Data analytics and mash-up

1
Data analytics and mash-up

• Real time analytics of employment data
• Team Shadowfax

2
Agenda

• What are data analytics and mash-up?
• Architecture of web mash-up
• Implementation
• Implementation architecture
• How is it going to be useful to the user ?

3
Data analytics and mashup

• Data Analytics is examining of raw data from
  which we can retrieve the information after work
  around with the data
• In the data analytics there is no assumption of
  data unlike data mining where little
  adjustments are made to draw conclusion
• Includes data cleaning, transformation and
  documentation
• Data from different data sources are analyzed and
  converted into information after which all the
  information from different sources are clubbed
  together into a single data source and presented
  to the user in a useful fashion.

4
Data/Web mash-up

• Data mashup is data integration of structured,
  web unstructured information available freely
  on different sources
• More and more reusable structured data appears on
  the Web. Users want to extracts related data from
  various resources and combine in a human readable
  format, such as HTML, PDF, or text
• Challenges
• Structured, unstructured data is available
  on multiple public resources in various formats.
  There is a file format mismatch, schema mismatch,
  data representation mismatch. Hence first
  challenge is to extract this data into common
  data format.

5
Architecture of web mashup

• The basic idea is to extract, analyze, aggregate
  and visualize.
• Divided into three layers
• Presentation This is the user interface of
  mashups. The technologies used are JSP, HTML, and
  JavaScript
• Information Extraction and delivery The
  functionality to access data through APIs
  (LinkedIn or any other APIs)is provided using API
  service
• Data Data is retrieved from various open data
  sources and is managed in a database

6
Implementation

• Idea
• The basic concept System facilitating user to
  search for labor stats and related jobs
• Data Scavenging
• Exemplifying application Need for data.
• Employment/Unemployment Data
• Wdie range of data pools
• Various granularity level of data
• County specific data
• Zip code County connectedness
• Job related data

7
Implementation

• Data Transformation mashing
• Connecting 2 databases
• Simple Java Parser Implementation
• Loading final structured data into MySql.
• Information staging
• Shaped up data presentation to the user.
• J2EE
• MySQL
• JS REST API

8
Implementation architecture
9
How is it going to be useful to the user ?

• The information is presented to the user using a
  web page and is available to the user on the web
  any time from any place
• The information available with Linked In requires
  the user to be a registered user with them to
  share the job listing information with the user
• User would be able to search for a job based on
  his preference of region ,climate and others

10
References

• http//www.bls.gov
• http//www.populardata.com
• http//developer.linkedin.com
• http//birming.jvmhost.net

11

• Thank You!
• Demo

12

• QA