Data sources

Understanding Data Science

Sara Billen

Curriculum Manager

The data science workflow

Sources of data

Company data

• Collected by companies
• Helps them make data-driven decisions

Open data

• Free, open data sources
• Can be used, shared, and built-on by anyone

Company data

• Web events
• Survey data
• Customer data
• Logistics data
• Financial transactions

Web data

event_name	timestamp	user_id
homepage_visit	2019-01-01 12:01:01	1234

 

• Events
• Timestamps
• User information

Survey data

• Asking people for their opinions
• Methods:
  • Face-to-face interview
  • Online questionnaire
  • Focus group

 

Net Promoter Score

Open data

• Data APIs
• Public records

Public data APIs

• Application Programming Interface
• Request data over the internet

• Twitter
• Wikipedia
• Yahoo! Finance
• Google Maps
• Many more!

Tracking a hashtag

• All tweets with #DataFramed (DataCamp's podcast!)
• Use Twitter API

Public records

• International organizations
  • e.g.: World Bank, UN, WTO
• National statistical offices
  • e.g.: censuses, surveys
• Government agencies
  • e.g.: weather, environment, population

 

• For the US, data.gov
• For the EU, data.europa.eu

 

Let's practice!

Understanding Data Science