Pentingnya flat file dalam data science

Pengantar Mengimpor Data di Python

Hugo Bowne-Anderson

Data Scientist at DataCamp

Flat file

titanic.csv

PassengerId,Survived,Pclass,Name,Gender,Age,SibSp,Parch,Ticket,Fare,Cabin,Embarked
1,0,3,"Braund, Mr. Owen Harris",male,22,1,0,A/5 21171,7.25,,S
2,1,1,"Cumings, Mrs. John Bradley",female,38,1,0,PC 17599,71.2833,C85,C
3,1,3,"Heikkinen, Miss. Laina",female,26,0,0,STON/O2.3101282,7.925,,S
Pengantar Mengimpor Data di Python

Flat file

titanic.csv

PassengerId,Survived,Pclass,Name,Gender,Age,SibSp,Parch,Ticket,Fare,Cabin,Embarked

1,0,3,"Braund, Mr. Owen Harris",male,22,1,0,A/5 21171,7.25,,S

2,1,1,"Cumings, Mrs. John Bradley",female,38,1,0,PC 17599,71.2833,C85,C

3,1,3,"Heikkinen, Miss. Laina",female,26,0,0,STON/O2.3101282,7.925,,S

panah

                        Name      Sex  Cabin  Survived
     Braund, Mr. Owen Harris     male    NaN         0
  Cumings, Mrs. John Bradley   female    C85         1
      Heikkinen, Miss. Laina   female    NaN         1
Futrelle, Mrs. Jacques Heath   female   C123         1
    Allen, Mr. William Henry     male    NaN         0
Pengantar Mengimpor Data di Python

Flat file

titanic.csv

titanic.csv dengan satu baris disorot panah

                        Name      Sex  Cabin  Survived
     Braund, Mr. Owen Harris     male    NaN         0
  Cumings, Mrs. John Bradley   female    C85         1
      Heikkinen, Miss. Laina   female    NaN         1
Pengantar Mengimpor Data di Python

Flat file

titanic.csv

titanic.csv dengan satu kolom disorot panah

                        Name      Sex  Cabin  Survived
     Braund, Mr. Owen Harris     male    NaN         0
  Cumings, Mrs. John Bradley   female    C85         1
      Heikkinen, Miss. Laina   female    NaN         1
Pengantar Mengimpor Data di Python

Flat file

  • File teks berisi rekaman
  • Yaitu data tabel
  • Rekaman: baris berisi field atau atribut

 

titanic.csv

PassengerId,Survived,Pclass,Name,Gender,Age,SibSp,Parch,Ticket,Fare,Cabin,Embarked
1,0,3,"Braund, Mr. Owen Harris",male,22,1,0,A/5 21171,7.25,,S
2,1,1,"Cumings, Mrs. John Bradley",female,38,1,0,PC 17599,71.2833,C85,C
3,1,3,"Heikkinen, Miss. Laina",female,26,0,0,STON/O2.3101282,7.925,,S
Pengantar Mengimpor Data di Python

Flat file

  • File teks berisi rekaman
  • Yaitu data tabel
  • Rekaman: baris berisi field atau atribut
  • Kolom: fitur atau atribut

titanic.csv

titanic.csv dengan satu baris disorot panah

Pengantar Mengimpor Data di Python

Flat file

  • File teks berisi rekaman
  • Yaitu data tabel
  • Rekaman: baris berisi field atau atribut
  • Kolom: fitur atau atribut

titanic.csv

titanic.csv dengan satu kolom disorot panah

Pengantar Mengimpor Data di Python

Header

titanic.csv

________________________________________________________________________
PassengerId,Survived,Pclass,Name,Gender,Age,SibSp,Parch,Ticket,Fare,Cabin,Embarked
________________________________________________________________________
1,0,3,"Braund, Mr. Owen Harris",male,22,1,0,A/5 21171,7.25,,S   
2,1,1,"Cumings, Mrs. John Bradley",female,38,1,0,PC 17599,71.2833,C85,C
3,1,3,"Heikkinen, Miss. Laina",female,26,0,0,STON/O2.3101282,7.925,,S
Pengantar Mengimpor Data di Python

Header

titanic.csv

________________________________________________________________________
PassengerId,Survived,Pclass,Name,Gender,Age,SibSp,Parch,Ticket,Fare,Cabin,Embarked
________________________________________________________________________
1,0,3,"Braund, Mr. Owen Harris",male,22,1,0,A/5 21171,7.25,,S   
2,1,1,"Cumings, Mrs. John Bradley",female,38,1,0,PC 17599,71.2833,C85,C
3,1,3,"Heikkinen, Miss. Laina",female,26,0,0,STON/O2.3101282,7.925,,S
Pengantar Mengimpor Data di Python

Ekstensi file

  • .csv - Comma separated values
  • .txt - File teks
  • koma, tab - Delimiter
Pengantar Mengimpor Data di Python

File dipisah tab

MNIST.txt

pixel149    pixel150    pixel151    pixel152    pixel153
0           0           0           0           0    
86          250         254         254         254    
0           0           0           9           254    
0           0           0           0           0    
103         253         253         253         253    
0           0           0           0           0    
0           0           0           0           0        
0           0           0           0           41        
253         253         253         253         253
Pengantar Mengimpor Data di Python

File dipisah tab

MNIST.txt

pixel149    pixel150    pixel151    pixel152    pixel153
0           0           0           0           0    
86          250         254         254         254    
0           0           0           9           254    
0           0           0           0           0    
103         253         253         253         253    
0           0           0           0           0    
0           0           0           0           0        
0           0           0           0           41        
253         253         253         253         253

                                         Gambar MNIST: mnist.png

Pengantar Mengimpor Data di Python

Bagaimana mengimpor flat file?

  • Dua paket utama: NumPy, pandas

ch_1_2.026.png

  • Di sini, Anda akan belajar mengimpor:
    • Flat file dengan data numerik (MNIST)
    • Flat file dengan data numerik dan string (titanic.csv)
Pengantar Mengimpor Data di Python

Ayo berlatih!

Pengantar Mengimpor Data di Python

Preparing Video For Download...