Data Exploration Checklist

-

 

Explore Checklist

What is your data telling you?

⏹ Inspect your data: If your dataset isn’t too large, read through your data to assess whether interesting information jumps out

⏹ Use summary statistics: Evaluate your data by summarizing it (categorize, use statistics like average, standard deviation, etc.)

⏹ Inspect a random sample of your data: if your dataset is too large, a random sample may give you some initial information

Visualizing data

⏹ Visualize your data using bar charts, line charts or scatter plots to examine information hidden in your dataset. 

Bar charts Line charts Scatter plots

Examine variable distributions

⏹ Inspect the distribution of your data 

  • Categorize the data 

  • Plot the categorized data

Common data distributions:

Normal Bimodal Log-normal Exponential Uniform

Learn more about your data:

⏹ Evaluate the minimum

⏹ Evaluate the maximum

⏹ Evaluate the mode

⏹ Evaluate the standard deviation

Examine variable relationships

⏹ Visualize variables to understand their correlation

Common visualizations: 

Scatter plot Line chart

⏹ Calculate the correlation coefficient to understand the strength of the correlation

0  = no correlation

1   = perfect positive correlation

-1 = perfect negative correlation

Feature engineering

⏹ Evaluate whether we can create new features or modify existing ones to better understand our data

Comments

Post a Comment

Popular posts from this blog

IELTS Writing Task 1 - Process

-
Image
  Question: The diagram below shows the process for recycling plastic bottles. Summarise the information by selecting and reporting the main features, and make comparisons where relevant. Answer: The flowchart illustrates the process of plastic bottles recycling. In general, the process of recycling involves at least 9 steps from collecting the bottle all the way to ready to use products such as fabrics or a new plastic. It all starts from waste bin where all waste is collected. The content of waste bin is carried using truck to recycling centre where waste is sorted according to its type. At this point, plastic bottles are collected then compressed into blocks to ease the transportation. These blocks then transported to another plant where the plastic blocks are crushed and washed. This makes plastic clean and smaller in size that ready to be used as ingredient of producing plastic pellets. In order to create raw material, the plastic pellets are heated to from in a special sh...
Read more

IELTS Writing task 2

-
 Writing Task 2 Question: In some countries, more and more people are becoming interested in finding out about the history of the house or building they live in. What are the reasons for this? How can people research this? Answer: There is increasing interest of home owners all around the world to get to know about the history of the building they live in. This curiosity gives some benefits one of them is to know the age of the building knowing how old the building will help the home owners to identify the need of reconstruction. Some buildings are designed to last a few years, and get the exact number of age of the building will the determine the house is rebuilt or abolish. Another advantage is understanding the surrounding cultures and changed that happen along. Many building started with humble beginning and turn to urban areas as the population grow. It might also change the culture that follow the ethnicity that live there. Many areas starts from a single ethnicity and become...
Read more

IELTS Academic Writing Task 1 - Map

-
Image
  Question:  The plans below show the site of an airport now and how it will look after redevelopment next year. Summarise the information by selecting and reporting the main features, and make comparisons where relevant. Answer: The maps illustrate the changes of southwest airport from existing layout to after development. Overall, there will be several expansions and features and facilities added inside the airport. There will be two expansions built in the airport. First, the waiting room. Southwest Airport will have 10 additional to gates from only 8 gates now to 18 gates after development. The area will be also larger with the extension to northwest and northeast so that it will look like a V shape. Sky train will be built to support travelers to ease mobilization. Small section of the arrival hall is also added and will be used for car hire. Other then sky train, there will be also bag drop located at the left-upper corner departure hall. It will replace the check-in...
Read more