Data Analysis 📈 using Python 🐍
- Data analysis is a process of inspecting, cleansing, transforming, and modeling data with the goal of discovering useful information, informing conclusions, and supporting decision-making.
Why is python an excellent option for data analysis ❓ 🤔
1. Easy to learn 🤩
Python is focused on simplicity as well as readability, providing a host of helpful options for data analysts/scientists simultaneously. Thus, newbies can easily utilize its pretty simple syntax to build effective solutions even for complex scenarios.
2. Well-supported 💁♂️
Being in widespread use in industrial alongside academic areas, Python has a broad array of helpful libraries with tons of helpful and support materials. The great benefit is that all the libraries are available at no cost.
3. Graphics and Visualization Tools 🎆
You can make the data more accessible and easier-to-use by means of creating various charts and graphics, as well as web-ready interactive plots. Yes, Python provides you with the capability to get a good sense of data.
4. Extended packs of analytics tools available 🔧🔨
Straight after you gather data, you’re to handle it. Python suits this purpose supremely well. So, seeking for the perfect tool for complex data processing or self-service analytics, we can’t but mention Python’s built-in data analytics tools.
Future and scope of the field 🔮
As companies are becoming more tech-driven and fast-paced now, data analysis professional are already playing an increasingly crucial role in businesses. Both startups and tech giants in India are adding data analysts to their workforce who are able of recording, analyzing and dissecting data to drive efficient decision-making.
Install and setup (Optional) 🚧
For running the tools for data analysis you have two options:
- Anaconda and Jupyter Notebooks
- Google Collaboratory We’ve given the instructions for 1️⃣ below, because there’s no setting up to do for 2️⃣!!
Install Anaconda 🐍
Anaconda puts nearly all of the tools that we’re going to need into a neat little package: the Python core language, an improved REPL environment called Jupyter, numeric computing libraries (NumPy, pandas), plotting libraries (seaborn, matplotlib), and statistics and machine learning libraries (SciPy, scikit-learn, statsmodels). We’ll use Anaconda’s installer to handle setting up the environment that we’ll work in. In order to keep the size of the download small, we actually use a minimum set of packages called Miniconda.
Miniconda installer packages:
Not on the system with that variant or needed another version? Check out the conda documantation at this link. Note: It’s easiest just to use Anaconda’s defaults in the installer. You don’t have to change anything unless you’re sure you want something different.
Set up your environment 🌆
Check out the environment files for windows and osx that we’ve given in this sub-repo
osx-environment.yml. Copy it to your device and save it in a location, preferrably as
Once that’s done, open the command line by doing the following:
Windows - Hit “Start” and then type “Command Prompt” and use that terminal.
OSX - Type
Cmd+Space and then enter Terminal in the search box to open the terminal.
Run the following commands, which will install the package and put you in the tutorial environment.
conda env create -f <PATH_TO_ENVIRONMENT.YML>
- You’ll need to replace <PATH_TO_ENVIRONMENT.YML> with the actual path where the file was downloaded.
For OSX, that’s often
For Windows, it is usually
You’ll have to replace with your username on your machine.
That will download all the set of packages that are commonly used for data science in Python. When it finishes, you can activate the environment with the following command:
source activate tutorial
Run the jupyter notebook! 📓
In this step, we’ll make sure everything is working by running the Jupyter Notebook. Jupyter Notebook is a tool for doing interactive data science work in your browser.
In your command prompt with the tutorial environment activated (Note: you’ll be able to tell because your command prompt will say (tutorial) at the start of it.)
Type the following command:
A browser window will open, showing the Jupyer environment. By default, you will be in a file browser view.
In the file browser, find where you have a Jupyter notebook. Check out the materials we’ve attached by the end of each curriculum documantation, if you wanna see it run!
Click on one of the notebook (*.ipynb) files to get started!
Stop the notebook 🛑
Ctrl+c to stop the Jupyter notebook server running on your machine. (Make sure to use
Ctrl+s in the notebook to save it first!)
Leave the tutorial environment 🚶♀️
source deactivate tutorial
Now let’s see the curriculum!
Let’s check out what you’re gonna learn throughout this path 🧘♀️🧘♂️
1. Let’s start with numpy #️⃣
So we’ll start off with numpy, a highly useful python module for numerical analysis of data and arrays
- You’ll learn numerical computing using numpy here!
💡 Resource 💡 Resource
2. Pandas 🐼
Pandas is another useful python module in reading and handling data 💻
Things you’ll learn here are:
- Creating Data Frames using Pandas module
- Handling Tabular data
- Reading different file formats such as CSV, JSON, HTML and Excel files
- Data Cleaning and Preprocessing
- Handling missing data
- Normalization technique
- Filling Missing values
- Dealing with outliers
Matplotlib 🗺 and Seaborn 🌊
We’ll get introduced to two efficient modules for data visualization, Matplotlib and Seaborn 📊📈
Things you’ll learn here are:
- Data visualization with Matplotlib & Seaborn modules
- Creating Scatter plot, Box plot, Histogram & Pie chart with Matplotlib module
- Distribution plots and Categorical Plots with Seaborn Module
More on data analysis 👨🔬
Finally we’ll be going through some types of data analysis. Here you’ll be learning:
- Univariate,Bivariate and MultiVariate Analysis
- Exploratory Data Analysis ( EDA ) on a Dataset covering all the previously taught topics
Handling errors & finding solutions 🕵️♀️
- Finding bugs 🐛 may be considered as comparatively easier since execution stops right when an error is encountered.
- As they say, “help with always be found for those who ask for it”, you’ll find a large and vast community online to clear your doubts and help you with bugs and fixes. You’ll find solutions in stackoveflow or you can always clarify doubts in our discord server!