Python Pandas Cheat Sheet: Master Data Manipulation in a Flash

Mastering Python Pandas: A Comprehensive Cheat Sheet

Python's Pandas library is a powerful data manipulation tool that simplifies data analysis and manipulation. Whether you're a beginner or an experienced data scientist, this cheat sheet will serve as a quick reference to help you make the most of Pandas.

Getting Started with Pandas

First, ensure you have Pandas installed. If not, you can install it using pip:

pip install pandas

Now, let's import Pandas and check its version:

import pandas as pd
print(pd.__version__)

Data Structures

Series

A Series is a one-dimensional labeled array capable of holding any data type (integers, strings, floating point numbers, Python objects).

s = pd.Series([1, 3, 5, np.nan, 6, 8], index=['a', 'b', 'c', 'd', 'e', 'f'])
print(s)

DataFrame

A DataFrame is a 2-dimensional labeled data structure with columns of potentially different types. You can create a DataFrame from lists, dictionaries, or even from a CSV file.

data = {
    'Name': ['Tom', 'Nick', 'John'],
    'Age': [20, 21, 19],
}
df = pd.DataFrame(data)
print(df)

Reading and Writing Data

Pandas provides functions to read and write data in various formats like CSV, Excel, SQL, and more.

Reading CSV

df = pd.read_csv('file.csv')
print(df.head())

Writing to CSV

df.to_csv('file.csv', index=False)

Data Cleaning and Preprocessing

Pandas offers numerous methods to clean and preprocess data, such as handling missing values, removing duplicates, and data type conversion.

Handling Missing Values

• dropna(): Remove rows/columns with missing values.
• fillna(): Fill missing values with a specified value or using interpolation.

Removing Duplicates

df.drop_duplicates(subset='column_name', keep='first')

Data Manipulation

Pandas provides various functions to manipulate data, including filtering, sorting, grouping, and merging.

Filtering Data

filtered_df = df[df['column_name'] > value]

Grouping Data

grouped_df = df.groupby('column_name').mean()

Merging DataFrames

merged_df = pd.merge(df1, df2, on='common_column')

Data Analysis

Pandas includes a wide range of statistical functions for data analysis, such as mean, median, mode, standard deviation, and more.

Descriptive Statistics

Use the describe() function to generate descriptive statistics that summarize the central tendency, dispersion, and shape of a dataset's distribution, excluding NaN values.

print(df.describe())

Tips and Tricks

Here are some tips and tricks to make your Pandas journey more efficient:

• Use head() and tail() functions to view the first or last few rows of a DataFrame.
• Use info() function to get a concise summary of a DataFrame, including index dtype and columns, non-null values and memory usage.
• Use value_counts() function to get the count of unique values in a column.

This cheat sheet covers the basics of Python Pandas. To learn more, explore the official Pandas documentation and keep practicing with real-world datasets. Happy data manipulation!