Cheat Sheet for Data Cleaning in Python Pandas
1. Data Overview
2. Handling Missing Values and Duplicates
3. Renaming and Type Conversion
4. Filtering and Selection
5. Sorting and Grouping
6. Column Operations
7. Saving Cleaned Data
1. Data Overview
import pandas as pd
df = pd.read_csv('data.csv') # Load CSV
df.head(5) # First 5 rows
df.info() # Data types and null counts
df.describe() # Summary statistics
2. Handling Missing Values and Duplicates
df.isnull().sum() # Count missing values
df.dropna() # Remove rows with nulls
df.fillna(0) # Fill missing values with zeros
df.duplicated().sum() # Count duplicates
df.drop_duplicates() # Remove duplicates
3. Renaming and Type Conversion
df.rename(columns={'old': 'new'}) # Rename column
df.astype({'col': 'int'}) # Change data type
df.columns.str.strip() # Remove spaces
4. Filtering and Selection
df.loc[df['col'] > 100] # Filter by condition
df.iloc[0:5] # Select by row index
df['col'].isin(['A', 'B']) # Filter by values
5. Sorting and Grouping
df.sort_values('col') # Sort ascending
df.groupby('group')['val'].mean() # Group and aggregate
df['col'].value_counts() # Count unique values
6. Column Operations
df['new'] = df['col1'] + df['col2'] # New column
df['col'] = df['col'].apply(lambda x: x*2) # Apply function
df.drop('col', axis=1) # Drop column
7. Saving Cleaned Data
df.to_csv('cleaned.csv', index=False) # Export to CSV
β€4
π₯ Trending Repository: free-programming-books
π Description: π Freely available programming books
π Repository URL: https://github.com/EbookFoundation/free-programming-books
π Website: https://ebookfoundation.github.io/free-programming-books/
π Readme: https://github.com/EbookFoundation/free-programming-books#readme
π Statistics:
π Stars: 366K stars
π Watchers:
π΄ Forks: 63.9K forks
π» Programming Languages: Python - HTML
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: π Freely available programming books
π Repository URL: https://github.com/EbookFoundation/free-programming-books
π Website: https://ebookfoundation.github.io/free-programming-books/
π Readme: https://github.com/EbookFoundation/free-programming-books#readme
π Statistics:
π Stars: 366K stars
π Watchers:
π΄ Forks: 63.9K forks
π» Programming Languages: Python - HTML
π·οΈ Related Topics:
#education #list #books #resource #hacktoberfest
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: midday
π Description: Invoicing, Time tracking, File reconciliation, Storage, Financial Overview & your own Assistant made for Freelancers
π Repository URL: https://github.com/midday-ai/midday
π Website: https://midday.ai
π Readme: https://github.com/midday-ai/midday#readme
π Statistics:
π Stars: 11.1K stars
π Watchers: 68
π΄ Forks: 1K forks
π» Programming Languages: TypeScript - MDX - Rust - CSS - JavaScript - Dockerfile
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: Invoicing, Time tracking, File reconciliation, Storage, Financial Overview & your own Assistant made for Freelancers
π Repository URL: https://github.com/midday-ai/midday
π Website: https://midday.ai
π Readme: https://github.com/midday-ai/midday#readme
π Statistics:
π Stars: 11.1K stars
π Watchers: 68
π΄ Forks: 1K forks
π» Programming Languages: TypeScript - MDX - Rust - CSS - JavaScript - Dockerfile
π·οΈ Related Topics:
#finance #typescript #nextjs #tailwind #supabase
==================================
π§ By: https://t.iss.one/DataScienceM
π₯1
π₯ Trending Repository: yt-dlp
π Description: A feature-rich command-line audio/video downloader
π Repository URL: https://github.com/yt-dlp/yt-dlp
π Website: https://discord.gg/H5MNcFW63r
π Readme: https://github.com/yt-dlp/yt-dlp#readme
π Statistics:
π Stars: 124K stars
π Watchers: 640
π΄ Forks: 9.9K forks
π» Programming Languages: Python
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: A feature-rich command-line audio/video downloader
π Repository URL: https://github.com/yt-dlp/yt-dlp
π Website: https://discord.gg/H5MNcFW63r
π Readme: https://github.com/yt-dlp/yt-dlp#readme
π Statistics:
π Stars: 124K stars
π Watchers: 640
π΄ Forks: 9.9K forks
π» Programming Languages: Python
π·οΈ Related Topics:
#python #cli #downloader #youtube_dl #youtube_downloader #sponsorblock #yt_dlp
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: django
π Description: The Web framework for perfectionists with deadlines.
π Repository URL: https://github.com/django/django
π Website: https://www.djangoproject.com/
π Readme: https://github.com/django/django#readme
π Statistics:
π Stars: 84.7K stars
π Watchers: 2.3k
π΄ Forks: 32.8K forks
π» Programming Languages: Python - Jinja
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: The Web framework for perfectionists with deadlines.
π Repository URL: https://github.com/django/django
π Website: https://www.djangoproject.com/
π Readme: https://github.com/django/django#readme
π Statistics:
π Stars: 84.7K stars
π Watchers: 2.3k
π΄ Forks: 32.8K forks
π» Programming Languages: Python - Jinja
π·οΈ Related Topics:
#python #django #views #framework #orm #web #apps #templates #models
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: ComfyUI-nunchaku
π Description: ComfyUI Plugin of Nunchaku
π Repository URL: https://github.com/nunchaku-tech/ComfyUI-nunchaku
π Website: https://nunchaku.tech/docs/ComfyUI-nunchaku/
π Readme: https://github.com/nunchaku-tech/ComfyUI-nunchaku#readme
π Statistics:
π Stars: 1.9K stars
π Watchers: 21
π΄ Forks: 68 forks
π» Programming Languages: Python
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: ComfyUI Plugin of Nunchaku
π Repository URL: https://github.com/nunchaku-tech/ComfyUI-nunchaku
π Website: https://nunchaku.tech/docs/ComfyUI-nunchaku/
π Readme: https://github.com/nunchaku-tech/ComfyUI-nunchaku#readme
π Statistics:
π Stars: 1.9K stars
π Watchers: 21
π΄ Forks: 68 forks
π» Programming Languages: Python
π·οΈ Related Topics:
#flux #quantization #diffusion #mlsys #comfyui #genai
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: klipper
π Description: Klipper is a 3d-printer firmware
π Repository URL: https://github.com/Klipper3d/klipper
π Readme: https://github.com/Klipper3d/klipper#readme
π Statistics:
π Stars: 10.7K stars
π Watchers: 368
π΄ Forks: 5.6K forks
π» Programming Languages: C - Python - Jupyter Notebook - C++ - Assembly - Makefile
π·οΈ Related Topics: Not available
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: Klipper is a 3d-printer firmware
π Repository URL: https://github.com/Klipper3d/klipper
π Readme: https://github.com/Klipper3d/klipper#readme
π Statistics:
π Stars: 10.7K stars
π Watchers: 368
π΄ Forks: 5.6K forks
π» Programming Languages: C - Python - Jupyter Notebook - C++ - Assembly - Makefile
π·οΈ Related Topics: Not available
==================================
π§ By: https://t.iss.one/DataScienceM
β€1
π₯ Trending Repository: Java
π Description: All Algorithms implemented in Java
π Repository URL: https://github.com/TheAlgorithms/Java
π Readme: https://github.com/TheAlgorithms/Java#readme
π Statistics:
π Stars: 62.8K stars
π Watchers: 2.2k
π΄ Forks: 20.2K forks
π» Programming Languages: Java - Dockerfile
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: All Algorithms implemented in Java
π Repository URL: https://github.com/TheAlgorithms/Java
π Readme: https://github.com/TheAlgorithms/Java#readme
π Statistics:
π Stars: 62.8K stars
π Watchers: 2.2k
π΄ Forks: 20.2K forks
π» Programming Languages: Java - Dockerfile
π·οΈ Related Topics:
#search #java #algorithm #algorithms #sort #data_structures #sorting_algorithms #algorithm_challenges #hacktoberfest #algorithms_datastructures
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: Folo
π Description: π§‘ Follow everything in one place
π Repository URL: https://github.com/RSSNext/Folo
π Website: https://folo.is
π Readme: https://github.com/RSSNext/Folo#readme
π Statistics:
π Stars: 32K stars
π Watchers: 119
π΄ Forks: 1.5K forks
π» Programming Languages: TypeScript - Swift - JavaScript - CSS - Kotlin - HTML
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: π§‘ Follow everything in one place
π Repository URL: https://github.com/RSSNext/Folo
π Website: https://folo.is
π Readme: https://github.com/RSSNext/Folo#readme
π Statistics:
π Stars: 32K stars
π Watchers: 119
π΄ Forks: 1.5K forks
π» Programming Languages: TypeScript - Swift - JavaScript - CSS - Kotlin - HTML
π·οΈ Related Topics:
#rss #ai #rss_reader #blockchain #reader
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: ai-agents-for-beginners
π Description: 11 Lessons to Get Started Building AI Agents
π Repository URL: https://github.com/microsoft/ai-agents-for-beginners
π Website: https://microsoft.github.io/ai-agents-for-beginners/
π Readme: https://github.com/microsoft/ai-agents-for-beginners#readme
π Statistics:
π Stars: 34.9K stars
π Watchers: 328
π΄ Forks: 11.1K forks
π» Programming Languages: Jupyter Notebook - Python - Dockerfile
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: 11 Lessons to Get Started Building AI Agents
π Repository URL: https://github.com/microsoft/ai-agents-for-beginners
π Website: https://microsoft.github.io/ai-agents-for-beginners/
π Readme: https://github.com/microsoft/ai-agents-for-beginners#readme
π Statistics:
π Stars: 34.9K stars
π Watchers: 328
π΄ Forks: 11.1K forks
π» Programming Languages: Jupyter Notebook - Python - Dockerfile
π·οΈ Related Topics:
#ai_agents #autogen #generative_ai #semantic_kernel #ai_agents_framework #agentic_framework #agentic_rag #agentic_ai
==================================
π§ By: https://t.iss.one/DataScienceM
β€1
π₯ Trending Repository: verifiers
π Description: Verifiers for LLM Reinforcement Learning
π Repository URL: https://github.com/willccbb/verifiers
π Readme: https://github.com/willccbb/verifiers#readme
π Statistics:
π Stars: 2.1K stars
π Watchers: 26
π΄ Forks: 267 forks
π» Programming Languages: Python
π·οΈ Related Topics: Not available
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: Verifiers for LLM Reinforcement Learning
π Repository URL: https://github.com/willccbb/verifiers
π Readme: https://github.com/willccbb/verifiers#readme
π Statistics:
π Stars: 2.1K stars
π Watchers: 26
π΄ Forks: 267 forks
π» Programming Languages: Python
π·οΈ Related Topics: Not available
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: spotify-downloader
π Description: Download your Spotify playlists and songs along with album art and metadata (from YouTube if a match is found).
π Repository URL: https://github.com/spotDL/spotify-downloader
π Website: https://spotdl.readthedocs.io/en/latest/
π Readme: https://github.com/spotDL/spotify-downloader#readme
π Statistics:
π Stars: 21.3K stars
π Watchers: 197
π΄ Forks: 1.9K forks
π» Programming Languages: Python
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: Download your Spotify playlists and songs along with album art and metadata (from YouTube if a match is found).
π Repository URL: https://github.com/spotDL/spotify-downloader
π Website: https://spotdl.readthedocs.io/en/latest/
π Readme: https://github.com/spotDL/spotify-downloader#readme
π Statistics:
π Stars: 21.3K stars
π Watchers: 197
π΄ Forks: 1.9K forks
π» Programming Languages: Python
π·οΈ Related Topics:
#python #music #playlists #spotify #mp3 #song #hacktoberfest #youtube_music #song_lyrics #download_music #spotdl #spotdl_cli
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: github-readme-stats
π Description: β‘ Dynamically generated stats for your github readmes
π Repository URL: https://github.com/anuraghazra/github-readme-stats
π Website: https://github-readme-stats.vercel.app
π Readme: https://github.com/anuraghazra/github-readme-stats#readme
π Statistics:
π Stars: 75.3K stars
π Watchers: 291
π΄ Forks: 25.7K forks
π» Programming Languages: JavaScript - Shell
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: β‘ Dynamically generated stats for your github readmes
π Repository URL: https://github.com/anuraghazra/github-readme-stats
π Website: https://github-readme-stats.vercel.app
π Readme: https://github.com/anuraghazra/github-readme-stats#readme
π Statistics:
π Stars: 75.3K stars
π Watchers: 291
π΄ Forks: 25.7K forks
π» Programming Languages: JavaScript - Shell
π·οΈ Related Topics:
#serverless #dynamic #hacktoberfest #readme_generator #profile_readme #readme_stats
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: nn-zero-to-hero
π Description: Neural Networks: Zero to Hero
π Repository URL: https://github.com/karpathy/nn-zero-to-hero
π Readme: https://github.com/karpathy/nn-zero-to-hero#readme
π Statistics:
π Stars: 15.5K stars
π Watchers: 319
π΄ Forks: 2.2K forks
π» Programming Languages: Jupyter Notebook
π·οΈ Related Topics: Not available
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: Neural Networks: Zero to Hero
π Repository URL: https://github.com/karpathy/nn-zero-to-hero
π Readme: https://github.com/karpathy/nn-zero-to-hero#readme
π Statistics:
π Stars: 15.5K stars
π Watchers: 319
π΄ Forks: 2.2K forks
π» Programming Languages: Jupyter Notebook
π·οΈ Related Topics: Not available
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: system_prompts_leaks
π Description: Collection of extracted System Prompts from popular chatbots like ChatGPT, Claude & Gemini
π Repository URL: https://github.com/asgeirtj/system_prompts_leaks
π Readme: https://github.com/asgeirtj/system_prompts_leaks#readme
π Statistics:
π Stars: 9.2K stars
π Watchers: 200
π΄ Forks: 2K forks
π» Programming Languages: JavaScript
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: Collection of extracted System Prompts from popular chatbots like ChatGPT, Claude & Gemini
π Repository URL: https://github.com/asgeirtj/system_prompts_leaks
π Readme: https://github.com/asgeirtj/system_prompts_leaks#readme
π Statistics:
π Stars: 9.2K stars
π Watchers: 200
π΄ Forks: 2K forks
π» Programming Languages: JavaScript
π·οΈ Related Topics:
#ai #gemini #openai #chatbots #prompts #claude #google_deepmind #large_language_models #llm #prompt_engineering #generative_ai #chatgpt #prompt_injection #anthropic
==================================
π§ By: https://t.iss.one/DataScienceM
β€1
π₯ Trending Repository: generative-ai-for-beginners
π Description: 21 Lessons, Get Started Building with Generative AI
π Repository URL: https://github.com/microsoft/generative-ai-for-beginners
π Readme: https://github.com/microsoft/generative-ai-for-beginners#readme
π Statistics:
π Stars: 95.7K stars
π Watchers: 827
π΄ Forks: 50.1K forks
π» Programming Languages: Jupyter Notebook - Python - JavaScript - TypeScript - Shell - PowerShell
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: 21 Lessons, Get Started Building with Generative AI
π Repository URL: https://github.com/microsoft/generative-ai-for-beginners
π Readme: https://github.com/microsoft/generative-ai-for-beginners#readme
π Statistics:
π Stars: 95.7K stars
π Watchers: 827
π΄ Forks: 50.1K forks
π» Programming Languages: Jupyter Notebook - Python - JavaScript - TypeScript - Shell - PowerShell
π·οΈ Related Topics:
#ai #azure #transformers #openai #gpt #language_model #semantic_search #dall_e #prompt_engineering #llms #generative_ai #generativeai #chatgpt #microsoft_for_beginners
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: awesome-tuis
π Description: List of projects that provide terminal user interfaces
π Repository URL: https://github.com/rothgar/awesome-tuis
π Readme: https://github.com/rothgar/awesome-tuis#readme
π Statistics:
π Stars: 11.1K stars
π Watchers: 155
π΄ Forks: 430 forks
π» Programming Languages: Not available
π·οΈ Related Topics: Not available
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: List of projects that provide terminal user interfaces
π Repository URL: https://github.com/rothgar/awesome-tuis
π Readme: https://github.com/rothgar/awesome-tuis#readme
π Statistics:
π Stars: 11.1K stars
π Watchers: 155
π΄ Forks: 430 forks
π» Programming Languages: Not available
π·οΈ Related Topics: Not available
==================================
π§ By: https://t.iss.one/DataScienceM
β¨ Meet BLIP: The Vision-Language Model Powering Image Captioning β¨
π Table of Contents Meet BLIP: The Vision-Language Model Powering Image Captioning What Is Image Captioning and Why Is It Challenging? Why Itβs Challenging Why Traditional Vision Tasks Arenβt Enough Configuring Your Development Environment A Brief History of Image Captioning Modelsβ¦...
π·οΈ #ComputerVision #DeepLearning #ImageCaptioning #MultimodalAI #Tutorial
π Table of Contents Meet BLIP: The Vision-Language Model Powering Image Captioning What Is Image Captioning and Why Is It Challenging? Why Itβs Challenging Why Traditional Vision Tasks Arenβt Enough Configuring Your Development Environment A Brief History of Image Captioning Modelsβ¦...
π·οΈ #ComputerVision #DeepLearning #ImageCaptioning #MultimodalAI #Tutorial
β€1
π₯ Trending Repository: SurfSense
π Description: Open Source Alternative to NotebookLM / Perplexity, connected to external sources such as Search Engines, Slack, Linear, Jira, ClickUp, Confluence, Notion, YouTube, GitHub, Discord and more. Join our discord:https://discord.gg/ejRNvftDp9
π Repository URL: https://github.com/MODSetter/SurfSense
π Website: https://www.surfsense.net
π Readme: https://github.com/MODSetter/SurfSense#readme
π Statistics:
π Stars: 6.7K stars
π Watchers: 46
π΄ Forks: 507 forks
π» Programming Languages: Python - TypeScript - MDX - CSS - JavaScript - Dockerfile
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: Open Source Alternative to NotebookLM / Perplexity, connected to external sources such as Search Engines, Slack, Linear, Jira, ClickUp, Confluence, Notion, YouTube, GitHub, Discord and more. Join our discord:https://discord.gg/ejRNvftDp9
π Repository URL: https://github.com/MODSetter/SurfSense
π Website: https://www.surfsense.net
π Readme: https://github.com/MODSetter/SurfSense#readme
π Statistics:
π Stars: 6.7K stars
π Watchers: 46
π΄ Forks: 507 forks
π» Programming Languages: Python - TypeScript - MDX - CSS - JavaScript - Dockerfile
π·οΈ Related Topics:
#python #chrome_extension #slack #agent #jira #typescript #extension #ai #nextjs #agents #notion #perplexity #rag #fastapi #langchain #ollama #langgraph #nextjs15 #aceternity_ui #notebooklm
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: Seelen-UI
π Description: The Fully Customizable Desktop Environment for Windows 10/11.
π Repository URL: https://github.com/eythaann/Seelen-UI
π Readme: https://github.com/eythaann/Seelen-UI#readme
π Statistics:
π Stars: 10.7K stars
π Watchers: 45
π΄ Forks: 327 forks
π» Programming Languages: Rust - TypeScript - CSS - NSIS - SCSS - JavaScript
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: The Fully Customizable Desktop Environment for Windows 10/11.
π Repository URL: https://github.com/eythaann/Seelen-UI
π Readme: https://github.com/eythaann/Seelen-UI#readme
π Statistics:
π Stars: 10.7K stars
π Watchers: 45
π΄ Forks: 327 forks
π» Programming Languages: Rust - TypeScript - CSS - NSIS - SCSS - JavaScript
π·οΈ Related Topics:
#windows #wallpaper #web #tools #toolbar #finder #desktop_application #dock #taskbar #tiling_window_manager #multilanguage #topbar #tauri #web_technologies #app_launcher #windows_11 #tauri_app #seelen_ui #seelen
==================================
π§ By: https://t.iss.one/DataScienceM
π₯ Trending Repository: Summer2026-Internships
π Description: Collection of Summer 2026 tech internships!
π Repository URL: https://github.com/SimplifyJobs/Summer2026-Internships
π Website: https://swelist.com/
π Readme: https://github.com/SimplifyJobs/Summer2026-Internships#readme
π Statistics:
π Stars: 40.3K stars
π Watchers: 1.6k
π΄ Forks: 3K forks
π» Programming Languages: Not available
π·οΈ Related Topics:
==================================
π§ By: https://t.iss.one/DataScienceM
π Description: Collection of Summer 2026 tech internships!
π Repository URL: https://github.com/SimplifyJobs/Summer2026-Internships
π Website: https://swelist.com/
π Readme: https://github.com/SimplifyJobs/Summer2026-Internships#readme
π Statistics:
π Stars: 40.3K stars
π Watchers: 1.6k
π΄ Forks: 3K forks
π» Programming Languages: Not available
π·οΈ Related Topics:
#university #jobs #internships #interview_preparation
==================================
π§ By: https://t.iss.one/DataScienceM
β€1