PythonBeginner
Reading CSV Files with pandas
Load a real CSV into pandas deliberately, validate its shape and types, and avoid the ingestion assumptions that cause downstream data problems.
Data and analytics
Data engineering, analytics and production Python workflows.
Python content covering pandas, DataFrames, PySpark, performance and practical data-platform work.
Curated path
PythonBeginner
Load a real CSV into pandas deliberately, validate its shape and types, and avoid the ingestion assumptions that cause downstream data problems.
PythonBeginner
Profile a pandas DataFrame systematically with shape, schema, samples, null counts, uniqueness and distribution checks before transforming it.
PythonBeginner
Build readable, null-safe pandas filters for realistic order questions and validate the result instead of relying on fragile expressions.
PythonIntermediate
Build trustworthy pandas summaries by defining grain, revenue rules, null behavior and joins before grouping real order data.
PythonIntermediate
Join pandas DataFrames safely with explicit cardinality, unmatched-key checks, indicators and row-count reconciliation.
Interview preparation
Practice Python questions for data engineers on data structures, generators, exceptions, large files, pandas, testing, memory and production pipelines.
Practice Python questions →PythonIntermediate
Learn how to unit test PySpark DataFrame transformations with pytest using small deterministic datasets, schema assertions, fixtures, edge cases and reusable testing patterns, and where unit tests stop and integration tests begin.
Microsoft FabricIntermediate
Compare Microsoft Fabric Runtime 2.0, 1.3, and 1.2 across Spark, Python, Java, Scala, Delta Lake, performance, lifecycle, compatibility, and migration risk.
PythonIntermediate
See what actually got faster in Python 3.15, including JIT improvements, startup behavior, standard-library optimizations, profiling, and how to benchmark your own code.
Microsoft FabricIntermediate
Compare pandas, Polars, DuckDB, PySpark and Spark SQL in Microsoft Fabric by speed, memory use, data size, Delta support and scale, with measured results from a real Fabric benchmark and practical guidance for choosing the right engine.
Microsoft FabricBeginner
Learn PySpark in Microsoft Fabric step by step by reading Lakehouse data, filtering rows, creating columns, aggregating, joining, using Spark SQL and writing a Delta result.
DevOps & ObservabilityIntermediate
How to design data-quality checks that actually protect a pipeline: row-level and dataset-level rules, severity and actions, quarantine with reason codes, thresholds from baselines, recorded evidence, tests for the checks themselves, and Microsoft Fabric's built-in options.
DevOps & ObservabilityAdvanced
How to prove an incremental load produces the correct final state when it reruns, replays data, receives late or out-of-order records, or recovers from a partial failure: guarantees, a full-load oracle, watermark and MERGE tests, invariants, metamorphic tests and a tested PySpark suite.
DevOps & ObservabilityAdvanced
A practical architecture for testing production data platforms: unit and transformation tests, data-quality checks, SQL Server and PySpark testing, Microsoft Fabric pipelines and notebooks, integration tests, deployment validation and the CI/CD quality gates that decide whether a change reaches production.
Diagnose common pandas failures involving dtypes, missing values, joins, chained assignment, duplicate data, datetime errors, memory pressure, and unexpected row-count changes.
Filter pandas DataFrame rows safely and clearly using boolean masks, multiple conditions, membership tests, string/date filters, null checks, and query expressions.
Group pandas data by business keys, calculate reliable aggregations, preserve row-level context with transform, and avoid common mistakes with nulls, duplicates, and mixed aggregation logic.
Inspect, filter, fill, drop, and validate missing values in pandas without silently changing the meaning or dtype of production data.
Inspect a pandas DataFrame quickly and safely to understand its shape, columns, data types, nulls, duplicates, distributions, and suspicious values before transforming data.
Join pandas DataFrames safely by validating keys, cardinality, null behavior, duplicate expansion, and row-count changes before trusting the result.
Microsoft FabricIntermediate
A hands-on guide to Microsoft Fabric Real-Time Intelligence: send service telemetry through an eventstream into an Eventhouse, query and window it with KQL, compare Eventstream, KQL and Spark Structured Streaming, and break and fix the flow on purpose.
PythonIntermediate
Compare Python 3.15 with 3.14: the practical language, runtime and profiling changes, compatibility risks, and a focused upgrade checklist.
Microsoft FabricIntermediate
A practical Microsoft Fabric notebook tutorial covering Lakehouse attachment, PySpark and SQL, Delta tables, parameters, pipelines, Git, monitoring, performance, and production readiness.
Microsoft FabricBeginner
Create a Microsoft Fabric notebook, attach it to a Lakehouse, build a small dataset with PySpark, write it as a Delta table and query it with Spark SQL, with every step explained.
PythonIntermediate
See what changed from Python 3.11 through 3.15, which features arrived in each release, what may break, and how to plan an upgrade.
Delta LakeAdvanced
Why Delta MERGE gets slow on large tables and the patterns that keep it fast: clean sources, pruning predicates, fewer touched files, sane file sizes, safe concurrency and knowing when not to MERGE.