All projects
Research Project CompleteFall 2024 — Independent ResearchData Scientist & Physicist — Model Architecture, Training & Evaluation

Higgs Boson Signal Classification

A deep learning pipeline classifying rare Higgs boson decay events (H → ZZ → 4ℓ) from overwhelming standard model backgrounds using simulated CMS Open Data.

PyTorchDeep LearningPhysicsData SciencePython

Overview

This project focuses on identifying the Higgs boson, a fundamental particle that gives mass to other elementary particles, through its decay into two Z bosons, which subsequently decay into four leptons (H → ZZ → 4ℓ). This decay channel is often called the 'golden channel' due to its clean experimental signature, but it is extremely rare and buried under significant background processes.

Using a dataset of 218,632 simulated events based on CMS Open Data, our team constructed a binary classification pipeline to distinguish the Higgs signal from three primary background processes: ZZ → 4e, ZZ → 2e2μ, and ZZ → 4μ. The key input features for the model were the reconstructed mass of the Higgs candidate, and the masses of the two Z bosons.

The core of the project was a custom Feed-Forward Deep Neural Network (DNN) implemented in PyTorch. The architecture featured a Linear input layer, a ReLU activation hidden layer, and a Sigmoid output layer for binary classification. The model was trained using Binary Cross-Entropy Loss and the Adam optimizer over 1000 epochs, achieving a highly successful 97.3% training accuracy and 97.1% validation accuracy, demonstrating strong generalization without overfitting.

Performance evaluation involved comprehensive analysis including Receiver Operating Characteristic (ROC) curves with an Area Under Curve (AUC) of ~0.99, demonstrating exceptional signal-to-background discrimination. The project culminated in a detailed presentation and poster summarizing the methodology and physics implications.

Interactive Code Notebook

Loading interactive notebook...

Interactive Jupyter Notebook — Scroll to view code, click 'Run' to execute and reveal outputs.

Process

  1. 01 — Data Ingestion & Preprocessing

    Extracting ROOT files and standardizing features

    Loaded signal and background datasets from CMS Open Data ROOT files using uproot. Extracted key kinematic variables (Higgs_mass, Z1_mass, Z2_mass) and standardized the feature set using scikit-learn's StandardScaler for optimal neural network convergence.

  2. 02 — Model Architecture

    Designing the PyTorch DNN

    Constructed a custom feed-forward neural network in PyTorch, utilizing a hidden layer with ReLU activation to capture non-linear relationships in the particle kinematics, followed by a sigmoid output for binary probability scoring.

  3. 03 — Training & Optimization

    Model fitting and loss minimization

    Trained the network using Binary Cross-Entropy (BCE) loss and the Adam optimizer. Continuously monitored training and validation loss/accuracy across 1000 epochs to prevent overfitting and ensure robust generalization.

  4. 04 — Physics Evaluation

    Analyzing model discrimination power

    Evaluated the trained model using ROC curves and AUC metrics for each specific background process. Plotted DNN score distributions to visually verify the network's ability to successfully separate the rare Higgs signal from dominant standard model backgrounds.

Engineering Details

Dataset Composition

Process TypeDecay ChannelLabelDescription
SignalH → ZZ → 4ℓ1.0Higgs boson decaying to four leptons (electrons/muons)
BackgroundZZ → 4e0.0Standard model production of 4 electrons
BackgroundZZ → 2e2μ0.0Standard model production of 2 electrons and 2 muons
BackgroundZZ → 4μ0.0Standard model production of 4 muons

Model Architecture & Hyperparameters

ParameterConfigurationNotes
Input Features3Higgs_mass, Z1_mass, Z2_mass
Hidden Layer16 nodesReLU activation function
Output Layer1 nodeSigmoid activation for binary classification
Loss FunctionBinary Cross-Entropy (BCE)Standard for binary probability tasks
OptimizerAdamLearning rate = 0.5
Epochs1000With early stopping validation monitoring