...
A good classifier should give an a high TPR and a small FPR.
...
Note that we have not used the low-level features in the training phase of our models, they behaved as spectator variables. We will plot the distribution of events considering their actual label (in the legend signal and background) and the distributions for the two classes that our classifiers has have built after having fixed a threshold on their output scores.
Question to students: look at the plots and comment on them. Taking into account the physics processes involved, did you expect these distributions?
Hint: The data set datasets are simulated events in which the Higgs boson is produced with a mass of 125 GeV. Therefore, we expect to see one on-mass-shell Z boson and another off-mass-shell Z boson.
...
Question to students: Merge the backgrounds used up to now for the training of our ML algos algorithms together with the ROOT File named ttH_HToZZ_4L.root. In this case, you will use also the QCD irreducible background. Uncomment the correct lines of code to proceed!
...
Once you manage to improve the network (random forest) performances, you can submit your results and participate to in our ML challenge. The challenge samples are available in this workspace, but the true labels (isSignal) are removed , so that you can't compute the AUC.
- You can participate as a single participant or as a team
- The winner is the one scoring the best AUC in the challenge samples!
- In the next box, you will find some lines of code for preparing an output csv file, containing your y_predic for this new data setsdataset!
- Choose a meaningful name for your result csv file (i.e. your name, or your team name, the model used for the training phase, and the decay channel - 4
or 4
- but avoid to submit
results.csv) - Download the csv file and upload it here: https://recascloud.ba.infn.it/index.php/s/CnoZuNrlr3x7uPI
- You can submit multiple results, paying attention to name them accordingly (add the version number, such as
v1,v34, etc.) - You can use this exercise as a starting point (train over constituents)
- We will consider your best result for the final score.
- The winner will be asked to present the ML architecture!
...