It is important to know and be able to classify the drivers’ behavior as good, bad, keen or aggressive, which would aid in driver assist systems to avoid vehicle crashes. This research attempts to develop, test, and compare the performance of machine learning methods for classifying human driving behavior. It also proposes to correlate driver affective states with the driving behavior. The major contributions of this work are to classify the driver behavior using Electroencephalograph (EEG) while driving simulated vehicle and compare them with the behavior classified using vehicle parameters and affective states. The study involved both classical machine learning techniques such as k-Nearest Neighbor (KNN), Support Vector Machine (SVM), Artificial Neural Network (ANN) and latest “unsupervised” Hybrid Deep Learning techniques, and compared the accuracy of classification across subjects, various driving scenarios and affective states.