In [1]:
from sklearn_benchmarks.reporting.utils import ReportingInfo
from pathlib import Path
import pandas as pd
from sklearn_benchmarks.utils import default_results_directory
pd.set_option('display.max_colwidth', None)
pd.set_option('display.max_columns', None)
pd.set_option('display.max_rows', None)

sklearn_benchmarks reporting¶

In [2]:
results_dir = default_results_directory()
In [3]:
# Parameters
results_dir = "./results/local/20220315T132911/"
In [4]:
results_dir = Path(results_dir)
In [5]:
reporting_info = ReportingInfo(results_dir=results_dir)
reporting_info.display()

Last run: Tuesday 15 March, 2022 at 13:29:12.

Notebooks¶

scikit-learn-intelex (Intel® oneAPI) vs. scikit-learn benchmarks

ONNX Runtime (Microsoft) vs. scikit-learn benchmarks

Gradient boosting: randomized HPO benchmarks

Benchmark environment information¶

System¶

python 3.8.12 | packaged by conda-forge | (default, Jan 30 2022, 23:42:07) [GCC 9.4.0]
executable /usr/share/miniconda/envs/sklbench/bin/python
machine Linux-5.11.0-1028-azure-x86_64-with-glibc2.10

Dependencies¶

version
pip 22.0.4
setuptools 60.9.3
sklearn 1.0.2
numpy 1.22.3
scipy 1.8.0
Cython None
pandas 1.4.1
matplotlib 3.5.1
joblib 1.1.0
threadpoolctl 3.1.0

Threadpool¶

user_api internal_api prefix filepath version threading_layer architecture num_threads
0 blas openblas libopenblas /usr/share/miniconda/envs/sklbench/lib/libopenblasp-r0.3.18.so 0.3.18 pthreads Haswell 2
1 openmp openmp libgomp /usr/share/miniconda/envs/sklbench/lib/libgomp.so.1.0.0 None NaN NaN 2

CPU count¶

cpu_count 2
physical_cpu_count 2

Time report¶

Total time elapsed: 1h 38m 56s

Hyperparameters match benchmarks¶

time elapsed
estimator
sklearnex_PCA 4s
sklearnex_Ridge 10s
sklearnex_KMeans_short 12s
sklearn_PCA 17s
sklearn_Ridge 19s
sklearn_KMeans_short 21s
sklearnex_LinearRegression 28s
sklearn_TSNE 30s
sklearnex_TSNE 32s
sklearnex_KNeighborsClassifier_brute_force 42s
sklearnex_LogisticRegression 47s
sklearn_LogisticRegression 59s
sklearn_LinearRegression 1m 3s
sklearnex_KMeans_tall 1m 10s
sklearnex_KNeighborsClassifier_kd_tree 1m 15s
sklearn_KMeans_tall 1m 28s
sklearn_HistGradientBoostingClassifier_best 2m 26s
sklearnex_DBSCAN 2m 42s
sklearn_KNeighborsClassifier_kd_tree 4m 50s
sklearn_DBSCAN 11m 31s
sklearn_KNeighborsClassifier_brute_force 14m 3s

Hyperparameters optimization benchmarks¶

time elapsed
estimator
catboost_lossguide 10m 12s
lightgbm 10m 19s
xgboost 10m 19s
sklearn_HistGradientBoostingClassifier 11m 2s
catboost_symmetric 11m 15s