42.67. Support Vector Machines (SVM) - Classification#

Support Vector Machines are the type of supervised learning algorithms used for regression, classification and detecting outliers. SVMs are remarkably one of the powerful models in classical machine learning suited for handling complex and high dimensional datasets.

With SVM supporting different kernels (linear, polynomial, Radial Basis Function(rbf), and sigmoid), SVM can tackle different kinds of datasets, both linear and non linear.

While the maths behind the SVMs are beyond the scope of this notebook, here is the idea behind SVMs:

The way SVM works can be compared to a street with a boundary line. During SVM training, SMV draws the large margin or decision boundary between classes based on the importance of each training data point. The training data points that are inside the decision boundary are called support vectors and hence the name.

SVM

Image source: Wikimedia

We are going to use Iris flower dataset.The dataset contain 3 species which are: Iris Setosa, Iris Virginica, Iris Versicolor. These species are what we can refer to categories/classes. The features are sepal length, sepal width, petal length, petal width. All features were measured in centimeters(cm).

There are 50 samples for each specy, so we have 150 samples for all species. Below are the pictures of these 3 species.

from IPython.display import Image

url_setosa = "../../../../images/ml-fundamentals/Kosaciec_szczecinkowaty_Iris_setosa.jpg"
url_virginica =  "../../../../images/ml-fundamentals/Iris_virginica.jpg"
url_versicolor =  "../../../../images/ml-fundamentals/Iris_versicolor_3.jpg"

urls = [url_setosa, url_virginica,url_versicolor]

def display_image(url):
    
    image = Image(url, width=250, height=200)
    
    return image

# Displaying Iris Setosa
display_image(urls[0])
../../../_images/support_vector_machines_for_classification_4_0.jpg 
# Displaying Iris Virginica
display_image(urls[1])
../../../_images/support_vector_machines_for_classification_5_0.jpg 
# Displaying Iris Versicolor
display_image(urls[2])
../../../_images/support_vector_machines_for_classification_6_0.jpg

42.67.1. Contents#

42.67.2. 1 - Imports#

import numpy as np
import pandas as pd
import seaborn as sns
import sklearn
import matplotlib.pyplot as plt
%matplotlib inline

42.67.3. 2 - Loading the data#

We will get Iris data from Sklearn datasets. Setting as_frame parameter to True will return data as a Pandas Dataframe.

data = pd.read_csv("../../../assets/data/iris_support.csv")
X = data
print(type(data))
X.head()
y = data['target']
print(type(y))

<class 'pandas.core.frame.DataFrame'>
<class 'pandas.core.series.Series'>

X.info()

<class 'pandas.core.frame.DataFrame'>
RangeIndex: 150 entries, 0 to 149
Data columns (total 5 columns):
 #   Column             Non-Null Count  Dtype  
---  ------             --------------  -----  
 0   sepal length (cm)  150 non-null    float64
 1   sepal width (cm)   150 non-null    float64
 2   petal length (cm)  150 non-null    float64
 3   petal width (cm)   150 non-null    float64
 4   target             150 non-null    int64  
dtypes: float64(4), int64(1)
memory usage: 6.0 KB

X.head()
sepal length (cm) sepal width (cm) petal length (cm) petal width (cm) target
0 5.1 3.5 1.4 0.2 0
1 4.9 3.0 1.4 0.2 0
2 4.7 3.2 1.3 0.2 0
3 4.6 3.1 1.5 0.2 0
4 5.0 3.6 1.4 0.2 0 
y.head()

0    0
1    0
2    0
3    0
4    0
Name: target, dtype: int64

42.67.4. 3 - Exploratory Analysis#

Before exploring some insight in data, let’s split it into test and train set.

from sklearn.model_selection import train_test_split

X_train, X_test, y_train, y_test = train_test_split(X,y, test_size=0.2,random_state=20)

print('The size of training data is: {} \nThe size of testing data is: {}'.format(len(X_train), len(X_test)))

The size of training data is: 120 
The size of testing data is: 30

# Three species

y_train.value_counts()

0    42
1    39
2    39
Name: target, dtype: int64

Plotting the histograms of all 4 features

X_train.hist(bins=30, figsize=(20,15))
plt.show()
../../../_images/support_vector_machines_for_classification_19_0.png

Plotting the scatter plots of the features

sns.scatterplot(data=X_train, x='sepal length (cm)', y='sepal width (cm)', hue=y_train)

<AxesSubplot: xlabel='sepal length (cm)', ylabel='sepal width (cm)'>
../../../_images/support_vector_machines_for_classification_21_1.png 
sns.scatterplot(data=X_train, x='petal length (cm)', y='petal width (cm)', hue=y_train)

<AxesSubplot: xlabel='petal length (cm)', ylabel='petal width (cm)'>
../../../_images/support_vector_machines_for_classification_22_1.png

42.67.5. 4 - Data Preprocessing#

The features already have small values but let’s scale them to be between 0 and 1. SVM work well with scaled values. I will set up a pipeline to handle that.

X_train.max()

sepal length (cm)    7.9
sepal width (cm)     4.4
petal length (cm)    6.9
petal width (cm)     2.5
target               2.0
dtype: float64

from sklearn.pipeline import Pipeline
from sklearn.preprocessing import MinMaxScaler

scale_pipe = Pipeline([
    ('scaler', MinMaxScaler())
])

X_train_scaled = scale_pipe.fit_transform(X_train)

42.67.6. 5 - Training Support Vector Classifier#

We are going to train two classifiers: Linear SVC and SVC that we can use different kernels. SVM supports linear, polynomial, sigmoid and rbf kernels.

from sklearn.svm import LinearSVC, SVC

lin_svc = LinearSVC()
lin_svc.fit(X_train_scaled, y_train)

LinearSVC()
In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.
poly_svc = SVC(kernel='poly')

poly_svc.fit(X_train_scaled, y_train)

SVC(kernel='poly')
In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.

42.67.7. 6 - Evaluating Support Vector Classifier#

Let’s first check the accuracy on the training. For this step since we are trying to find model to improve further, we won’t touch test set yet.

from sklearn.metrics import accuracy_score

lin_pred = lin_svc.predict(X_train_scaled)

accuracy_score(y_train, lin_pred)

1.0

from sklearn.metrics import accuracy_score

poly_pred = poly_svc.predict(X_train_scaled)

accuracy_score(y_train, poly_pred)

1.0

We can also display the confusion matrix and the classification report on SVC with polynomial kernel. Classification report goes beyond accuracy to recall, precision, and f1 score.

from sklearn.metrics import confusion_matrix, classification_report

confusion_matrix(y_train, poly_pred)

array([[42,  0,  0],
       [ 0, 39,  0],
       [ 0,  0, 39]], dtype=int64)

print(classification_report(y_train, poly_pred))

              precision    recall  f1-score   support

           0       1.00      1.00      1.00        42
           1       1.00      1.00      1.00        39
           2       1.00      1.00      1.00        39

    accuracy                           1.00       120
   macro avg       1.00      1.00      1.00       120
weighted avg       1.00      1.00      1.00       120

The results are quite impressive given that we didn’t have to tune any hyper paremeter. Although this would be enough for our dataset, it’s unlikely that your model will work well at first in real life. You may have to tune hyperparamaters.

There are two commom techniques for hyper parameter search. These are Randomized Search and GridSearch. In our last, we used Randomized Search, let’s use GridSearch now.

42.67.8. 7 - Improving Support Vector Classifier#

from sklearn.model_selection import GridSearchCV

params_grid = {'C':[0.001,10,100,1000],
              'gamma':[1,0.1,0.01,0.001], 
                'degree':[2,3,4,5],
              'coef0':[0,1,2,4]
              
              }

grid_search = GridSearchCV(SVC(), params_grid, verbose=2)

grid_search.fit(X_train_scaled, y_train)

Fitting 5 folds for each of 256 candidates, totalling 1280 fits
[CV] END ................C=0.001, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=0.001, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=0.001, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=0.001, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ............C=0.001, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ...................C=10, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END .................C=10, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ................C=10, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ...............C=10, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ..................C=100, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ................C=100, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ...............C=100, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END ..............C=100, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=2, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=2, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=3, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=3, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=4, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=4, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=0, degree=5, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=0, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=0, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=0, degree=5, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=2, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=2, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=3, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=3, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=4, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=4, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=1, degree=5, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=1, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=1, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=1, degree=5, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=2, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=2, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=3, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=3, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=4, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=4, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=2, degree=5, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=2, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=2, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=2, degree=5, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=2, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=2, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=2, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=2, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=3, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=3, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=3, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=3, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=4, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=4, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=4, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=4, gamma=0.001; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END .................C=1000, coef0=4, degree=5, gamma=1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ...............C=1000, coef0=4, degree=5, gamma=0.1; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END ..............C=1000, coef0=4, degree=5, gamma=0.01; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=5, gamma=0.001; total time=   0.0s
[CV] END .............C=1000, coef0=4, degree=5, gamma=0.001; total time=   0.0s

GridSearchCV(estimator=SVC(),
             param_grid={'C': [0.001, 10, 100, 1000], 'coef0': [0, 1, 2, 4],
                         'degree': [2, 3, 4, 5],
                         'gamma': [1, 0.1, 0.01, 0.001]},
             verbose=2)
In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.
grid_search.best_params_

{'C': 10, 'coef0': 0, 'degree': 2, 'gamma': 1}

# In grid search definition above, if you set parameter re_fit to True, you won't have to do this 

poly_best = grid_search.best_estimator_.fit(X_train_scaled, y_train)

grid_pred = poly_best.predict(X_train_scaled)

accuracy_score(y_train, grid_pred)

1.0

confusion_matrix(y_train, grid_pred)

array([[42,  0,  0],
       [ 0, 39,  0],
       [ 0,  0, 39]], dtype=int64)

print(classification_report(y_train, grid_pred))

              precision    recall  f1-score   support

           0       1.00      1.00      1.00        42
           1       1.00      1.00      1.00        39
           2       1.00      1.00      1.00        39

    accuracy                           1.00       120
   macro avg       1.00      1.00      1.00       120
weighted avg       1.00      1.00      1.00       120

As you can see, nothing really improved. This was only for purpose of learning how to improve a model, tuning hyperparameters per the reason that most of the time the first model will not be good enough.

After your have improved your model, you can safely make predictions on test set. We will have to scale it first, just like we did for the training set. Recall that we don’t do fit_transform, we only transfrom the test set.

test_scaled = scale_pipe.transform(X_test)

test_pred = poly_best.predict(test_scaled)

accuracy_score(y_test, test_pred)

1.0

print(classification_report(y_test, test_pred))

              precision    recall  f1-score   support

           0       1.00      1.00      1.00         8
           1       1.00      1.00      1.00        11
           2       1.00      1.00      1.00        11

    accuracy                           1.00        30
   macro avg       1.00      1.00      1.00        30
weighted avg       1.00      1.00      1.00        30

Let’s see why we didn’t have to tune hyperparameters. If we evaluate our first good model before the hyperparameter search, you can see that it does well on the test set than the one with tuned hyperparameter.

What does that tell us? It means that when we were trying to improve the model, we were actually overfitting and as the results the model can not generalize well on the new data. If you look on above results, that’s what happened.

Let’s evauate our first polynomial model on the test set. It was pretty good even without hyperparameter tuning because the accuracy on train was 98%.

test_pred_poly = poly_svc.predict(test_scaled)

accuracy_score(y_test, test_pred_poly)

1.0

print(classification_report(y_test, test_pred_poly))

              precision    recall  f1-score   support

           0       1.00      1.00      1.00         8
           1       1.00      1.00      1.00        11
           2       1.00      1.00      1.00        11

    accuracy                           1.00        30
   macro avg       1.00      1.00      1.00        30
weighted avg       1.00      1.00      1.00        30

This is the end of the lab which was all about using Support Vector Machines for classification task. As you can see, SVM is a robust algorithm given how it supports different kernels. These kernels are what make it suitable for both linear and non linear problems. In real world, many datasets are not linear. So when you can’t get good results with linear models, try things like SVM with polynomial kernel.

42.67.9. Acknowledgments#

Thanks to Jake VanderPlas for creating the open-source course Python Data Science Handbook . It inspires the majority of the content in this chapter.