Train an ε‑insensitive SVR model on your own data points. Choose linear or polynomial degree, adjust C & epsilon, and visualize the regression curve. Perfect for nonlinear trend modeling and understanding kernelized regression.
| x | y |
|---|
Support Vector Regression is a powerful regression technique derived from Support Vector Machines. Unlike ordinary least squares, SVR aims to find a function f(x) such that deviations within an ε‑insensitive tube are ignored, while penalizing errors beyond ε. This makes SVR robust to outliers and provides sparse solutions. The optimization problem balances model complexity (via ‖w‖² regularization) and tube violations, controlled by hyperparameter C.
Mathematical formulation (linear SVR):
minimize ½‖w‖² + C ∑ (ξᵢ + ξᵢ*)
subject to |yᵢ - (w·xᵢ + b)| ≤ ε + ξᵢ, ξᵢ ≥ 0
With polynomial mapping φ(x), we replace x → φ(x) to learn non‑linear patterns. Our solver uses gradient descent on the primal objective with ε‑insensitive hinge loss: L = C * Σ max(0, |yᵢ - f(xᵢ)| - ε) + ½‖θ‖².
Our interactive calculator implements the primal SVR with polynomial feature expansion (degree d). You can tune C (regularization strength – high C reduces tolerance to errors) and ε (tube width – larger ε yields fewer support vectors and smoother regression). The model trains via mini‑batch gradient descent, making it accessible for real‑time experimentation.
| Parameter | Effect |
|---|---|
| C ↑ (high) | Less regularization, more complex curve, may overfit. |
| C ↓ (low) | Strong regularization, smoother fit, higher bias. |
| ε ↑ (large tube) | Fewer points influence the model → simpler, flatter regression. |
| ε ↓ (tight tube) | More sensitive to errors, wiggly curve. |
| Degree ↑ | Higher flexibility, possible overfitting for small datasets. |
An environmental engineer measured temperature vs. voltage from a thermistor. The relationship was quadratic, but sensor noise produced outliers. Using SVR with degree 2 polynomial kernel (C=2.0, ε=0.25) produced a robust calibration curve, reducing influence of spurious readings by 38% compared to linear regression. The ε‑tube naturally ignored small fluctuations, while the polynomial kernel captured the non‑linear physics. This interactive tool reproduces that workflow instantly.