Control Vector Oscillation Studies

March 2026
Control vector oscillation diagram
Sine wave modulating opposing control vectors over text generation.

Control vectors let you steer a language model by adding a direction to its activations. Find the direction for a concept (happiness, formality, whatever) and you can push generation toward or away from it without changing the weights.

A "fish" vector applied to unrelated text produced: "Somebody's worn off my scales." It didn't insert the word "fish." It integrated the concept into whatever was already happening.

Early sketches
Early sketches.

Instead of holding a vector at fixed strength, I oscillated between opposing vectors with a sine wave at each token. The model drifts between states instead of snapping. At the crossover points neither vector dominates and the output gets interesting.

Base drawing
Base drawing.
Detail of base drawing
Detail.

Generated text printed on transparency film, exposed onto light-sensitive paper. Each print depends on exposure time, light, the paper's chemistry, and which point in the oscillation cycle it captures.

Oscillation study on light-sensitive paper
Light-sensitive paper, transparency film, hand-drawn overlay.
Detail with drawing and text Text on photosensitive surface
Detail exposures. Special tokens and system prompts alongside generated prose.
Mask study Mask study
Mask studies.
Sea study
Ice study

Workable range was between alpha −0.8 and 1.2. Outside that the oscillation overwhelms the model. Inside it the text gets inflected by a concept rather than being about it.