Vertex is also a key component of Numaflow
Pipeline where the data processing happens.
Vertex is defined as a list in the pipeline spec, each representing a data processing task.
There are 3 types of
Vertex in Numaflow today:
Source- To ingest data from sources.
Sink- To forward processed data to sinks.
UDF- User Defined Function, which is used to define data processing logic.
We have defined a Kubernetes Custom Resource defined for
Pipeline containing multiple vertices will automatically generate multiple
Vertex objects by the controller. As a user, you should NOT create a
Vertex object directly.
Pipeline, the vertices are not connected directly, but through Inter-Step Buffers.
Vertex objects with
kubectl get vertex # or "vtx" as a short name