The App Store for open-source. Curated alternatives to proprietary software — self-hosted and desktop.
Milvus — open-source Pinecone alternative | open-source.store
Milvus Apache-2.0 Milvus is an open-source distributed vector database replacing Pinecone with GPU-accelerated indexing, hybrid search, and decoupled cloud-native scaling.
Open-source alternative to — compare it against: A machine learning platform scaling past one hundred million embeddings discovers that managed cloud vector bills compound rapidly while query latency degrades under peak write traffic. Milvus isolates storage from compute across Kubernetes nodes, sustaining tens of thousands of nearest-neighbor searches per second on billions of high-dimensional vectors. The database gives infrastructure teams complete control over their hardware acceleration, index topologies, and VPC network perimeter.
Why Milvus instead of Pinecone
Pinecone provides a hands-off managed vector environment, but engineering teams surrender control over infrastructure tuning, data locality, and latency predictability under high load. Because Pinecone operates as an external multi-tenant service, queries traverse public networks or cloud interconnects, adding transit latency to retrieval steps. Milvus runs directly within your private network or Kubernetes clusters, keeping sensitive embedding data inside internal boundaries while eliminating network transit hops.
The architectural divergence centers on compute separation and hardware tuning. Milvus decouples query, data, and index nodes into stateless microservices backed by object storage. During ingestion bursts, data nodes absorb incoming vectors without degrading read throughput on dedicated query nodes. Milvus also lets teams match index algorithms to hardware budgets, spanning in-memory HNSW, GPU-accelerated CAGRA, and SSD-backed DiskANN. Pinecone abstracts index mechanics behind fixed tiers, preventing low-level memory tuning or local GPU execution. In exchange, Milvus shifts operational responsibility to your team: where Pinecone needs only an API key, Milvus requires orchestrating Kubernetes clusters, storage buckets, and streaming brokers.
What it does well
Decoupled cloud architecture separates query nodes from ingestion nodes, allowing DevOps engineers to scale search throughput independently of write traffic.
Broad vector index options give developers fine-grained control over accuracy and latency through HNSW, IVF, GPU-accelerated CAGRA, and DiskANN.
Native hybrid retrieval combines dense vectors with BM25 sparse lexical tokens and metadata filtering within a single query execution.
Multi-tenancy strategies isolate data across collections, partitions, or partition keys to serve thousands of client namespaces on one cluster.
Tiered storage keeps active index segments in memory or NVMe cache while offloading cold vector partitions to S3-compatible object storage.
Operational tooling includes Attu for graphical management, Birdwatcher for debugging cluster state, and Prometheus metrics for observability.
Limitations
Cluster operations require DevOps teams to manage Kubernetes deployments alongside external dependencies including etcd, MinIO, and Apache Pulsar or Kafka.
In-memory HNSW indexing demands heavy RAM capacity, expanding memory footprint rapidly unless collections use scalar quantization or DiskANN caching.
Upserts execute as soft deletions followed by insertions, creating write amplification and delayed space reclamation during compaction cycles (GitHub issue #39027).
Rolling node restarts in Kubernetes can trigger query latency spikes during worker pod draining, requiring careful timeout configuration (GitHub issue #24272).
Who should use it
DevOps and infrastructure engineers who must run high-performance vector search inside private cloud VPCs or air-gapped clusters to satisfy strict data sovereignty requirements.
Machine learning developers searching hundreds of millions of embeddings who need GPU acceleration and custom index tuning to maintain single-digit millisecond query latencies.
Platform architects designing multi-tenant enterprise search backends who require independent horizontal scaling between streaming document ingestion and customer search traffic.
FAQ Is Milvus free for commercial use?
Yes. Milvus carries the Apache-2.0 license, permitting commercial deployment and modification without licensing royalties.
Milvus vs Pinecone — which should engineering teams choose?
Pinecone is ideal for teams wanting a zero-maintenance managed service with minimal operational overhead, whereas Milvus is suited for organizations needing private cloud deployment, GPU acceleration, and predictable performance at large scale.
Can Milvus run locally without Kubernetes?
Yes. Developers can evaluate Milvus locally using standalone Docker containers or embed Milvus Lite directly inside Python applications for prototyping.
Verdict Milvus is the right choice when query throughput, private network deployment, and hardware control outweigh the simplicity of a managed SaaS endpoint; it is not suited for small teams lacking the infrastructure capacity to operate distributed Kubernetes services. With steady development continuing past September 2026 and an Apache-2.0 license that guarantees unrestricted deployment across private cloud infrastructure, it remains a premier open-source vector engine for high-throughput production retrieval.
Apache-2.0 Vector Databases
security: open protocols — no unauthenticated Redis protocol on public ports
security: nuclei scan — no public TCP ports Ubuntu 24.04 · Apple container, Docker 29.1.3, Compose 2.40.3+ds1-0ubuntu1~24.04.1. Images pulled in 256 s: milvusdb/milvus:v3.0.5, milvusdb/milvus:v3.0.5, quay.io/coreos/etcd:v3.5.25, milvusdb/minio:RELEASE.2024-12-18T13-15-44Z.
Based on the upstream setup . Official Milvus standalone compose. Pinned images to v3.0.5, etcd v3.5.25, MinIO RELEASE.2024-12-18T13-15-44Z; MinIO credentials moved to .env; bound to 127.0.0.1 because Milvus has no authentication enabled by default; named volumes used; internal ports kept unmapped.
standalone-1 | 2026-11-01T03:59:26.338965970Z [2026/11/01 03:59:24.308 +00:00] [INFO] [CGO] [storage/StorageV2FSCache.cpp:67] ["[SERVER][Get][milvus][]StorageV2FSCache::Get: address=minio:9000, bucket=a-bucket, key_prefix=files, fs_root_path=files, storage_type=remote"]
standalone-1 | 2026-11-01T03:59:26.338973054Z [2026/11/01 03:59:24.647 +00:00] [INFO] [dist/dist_handler.go:177] ["skip update dist due to no distribution change"] [lastModifyTs=1793505563658927677] [lastUpdateTs=1793505563658927677]
standalone-1 | 2026-11-01T03:59:26.338975054Z [2026/11/01 03:59:24.647 +00:00] [INFO] [dist/dist_handler.go:157] ["pull and handle distribution done"] [respSize=14] [pullDur=963.583µs] [handleDur=69.292µs]
standalone-1 | 2026-11-01T03:59:26.338977470Z [2026/11/01 03:59:25.140 +00:00] [INFO] [dist/dist_handler.go:177] ["skip update dist due to no distribution change"] [lastModifyTs=1793505563658927677] [lastUpdateTs=1793505563658927677]
standalone-1 | 2026-11-01T03:59:26.338978929Z [2026/11/01 03:59:25.140 +00:00] [INFO] [dist/dist_handler.go:157] ["pull and handle distribution done"] [respSize=14] [pullDur=776.709µs] [handleDur=90.875µs]
standalone-1 | 2026-11-01T03:59:26.338980262Z [2026/11/01 03:59:25.640 +00:00] [INFO] [dist/dist_handler.go:177] ["skip update dist due to no distribution change"] [lastModifyTs=1793505563658927677] [lastUpdateTs=1793505563658927677]
standalone-1 | 2026-11-01T03:59:26.338981595Z [2026/11/01 03:59:25.640 +00:00] [INFO] [dist/dist_handler.go:157] ["pull and handle distribution done"] [respSize=14] [pullDur=390.416µs] [handleDur=28.542µs]
standalone-1 | 2026-11-01T03:59:26.338983637Z [2026/11/01 03:59:26.141 +00:00] [INFO] [dist/dist_handler.go:177] ["skip update dist due to no distribution change"] [lastModifyTs=1793505563658927677] [lastUpdateTs=1793505563658927677]
standalone-1 | 2026-11-01T03:59:26.338999595Z [2026/11/01 03:59:26.141 +00:00] [INFO] [dist/dist_handler.go:157] ["pull and handle distribution done"] [respSize=14] [pullDur=757.666µs] [handleDur=77.209µs]
standalone-1 | 2026-11-01T03:59:26.339001137Z [2026/11/01 03:59:26.304 +00:00] [INFO] [delegator/delegator.go:1301] ["update tsafe"] [collectionID=470156719476442097] [channel=by-dev-rootcoord-dml_0_470156719476442097v0] [replicaID=470156719490334721] [collectionID=470156719476442097] [vchannel=by-dev-rootcoord-dml_0_470156719476442097v0] [tsafe=2026/11/01 03:59:26.256 +00:00] [latestTSafe=2026/11/01 03:59:24.256 +00:00]
standalone-1 | 2026-11-01T03:59:26.339003012Z [2026/11/01 03:59:26.314 +00:00] [INFO] [CGO] [storage/StorageV2FSCache.cpp:84] ["[SERVER][Get][milvus][]StorageV2FSCache::Get: got filesystem successfully"]
standalone-1 | 2026-11-01T03:59:26.339004470Z [2026/11/01 03:59:26.315 +00:00] [INFO] [CGO] [monitor/scope_metric.cpp:53] ["[SERVER][~FuncScopeMetric][milvus][][CGO Call] slow function NewPackedWriterWithStorageConfig done with duration 2.006701793s"]
standalone-1 | 2026-11-01T03:59:26.339006095Z [2026/11/01 03:59:26.337 +00:00] [INFO] [syncmgr/meta_writer.go:87] [SaveBinlogPath] [SegmentID=470156719476642164] [CollectionID=470156719476442097] [ParitionID=470156719476442098] [startPos="[{\"start_position\":{\"channel_name\":\"by-dev-rootcoord-dml_0_470156719476442097v0\",\"msgID\":\"BgCcQQxVhgY=\",\"timestamp\":470156722230004700,\"WAL_name\":1},\"segmentID\":470156719476642164}]"] [checkPoints="[{\"segmentID\":470156719476642164,\"position\":{\"channel_name\":\"by-dev-rootcoord-dml_0_470156719476442097v0\",\"msgID\":\"CACcQQxVhgY=\",\"timestamp\":470156722597003282,\"WAL_name\":1},\"num_of_rows\":1}]"] [binlogNum=3] [statslogNum=1] [deltalogNum=0] [bm25logNum=0] [manifestPath=] [vChannelName=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.341788054Z [2026/11/01 03:59:26.338 +00:00] [INFO] [datacoord/services.go:617] ["receive SaveBinlogPaths request"] [isFlush=false] [isDropped=true] [checkpoints="[{\"segmentID\":470156719476642164,\"position\":{\"channel_name\":\"by-dev-rootcoord-dml_0_470156719476442097v0\",\"msgID\":\"CACcQQxVhgY=\",\"timestamp\":470156722597003282,\"WAL_name\":1},\"num_of_rows\":1}]"]
standalone-1 | 2026-11-01T03:59:26.341800429Z [2026/11/01 03:59:26.340 +00:00] [INFO] [datacoord/meta.go:2073] ["meta update: update flush segments info - update flush segments info successfully"] [module=mixcoord] [traceID=2b44af92c04f41219cf8908ea00963e6] [spanID=89dce1ea03351f5c]
standalone-1 | 2026-11-01T03:59:26.341801970Z [2026/11/01 03:59:26.340 +00:00] [INFO] [datacoord/services.go:728] ["SaveBinlogPaths sync segment with meta"] [checkpoints="[{\"segmentID\":470156719476642164,\"position\":{\"channel_name\":\"by-dev-rootcoord-dml_0_470156719476442097v0\",\"msgID\":\"CACcQQxVhgY=\",\"timestamp\":470156722597003282,\"WAL_name\":1},\"num_of_rows\":1}]"] [binlogs="[f0:l470156719476642165(e1,m27,t470156722230004700-470156722230004700),f1:l470156719476642166(e1,m11,t470156722230004700-470156722230004700),f101:l470156719476642167(e1,m17,t470156722230004700-470156722230004700)]"] [deltalogs="[]"] [statslogs="[f100:l470156719476642168(e1,m185,t470156722230004700-470156722230004700)]"] [bm25logs="[]"]
standalone-1 | 2026-11-01T03:59:26.341804137Z [2026/11/01 03:59:26.340 +00:00] [INFO] [syncmgr/task.go:231] ["segment removed"] [collectionID=470156719476442097] [partitionID=470156719476442098] [segmentID=470156719476642164] [channel=by-dev-rootcoord-dml_0_470156719476442097v0] [level=L1] [segmentID=470156719476642164] [channel=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.341805179Z [2026/11/01 03:59:26.340 +00:00] [INFO] [syncmgr/task.go:237] ["task done"] [collectionID=470156719476442097] [partitionID=470156719476442098] [segmentID=470156719476642164] [channel=by-dev-rootcoord-dml_0_470156719476442097v0] [level=L1] [flushedSize=185] [timeTaken=2.031996792s]
standalone-1 | 2026-11-01T03:59:26.341806512Z [2026/11/01 03:59:26.340 +00:00] [INFO] [datacoord/services.go:816] ["receive DropVirtualChannel request"] [channelName=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.341807387Z [2026/11/01 03:59:26.340 +00:00] [INFO] [datacoord/meta.go:2221] ["meta update: batch save drop segments"] [module=mixcoord] ["drop segments"="[470156719476642164]"] [traceID=06ed83954abb44153fd3cfe5113d980d] [spanID=c7782bf0d297487f]
standalone-1 | 2026-11-01T03:59:26.341808387Z [2026/11/01 03:59:26.341 +00:00] [INFO] [datacoord/kv_catalog.go:521] ["remove flag tombstone added"] [module=mixcoord] [channel=by-dev-rootcoord-dml_0_470156719476442097v0] [traceID=06ed83954abb44153fd3cfe5113d980d] [spanID=c7782bf0d297487f]
standalone-1 | 2026-11-01T03:59:26.341809304Z [2026/11/01 03:59:26.341 +00:00] [INFO] [datacoord/meta.go:2138] ["meta update: update drop channel segment info - complete"] [channel=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.341810095Z [2026/11/01 03:59:26.341 +00:00] [INFO] [datacoord/compaction_inspector.go:487] ["removing tasks by channel"] [channel=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.341810887Z [2026/11/01 03:59:26.341 +00:00] [INFO] [pipeline/flow_graph_time_tick_node.go:91] ["ttnode in dropMode"] [channel=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.341811679Z [2026/11/01 03:59:26.341 +00:00] [INFO] [flowgraph/input_node.go:92] ["input node message stream closed"] [node=dmInputNode-data-by-dev-rootcoord-dml_0_470156719476442097v0] [collection=470156719476442097] [closeGracefully=true]
standalone-1 | 2026-11-01T03:59:26.341813304Z [2026/11/01 03:59:26.341 +00:00] [INFO] [flowgraph/input_node.go:96] ["input node trigger force sync"] [node=dmInputNode-data-by-dev-rootcoord-dml_0_470156719476442097v0] [collection=470156719476442097] [position="[{\"channel_name\":\"by-dev-rootcoord-dml_0_470156719476442097v0\",\"msgID\":\"CACcQQxVhgY=\",\"timestamp\":470156722597003282,\"WAL_name\":1}]"]
standalone-1 | 2026-11-01T03:59:26.341814512Z [2026/11/01 03:59:26.341 +00:00] [WARN] [pipeline/flow_graph_dd_node.go:115] ["MsgStream closed"] ["ddNode node"=ddNode-by-dev-rootcoord-dml_0_470156719476442097v0] [channel=by-dev-rootcoord-dml_0_470156719476442097v0] [collection=470156719476442097]
standalone-1 | 2026-11-01T03:59:26.341815304Z [2026/11/01 03:59:26.341 +00:00] [INFO] [pipeline/data_sync_service.go:123] ["dataSyncService flowgraph closed"] [collectionID=470156719476442097] [vChanName=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.343508554Z [2026/11/01 03:59:26.341 +00:00] [INFO] [pipeline/data_sync_service.go:132] ["dataSyncService closed"] [collectionID=470156719476442097] [vChanName=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.343512012Z [2026/11/01 03:59:26.341 +00:00] [WARN] [writebuffer/manager.go:318] ["failed to remove channel, channel not maintained in manager"] [channel=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.343513179Z [2026/11/01 03:59:26.341 +00:00] [INFO] [flusherimpl/flusher_components.go:115] ["drop data sync service"] [module=streamingnode] [component=flusher] [pchannel=by-dev-rootcoord-dml_0:rw@2] [vchannel=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.343514095Z [2026/11/01 03:59:26.342 +00:00] [INFO] [broadcaster/broadcast_task.go:569] ["save broadcast task done"] [module=streamingcoord] [component=broadcaster] [message="{type=DropCollection,broadcastID=470156719476441100,broadcastVChannels=by-dev-rootcoord-dml_0_470156719476442097v0,by-dev-rootcoord-dml_0_vcchan,ackSyncUp=true,size=37,collectionID=470156719476442097}"] [state=BROADCAST_TASK_STATE_PENDING] [ackedVChannelCount=2] [module=mixcoord] [traceID=cb555698c78ae3eb64cbef7841a79b19] [spanID=0ff44f1d9daab237]
standalone-1 | 2026-11-01T03:59:26.343515179Z [2026/11/01 03:59:26.342 +00:00] [INFO] [datacoord/services.go:816] ["receive DropVirtualChannel request"] [channelName=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.343516054Z [2026/11/01 03:59:26.342 +00:00] [INFO] [recovery/recovery_storage_impl.go:541] ["flush all segments of collection"] [module=streamingnode] [nodeID=1] [component=recovery-storage] [channel=by-dev-rootcoord-dml_0:rw@2] [state=working] [message="{type=DropCollection,vchannel=by-dev-rootcoord-dml_0_470156719476442097v0,timetick=470156722597003282,messageID=470156722235506700,lastConfirmed=470156722235506696,broadcastID=470156719476441100,broadcastVChannels=by-dev-rootcoord-dml_0_470156719476442097v0,by-dev-rootcoord-dml_0_vcchan,size=37,collectionID=470156719476442097}"] [segmentIDs="[470156719476642164]"] [rows="[1]"]
standalone-1 | 2026-11-01T03:59:26.343517637Z [2026/11/01 03:59:26.342 +00:00] [INFO] [recovery/recovery_storage_impl.go:527] ["drop collection"] [module=streamingnode] [nodeID=1] [component=recovery-storage] [channel=by-dev-rootcoord-dml_0:rw@2] [state=working] [message="{type=DropCollection,vchannel=by-dev-rootcoord-dml_0_470156719476442097v0,timetick=470156722597003282,messageID=470156722235506700,lastConfirmed=470156722235506696,broadcastID=470156719476441100,broadcastVChannels=by-dev-rootcoord-dml_0_470156719476442097v0,by-dev-rootcoord-dml_0_vcchan,size=37,collectionID=470156719476442097}"]
standalone-1 | 2026-11-01T03:59:26.343520595Z [2026/11/01 03:59:26.342 +00:00] [INFO] [datacoord/meta.go:2221] ["meta update: batch save drop segments"] ["drop segments"="[470156719476642164]"]
standalone-1 | 2026-11-01T03:59:26.343521345Z [2026/11/01 03:59:26.342 +00:00] [INFO] [datacoord/kv_catalog.go:521] ["remove flag tombstone added"] [channel=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.343522012Z [2026/11/01 03:59:26.342 +00:00] [INFO] [datacoord/meta.go:2138] ["meta update: update drop channel segment info - complete"] [channel=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.343522804Z [2026/11/01 03:59:26.342 +00:00] [INFO] [datacoord/compaction_inspector.go:487] ["removing tasks by channel"] [channel=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:26.343523429Z [2026/11/01 03:59:26.343 +00:00] [INFO] [observers/target_observer.go:210] ["manually trigger update target"] [collectionID=470156719476442097] [opType=ReleaseCollection]
standalone-1 | 2026-11-01T03:59:26.343524054Z [2026/11/01 03:59:26.343 +00:00] [INFO] [meta/target_manager.go:226] ["remove collection from targets"] [collectionID=470156719476442097]
standalone-1 | 2026-11-01T03:59:26.343524720Z [2026/11/01 03:59:26.343 +00:00] [INFO] [observers/target_observer.go:282] ["manually trigger update target done"] [collectionID=470156719476442097] [opType=ReleaseCollection]
standalone-1 | 2026-11-01T03:59:26.343525429Z [2026/11/01 03:59:26.343 +00:00] [INFO] [proxy/impl.go:158] ["received request to invalidate collection meta cache"] [module=proxy] [module=Proxy] [traceID=4031a994a0d365449745fb4abd36005c] [spanID=f13e2522e6a534b1]
standalone-1 | 2026-11-01T03:59:26.343526095Z [2026/11/01 03:59:26.343 +00:00] [INFO] [shardclient/manager.go:318] ["Invalidate shard cache for collections"] [collectionIDs="[470156719476442097]"]
standalone-1 | 2026-11-01T03:59:26.639774512Z [2026/11/01 03:59:26.343 +00:00] [INFO] [proxy/impl.go:211] ["complete to invalidate collection meta cache"] [module=proxy] [module=Proxy] [type=ReleaseCollection] [traceID=4031a994a0d365449745fb4abd36005c] [spanID=f13e2522e6a534b1]
standalone-1 | 2026-11-01T03:59:26.639784470Z [2026/11/01 03:59:26.343 +00:00] [INFO] [proxy/impl.go:250] ["complete to invalidate collection meta cache"] [module=proxy] [module=Proxy] [traceID=4031a994a0d365449745fb4abd36005c] [spanID=f13e2522e6a534b1]
standalone-1 | 2026-11-01T03:59:26.639785679Z [2026/11/01 03:59:26.343 +00:00] [INFO] [proxy/impl.go:264] ["received request to invalidate shard leader cache"] [module=proxy] [module=Proxy] [collectionIDs="[470156719476442097]"] [traceID=e486d19d7d93c17076636c08a77fd359] [spanID=1d7634c3d5d93332]
standalone-1 | 2026-11-01T03:59:26.639786720Z [2026/11/01 03:59:26.343 +00:00] [INFO] [shardclient/manager.go:318] ["Invalidate shard cache for collections"] [collectionIDs="[470156719476442097]"]
standalone-1 | 2026-11-01T03:59:26.639787637Z [2026/11/01 03:59:26.343 +00:00] [INFO] [proxy/impl.go:268] ["complete to invalidate shard leader cache"] [module=proxy] [module=Proxy] [collectionIDs="[470156719476442097]"] [traceID=e486d19d7d93c17076636c08a77fd359] [spanID=1d7634c3d5d93332]
standalone-1 | 2026-11-01T03:59:26.639788595Z [2026/11/01 03:59:26.343 +00:00] [INFO] [job/utils.go:80] ["waitting for release..."] [collection=470156719476442097] [partitions="[]"] [channel=1] [segments=0]
standalone-1 | 2026-11-01T03:59:26.639789429Z [2026/11/01 03:59:26.343 +00:00] [INFO] [task/scheduler.go:692] ["task added"] [task="[id=1793505552258] [type=Reduce] [source=channel_checker] [reason=collection released] [collectionID=470156719476442097] [replicaID=-1] [resourceGroup=] [priority=Normal] [actionsCount=1] [actions={[type=Reduce][node=1][shard=by-dev-rootcoord-dml_0_470156719476442097v0]},] [channel=by-dev-rootcoord-dml_0_470156719476442097v0]"] [traceID=c851078e86e76cecc912514a90c95f94] [spanID=834954cda23850e3]
standalone-1 | 2026-11-01T03:59:26.639793512Z [2026/11/01 03:59:26.543 +00:00] [INFO] [job/utils.go:80] ["waitting for release..."] [collection=470156719476442097] [partitions="[]"] [channel=1] [segments=0]
standalone-1 | 2026-11-01T03:59:26.639794512Z [2026/11/01 03:59:26.639 +00:00] [INFO] [task/scheduler.go:1080] ["processed tasks"] [nodeID=1] [toProcessNum=1] [committedNum=1] [toRemoveNum=0] [promoteDur=15.375µs] [preprocessDUr=3.375µs] [processDUr=21.917µs] [totalDur=40.958µs]
standalone-1 | 2026-11-01T03:59:26.639795512Z [2026/11/01 03:59:26.639 +00:00] [INFO] [task/scheduler.go:1090] ["process tasks related to node done"] [nodeID=1] [processingTaskNum=1] [waitingTaskNum=0] [segmentTaskNum=0] [channelTaskNum=1]
standalone-1 | 2026-11-01T03:59:26.639796220Z [2026/11/01 03:59:26.639 +00:00] [INFO] [task/executor.go:187] ["execute the action of task"]
standalone-1 | 2026-11-01T03:59:26.639796804Z [2026/11/01 03:59:26.639 +00:00] [INFO] [task/executor.go:530] ["unsubscribe channel..."]
standalone-1 | 2026-11-01T03:59:26.639797387Z [2026/11/01 03:59:26.639 +00:00] [INFO] [querynodev2/services.go:382] ["received unsubscribe channel request"] [collectionID=470156719476442097] [channel=by-dev-rootcoord-dml_0_470156719476442097v0] [currentNodeID=1] [module=querynode] [traceID=c851078e86e76cecc912514a90c95f94] [spanID=2700a2d1cdcd107f]
standalone-1 | 2026-11-01T03:59:26.639798179Z [2026/11/01 03:59:26.639 +00:00] [INFO] [service/release_manual_flush_preparer.go:41] ["skip release manual flush prepare because channel does not use growing-source flush"] [module=querynode] [vchannel=by-dev-rootcoord-dml_0_470156719476442097v0] [collectionID=470156719476442097] [releaseSegmentIDs="[470156719476642164]"] [traceID=c851078e86e76cecc912514a90c95f94] [spanID=2700a2d1cdcd107f]
standalone-1 | 2026-11-01T03:59:26.639799054Z [2026/11/01 03:59:26.639 +00:00] [INFO] [dist/dist_handler.go:177] ["skip update dist due to no distribution change"] [lastModifyTs=1793505563658927677] [lastUpdateTs=1793505563658927677]
standalone-1 | 2026-11-01T03:59:26.639799679Z [2026/11/01 03:59:26.639 +00:00] [INFO] [querynodev2/services.go:416] ["release manual flush prepare result before unsubscribing channel"] [collectionID=470156719476442097] [channel=by-dev-rootcoord-dml_0_470156719476442097v0] [currentNodeID=1] [module=querynode] [segmentIDs="[470156719476642164]"] [prepared=false] [traceID=c851078e86e76cecc912514a90c95f94] [spanID=2700a2d1cdcd107f]
standalone-1 | 2026-11-01T03:59:26.639800512Z [2026/11/01 03:59:26.639 +00:00] [INFO] [dist/dist_handler.go:157] ["pull and handle distribution done"] [respSize=14] [pullDur=186.666µs] [handleDur=12.417µs]
standalone-1 | 2026-11-01T03:59:26.639801137Z [2026/11/01 03:59:26.639 +00:00] [INFO] [msgdispatcher/dispatcher.go:251] ["stop working"] [pchannel=by-dev-rootcoord-dml_0] [id=1]
standalone-1 | 2026-11-01T03:59:27.140323346Z [2026/11/01 03:59:26.639 +00:00] [INFO] [msgdispatcher/dispatcher.go:238] ["handle signal done"] [pchannel=by-dev-rootcoord-dml_0] [id=1] [signal=pause]
standalone-1 | 2026-11-01T03:59:27.140357346Z [2026/11/01 03:59:26.639 +00:00] [INFO] [msgdispatcher/dispatcher.go:195] ["target removed"] [vchannel=by-dev-rootcoord-dml_0_470156719476442097v0] [id=1]
standalone-1 | 2026-11-01T03:59:27.140362262Z [2026/11/01 03:59:26.639 +00:00] [INFO] [adaptor/scanner_adaptor.go:186] ["the produce event loop of scanner is closed"] [module=streamingnode] [component=scanner] [name=by-dev-rootcoord-dml_0/2/2] [channel=by-dev-rootcoord-dml_0]
standalone-1 | 2026-11-01T03:59:27.140375721Z [2026/11/01 03:59:26.639 +00:00] [INFO] [adaptor/scanner_adaptor.go:194] ["the consuming event loop of scanner is closed"] [module=streamingnode] [component=scanner] [name=by-dev-rootcoord-dml_0/2/2] [channel=by-dev-rootcoord-dml_0]
standalone-1 | 2026-11-01T03:59:27.140379304Z [2026/11/01 03:59:26.639 +00:00] [INFO] [adaptor/scanner_adaptor.go:173] ["scanner is closed"] [module=streamingnode] [component=scanner] [name=by-dev-rootcoord-dml_0/2/2] [channel=by-dev-rootcoord-dml_0]
standalone-1 | 2026-11-01T03:59:27.140382137Z [2026/11/01 03:59:26.639 +00:00] [INFO] [consumer/consumer_impl.go:67] ["resumable consumer is closed"] [pchannel=by-dev-rootcoord-dml_0] [initialDeliverPolicy="start_from:{id:\"3klcncgk6k90\" WAL_name:RocksMQ}"]
standalone-1 | 2026-11-01T03:59:27.140385262Z [2026/11/01 03:59:26.639 +00:00] [INFO] [msgdispatcher/dispatcher.go:238] ["handle signal done"] [pchannel=by-dev-rootcoord-dml_0] [id=1] [signal=terminate]
standalone-1 | 2026-11-01T03:59:27.140387721Z [2026/11/01 03:59:26.639 +00:00] [INFO] [msgdispatcher/target.go:73] ["close target chan"] [vchannel=by-dev-rootcoord-dml_0_470156719476442097v0]
standalone-1 | 2026-11-01T03:59:27.140390179Z [2026/11/01 03:59:26.639 +00:00] [INFO] [msgdispatcher/client.go:123] ["deregister done"] [role=querynode] [nodeID=1] [vchannel=by-dev-rootcoord-dml_0_470156719476442097v0] [dur=89.875µs]
standalone-1 | 2026-11-01T03:59:27.140393721Z [2026/11/01 03:59:26.639 +00:00] [INFO] [delegator/delegator.go:1470] ["unregister all l0 segments"] [cost=1.458µs]
standalone-1 | 2026-11-01T03:59:27.140397262Z [2026/11/01 03:59:26.639 +00:00] [INFO] [segments/segment.go:1312] ["delete segment from memory"] [collectionID=470156719476442097] [partitionID=470156719476442098] [segmentID=470156719476642164] [segmentType=Growing] [insertCount=1] [module=querynode] [traceID=c851078e86e76cecc912514a90c95f94] [spanID=2700a2d1cdcd107f]
standalone-1 | 2026-11-01T03:59:27.140400512Z [2026/11/01 03:59:26.639 +00:00] [INFO] [segments/collection.go:291] ["release collection due to ref count to 0"] [nodeID=1] [collectionID=470156719476442097]
standalone-1 | 2026-11-01T03:59:27.140403012Z [2026/11/01 03:59:26.639 +00:00] [INFO] [querynodev2/services.go:442] ["unsubscribed channel"] [collectionID=470156719476442097] [channel=by-dev-rootcoord-dml_0_470156719476442097v0] [currentNodeID=1] [module=querynode] [traceID=c851078e86e76cecc912514a90c95f94] [spanID=2700a2d1cdcd107f]
standalone-1 | 2026-11-01T03:59:27.140405887Z [2026/11/01 03:59:26.639 +00:00] [INFO] [task/executor.go:543] ["unsubscribe channel done"] [taskID=1793505552258] ["time taken"=445.042µs]
standalone-1 | 2026-11-01T03:59:27.140408387Z [2026/11/01 03:59:26.744 +00:00] [INFO] [job/utils.go:80] ["waitting for release..."] [collection=470156719476442097] [partitions="[]"] [channel=1] [segments=0]
standalone-1 | 2026-11-01T03:59:27.140410887Z [2026/11/01 03:59:26.950 +00:00] [INFO] [job/utils.go:80] ["waitting for release..."] [collection=470156719476442097] [partitions="[]"] [channel=1] [segments=0]
standalone-1 | 2026-11-01T03:59:27.140413387Z [2026/11/01 03:59:27.139 +00:00] [INFO] [task/scheduler.go:1080] ["processed tasks"] [nodeID=1] [toProcessNum=1] [committedNum=1] [toRemoveNum=0] [promoteDur=22.708µs] [preprocessDUr=13.959µs] [processDUr=41.416µs] [totalDur=78.708µs]
standalone-1 | 2026-11-01T03:59:27.140416346Z [2026/11/01 03:59:27.139 +00:00] [INFO] [task/scheduler.go:1090] ["process tasks related to node done"] [nodeID=1] [processingTaskNum=1] [waitingTaskNum=0] [segmentTaskNum=0] [channelTaskNum=1]
standalone-1 | 2026-11-01T03:59:27.140421471Z [2026/11/01 03:59:27.139 +00:00] [INFO] [task/executor.go:187] ["execute the action of task"]
standalone-1 | 2026-11-01T03:59:27.140423887Z [2026/11/01 03:59:27.139 +00:00] [INFO] [task/executor.go:530] ["unsubscribe channel..."]
standalone-1 | 2026-11-01T03:59:27.140426054Z [2026/11/01 03:59:27.139 +00:00] [INFO] [querynodev2/services.go:382] ["received unsubscribe channel request"] [collectionID=470156719476442097] [channel=by-dev-rootcoord-dml_0_470156719476442097v0] [currentNodeID=1] [module=querynode] [traceID=c851078e86e76cecc912514a90c95f94] [spanID=978e28514d30684c]
standalone-1 | 2026-11-01T03:59:27.154507804Z [2026/11/01 03:59:27.139 +00:00] [INFO] [querynodev2/services.go:442] ["unsubscribed channel"] [collectionID=470156719476442097] [channel=by-dev-rootcoord-dml_0_470156719476442097v0] [currentNodeID=1] [module=querynode] [traceID=c851078e86e76cecc912514a90c95f94] [spanID=978e28514d30684c]
standalone-1 | 2026-11-01T03:59:27.154593679Z [2026/11/01 03:59:27.140 +00:00] [INFO] [task/executor.go:543] ["unsubscribe channel done"] [taskID=1793505552258] ["time taken"=497.291µs]
standalone-1 | 2026-11-01T03:59:27.154599387Z [2026/11/01 03:59:27.140 +00:00] [INFO] [dist/dist_handler.go:157] ["pull and handle distribution done"] [respSize=72] [pullDur=1.442875ms] [handleDur=34.042µs]
standalone-1 | 2026-11-01T03:59:27.154601512Z [2026/11/01 03:59:27.140 +00:00] [INFO] [observers/leader_cache_observer.go:77] ["receive event, trigger leader cache update"] [event=470156719476442097]
standalone-1 | 2026-11-01T03:59:27.154603262Z [2026/11/01 03:59:27.141 +00:00] [INFO] [proxy/impl.go:264] ["received request to invalidate shard leader cache"] [module=proxy] [module=Proxy] [collectionIDs="[470156719476442097]"] [traceID=32d9deb32a46b47d32051c75fa0910d7] [spanID=dd8b9df357cbf5b1]
standalone-1 | 2026-11-01T03:59:27.154613554Z [2026/11/01 03:59:27.141 +00:00] [INFO] [shardclient/manager.go:318] ["Invalidate shard cache for collections"] [collectionIDs="[470156719476442097]"]
standalone-1 | 2026-11-01T03:59:27.154615262Z [2026/11/01 03:59:27.141 +00:00] [INFO] [proxy/impl.go:268] ["complete to invalidate shard leader cache"] [module=proxy] [module=Proxy] [collectionIDs="[470156719476442097]"] [traceID=32d9deb32a46b47d32051c75fa0910d7] [spanID=dd8b9df357cbf5b1]
standalone-1 | 2026-11-01T03:59:27.154617304Z [2026/11/01 03:59:27.151 +00:00] [INFO] [job/job_release.go:117] ["release collection job done"] [collectionID=470156719476442097]
standalone-1 | 2026-11-01T03:59:27.154618804Z [2026/11/01 03:59:27.151 +00:00] [INFO] [meta/failed_load_cache.go:106] ["FailedLoadCache removes cache"] [collectionID=470156719476442097]
standalone-1 | 2026-11-01T03:59:27.154620346Z [2026/11/01 03:59:27.151 +00:00] [INFO] [datacoord/index_meta.go:757] ["IndexCoord metaTable MarkIndexAsDeleted"] [collectionID=470156719476442097] [indexIDs="[]"]
standalone-1 | 2026-11-01T03:59:27.154621971Z [2026/11/01 03:59:27.152 +00:00] [INFO] [datacoord/index_meta.go:819] ["IndexCoord metaTable MarkIndexAsDeleted success"] [collectionID=470156719476442097] [indexIDs="[470156719476442154]"]
standalone-1 | 2026-11-01T03:59:27.154624512Z [2026/11/01 03:59:27.152 +00:00] [INFO] [datacoord/ddl_callbacks_snapshot.go:81] ["dropSnapshotsByCollectionV2AckCallback received"] [collectionID=470156719476442097]
standalone-1 | 2026-11-01T03:59:27.154626221Z [2026/11/01 03:59:27.152 +00:00] [INFO] [datacoord/snapshot_manager.go:527] ["drop all snapshots for collection"]
standalone-1 | 2026-11-01T03:59:27.154627637Z [2026/11/01 03:59:27.152 +00:00] [INFO] [datacoord/snapshot_meta.go:762] ["no snapshots found for collection, skip"]
standalone-1 | 2026-11-01T03:59:27.154635679Z [2026/11/01 03:59:27.152 +00:00] [INFO] [datacoord/snapshot_manager.go:540] ["all snapshots dropped for collection"] [droppedCount=0]
standalone-1 | 2026-11-01T03:59:27.154638596Z [2026/11/01 03:59:27.152 +00:00] [INFO] [datacoord/ddl_callbacks_snapshot.go:88] ["dropSnapshotsByCollectionV2AckCallback completed"] [collectionID=470156719476442097]
standalone-1 | 2026-11-01T03:59:27.154640304Z [2026/11/01 03:59:27.153 +00:00] [INFO] [rootcoord/meta_table.go:636] ["update coll state to dropping"] [collectionID=470156719476442097] [state=CollectionDropping]
standalone-1 | 2026-11-01T03:59:27.154641887Z [2026/11/01 03:59:27.153 +00:00] [INFO] [rootcoord/meta_table.go:653] ["drop collection from meta table"] [collection=470156719476442097] [state=CollectionCreated] [ts=470156722597003281]
standalone-1 | 2026-11-01T03:59:27.154643471Z [2026/11/01 03:59:27.153 +00:00] [INFO] [balancer/balancer_impl.go:584] ["start to balance"] [module=streamingcoord] [component=balancer] [policy=vchannelFair]
standalone-1 | 2026-11-01T03:59:27.154645096Z [2026/11/01 03:59:27.153 +00:00] [INFO] [balancer/balancer_impl.go:588] ["collect all status..."] [module=streamingcoord] [component=balancer] [policy=vchannelFair] [resourceGroupHint=]
standalone-1 | 2026-11-01T03:59:27.154646721Z [2026/11/01 03:59:27.154 +00:00] [INFO] [tombstone/scheduler.go:77] ["tombstone added"] [module=rootcoord] [component=tombstone_sweeper] [tombstone=c:470156719476442097]
standalone-1 | 2026-11-01T03:59:27.159445804Z [2026/11/01 03:59:27.157 Z] [GIN] [/v2/vectordb/collections/drop] [traceID=a61c6ec1023faa0024942391d79f0788] [code=200] [latency=2.986561293s] [client=172.18.0.1] [method=POST] [error=]
standalone-1 | 2026-11-01T03:59:27.643891888Z [2026/11/01 03:59:27.154 +00:00] [INFO] [balancer/balancer_impl.go:605] ["balance policy generate result success, try to assign..."] [module=streamingcoord] [component=balancer] [policy=vchannelFair] [expectedLayout=by-dev-rootcoord-dml_11:rw@3>[email protected] :22222,by-dev-rootcoord-dml_5:rw@3>[email protected] :22222,by-dev-rootcoord-dml_14:rw@3>[email protected] :22222,by-dev-rootcoord-dml_15:rw@3>[email protected] :22222,by-dev-rootcoord-dml_12:rw@3>[email protected] :22222,by-dev-rootcoord-dml_1:rw@3>[email protected] :22222,by-dev-rootcoord-dml_3:rw@3>[email protected] :22222,by-dev-rootcoord-dml_9:rw@3>[email protected] :22222,by-dev-rootcoord-dml_0:rw@3>[email protected] :22222,by-dev-rootcoord-dml_13:rw@3>[email protected] :22222,by-dev-rootcoord-dml_8:rw@3>[email protected] :22222,by-dev-rootcoord-dml_7:rw@3>[email protected] :22222,by-dev-rootcoord-dml_10:rw@3>[email protected] :22222,by-dev-rootcoord-dml_2:rw@3>[email protected] :22222,by-dev-rootcoord-dml_6:rw@3>[email protected] :22222,by-dev-rootcoord-dml_4:rw@3>[email protected] :22222]
standalone-1 | 2026-11-01T03:59:27.643946013Z [2026/11/01 03:59:27.154 +00:00] [INFO] [balancer/balancer_impl.go:613] ["no change of balance result need to be applied"] [module=streamingcoord] [component=balancer] [policy=vchannelFair]
standalone-1 | 2026-11-01T03:59:27.643948763Z [2026/11/01 03:59:27.154 +00:00] [INFO] [balancer/balancer_impl.go:424] ["apply balance success"] [module=streamingcoord] [component=balancer] [policy=vchannelFair]
standalone-1 | 2026-11-01T03:59:27.643950596Z [2026/11/01 03:59:27.154 +00:00] [INFO] [balancer/balancer_impl.go:373] ["balance wait"] [module=streamingcoord] [component=balancer] [policy=vchannelFair] [nextBalanceInterval=1m0s]
standalone-1 | 2026-11-01T03:59:27.643951971Z [2026/11/01 03:59:27.156 +00:00] [INFO] [proxy/impl.go:158] ["received request to invalidate collection meta cache"] [module=proxy] [module=Proxy] [traceID=3ccb33b4b882bc586da9ce42044b1ed3] [spanID=24829c843584929c]
standalone-1 | 2026-11-01T03:59:27.643964471Z [2026/11/01 03:59:27.156 +00:00] [INFO] [shardclient/manager.go:318] ["Invalidate shard cache for collections"] [collectionIDs="[470156719476442097]"]
standalone-1 | 2026-11-01T03:59:27.643967471Z [2026/11/01 03:59:27.156 +00:00] [INFO] [proxy/impl.go:204] ["complete to invalidate collection meta cache with collection name"] [module=proxy] [module=Proxy] [type=DropCollection] [traceID=3ccb33b4b882bc586da9ce42044b1ed3] [spanID=24829c843584929c]
standalone-1 | 2026-11-01T03:59:27.643969013Z [2026/11/01 03:59:27.156 +00:00] [INFO] [proxy/impl.go:250] ["complete to invalidate collection meta cache"] [module=proxy] [module=Proxy] [traceID=3ccb33b4b882bc586da9ce42044b1ed3] [spanID=24829c843584929c]
standalone-1 | 2026-11-01T03:59:27.643970346Z [2026/11/01 03:59:27.157 +00:00] [INFO] [broadcaster/broadcast_task.go:569] ["save broadcast task done"] [module=streamingcoord] [component=broadcaster] [message="{type=DropCollection,broadcastID=470156719476441100,broadcastVChannels=by-dev-rootcoord-dml_0_470156719476442097v0,by-dev-rootcoord-dml_0_vcchan,ackSyncUp=true,size=37,collectionID=470156719476442097}"] [state=BROADCAST_TASK_STATE_TOMBSTONE] [ackedVChannelCount=2]
standalone-1 | 2026-11-01T03:59:27.643972096Z [2026/11/01 03:59:27.157 +00:00] [INFO] [broadcaster/ack_callback_scheduler.go:256] ["execute ack callback done"] [module=streamingcoord] [component=broadcaster] [broadcastID=470156719476441100]
standalone-1 | 2026-11-01T03:59:27.643973346Z [2026/11/01 03:59:27.157 +00:00] [INFO] [rootcoord/root_coord.go:1127] ["done to drop collection"] [role=rootcoord] [dbName=default] [name=smoke_test] [module=mixcoord] [traceID=a61c6ec1023faa0024942391d79f0788] [spanID=bb60f393e27302ad]
standalone-1 | 2026-11-01T03:59:27.643974721Z [2026/11/01 03:59:27.157 +00:00] [INFO] [broadcaster/tombstone_scheduler.go:118] [triggerGCTombstone] [module=streamingcoord] [component=broadcaster] ["tombstone count"=4] ["expired offset"=0] ["expired time"=2026/10/31 03:59:27.157 +00:00]
standalone-1 | 2026-11-01T03:59:27.643976179Z [2026/11/01 03:59:27.157 +00:00] [INFO] [proxy/impl.go:594] ["DropCollection done"] [BeginTs=470156722609848322] [EndTs=470156722609848322]
standalone-1 | 2026-11-01T03:59:27.643977346Z [2026/11/01 03:59:27.643 +00:00] [INFO] [task/scheduler.go:1326] ["task removed"] [channel=by-dev-rootcoord-dml_0_470156719476442097v0] [traceID=c851078e86e76cecc912514a90c95f94] [spanID=834954cda23850e3]
standalone-1 | 2026-11-01T03:59:27.643978638Z [2026/11/01 03:59:27.643 +00:00] [INFO] [task/scheduler.go:1080] ["processed tasks"] [nodeID=1] [toProcessNum=0] [committedNum=0] [toRemoveNum=1] [promoteDur=31.292µs] [preprocessDUr=10.875µs] [processDUr=4.25µs] [totalDur=108.875µs] 