bug: query hangs when 2 nodes in cluster

[rad-pat]

Search before asking

• I had searched in the issues and found no similar issues.

Version

v1.2.680-p3

What's Wrong?

When running with 2 query nodes, one particular query seems to hang indefinitely. When expanded to 3 nodes, it runs quickly. I attach logs for the query nodes. The hanging query id is 6c44bc25-bf60-4919-9119-d41de5f983e8, but interestingly whilst getting the logs the same query ran quickly the first time I ran it, which would be query id 59a95344-2476-4b2b-b9b1-30475371d4c4, but that seems to have ran on query node 1 firstly.

databend-query-0.txt
databend-query-1.txt

How to Reproduce?

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

[sundy-li]

Seems to be another bug, can you share the dataset(parquet files) to reproduce this hang?

And please provide the full logs with Very slow processor async task, it will dump the pipeline each 200 seconds.

[rad-pat]

These are the dump of pipeline. I will have to ask about providing data as it is customer data

58485388-fae6-4b22-b850-5cd3ffda1ad4 2025-01-23T11:23:29.316175Z ERROR databend_query::pipelines::executor::processor_async_task: processor_async_task.rs:153 Very slow processor async task, query_id:"58485388-fae6-4b22-b850-5cd3ffda1ad4", processor id: NodeIndex(197), name: "HashJoinProbe", elapsed: 200.05044706s, active sync workers: 0, [Node { name: "BlockPartitionSource", id: 0, state: "Idle", inputs_status: [], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "AsyncReadParquetDataTransform", id: 1, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "DeserializeDataTransform", id: 2, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "DummyTransform", id: 3, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "ExchangeSourceReader", id: 4, state: "Idle", inputs_status: [], outputs_status: [("Unfinished", "Nodata", "UnNeeded")], details: "Display { source: \"7zynrpdQxg7PI5M3A5q656\", destination: \"DSwIiSPPh7QKX13wrinBg3\", fragment: 2, can_push: false }" }, Node { name: "Resize", id: 5, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded"), ("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "TransformExchangeDeserializer", id: 6, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "HashJoinProbe", id: 7, state: "Processing", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "Resize", id: 8, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformPartialAggregate", id: 9, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformAggregateSpillWriter", id: 10, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformPartitionBucket", id: 11, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 12, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 13, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 14, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "HashJoinBuild", id: 15, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [] }, Node { name: "BlockPartitionSource", id: 16, state: "Finished", inputs_status: [], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "AsyncReadParquetDataTransform", id: 17, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "DeserializeDataTransform", id: 18, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "TransformPartialAggregate", id: 19, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "ScatterTransform", id: 20, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformExchangeAggregateSerializer", id: 21, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformExchangeAsyncBarrier", id: 22, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformExchangeSorting", id: 23, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "ExchangeShuffleTransform", id: 24, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")], details: "Display { queue_status: [(0, 0), (1, 0)], inputs: 1, finished_inputs: 1, outputs: 2, finished_outputs: 2, waiting_outputs: [0, 1], waiting_inputs: [] }" }, Node { name: "ExchangeWriterSink", id: 25, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [], details: "Display { source: \"DSwIiSPPh7QKX13wrinBg3\", destination: \"7zynrpdQxg7PI5M3A5q656\", fragment: 0 }" }, Node { name: "Resize", id: 26, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")] }, Node { name: "ExchangeSourceReader", id: 27, state: "Finished", inputs_status: [], outputs_status: [("Finished", "Nodata", "UnNeeded")], details: "Display { source: \"7zynrpdQxg7PI5M3A5q656\", destination: \"DSwIiSPPh7QKX13wrinBg3\", fragment: 0, can_push: false }" }, Node { name: "TransformDeserializer", id: 28, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 29, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 30, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 31, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 32, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 33, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 34, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 35, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 36, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 37, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 38, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 39, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 40, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 41, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 42, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 43, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 44, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformPartitionBucket", id: 45, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "Resize", id: 46, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 47, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 48, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 49, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 50, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 51, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 52, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 53, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 54, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 55, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 56, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 57, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 58, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 59, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 60, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 61, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 62, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 63, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 64, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 65, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 66, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 67, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 68, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 69, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 70, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 71, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 72, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 73, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 74, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 75, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 76, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 77, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 78, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 79, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 80, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 81, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 82, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 83, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 84, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 85, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 86, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 87, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 88, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 89, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 90, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 91, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 92, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 93, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 94, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 95, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 96, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 97, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 98, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 99, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 100, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 101, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 102, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 103, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 104, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 105, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 106, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 107, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 108, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 109, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 110, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 111, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 112, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 113, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 114, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 115, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 116, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 117, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 118, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 119, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 120, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 121, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 122, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 123, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 124, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 125, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 126, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 127, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 128, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 129, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 130, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 131, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 132, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 133, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 134, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 135, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 136, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 137, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 138, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 139, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 140, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 141, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 142, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 143, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 144, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 145, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 146, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 147, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 148, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergePartitioner", id: 149, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 150, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 151, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 152, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 153, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 154, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 155, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 156, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 157, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 158, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 159, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 160, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 161, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 162, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 163, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 164, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 165, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeCombiner", id: 166, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "DummyTransform", id: 167, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "ExchangeSourceReader", id: 168, state: "Finished", inputs_status: [], outputs_status: [("Finished", "Nodata", "UnNeeded")], details: "Display { source: \"7zynrpdQxg7PI5M3A5q656\", destination: \"DSwIiSPPh7QKX13wrinBg3\", fragment: 1, can_push: false }" }, Node { name: "TransformExchangeDeserializer", id: 169, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformExchangeDeserializer", id: 170, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergePartitioner", id: 171, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 172, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 173, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 174, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 175, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 176, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 177, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 178, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 179, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 180, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 181, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 182, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 183, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 184, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 185, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 186, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 187, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeCombiner", id: 188, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "HashJoinBuild", id: 189, state: "Idle", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [] }, Node { name: "BlockPartitionSource", id: 190, state: "Idle", inputs_status: [], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "AsyncReadParquetDataTransform", id: 191, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "DeserializeDataTransform", id: 192, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "DummyTransform", id: 193, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "ExchangeSourceReader", id: 194, state: "Idle", inputs_status: [], outputs_status: [("Unfinished", "Nodata", "UnNeeded")], details: "Display { source: \"7zynrpdQxg7PI5M3A5q656\", destination: \"DSwIiSPPh7QKX13wrinBg3\", fragment: 3, can_push: false }" }, Node { name: "Resize", id: 195, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded"), ("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "TransformExchangeDeserializer", id: 196, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "HashJoinProbe", id: 197, state: "Processing", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "Resize", id: 198, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 199, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Project)", id: 200, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "BlockCompactBuilder", id: 201, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformCompactBlock", id: 202, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformSerializeBlock", id: 203, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformSerializeSegment", id: 204, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "MutationAggregator", id: 205, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "CommitSink", id: 206, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [] }]
58485388-fae6-4b22-b850-5cd3ffda1ad4 2025-01-23T11:23:29.316192Z ERROR databend_query::pipelines::executor::processor_async_task: processor_async_task.rs:153 Very slow processor async task, query_id:"58485388-fae6-4b22-b850-5cd3ffda1ad4", processor id: NodeIndex(7), name: "HashJoinProbe", elapsed: 200.050844889s, active sync workers: 0, [Node { name: "BlockPartitionSource", id: 0, state: "Idle", inputs_status: [], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "AsyncReadParquetDataTransform", id: 1, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "DeserializeDataTransform", id: 2, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "DummyTransform", id: 3, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "ExchangeSourceReader", id: 4, state: "Idle", inputs_status: [], outputs_status: [("Unfinished", "Nodata", "UnNeeded")], details: "Display { source: \"7zynrpdQxg7PI5M3A5q656\", destination: \"DSwIiSPPh7QKX13wrinBg3\", fragment: 2, can_push: false }" }, Node { name: "Resize", id: 5, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded"), ("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "TransformExchangeDeserializer", id: 6, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "HashJoinProbe", id: 7, state: "Processing", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "Resize", id: 8, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformPartialAggregate", id: 9, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformAggregateSpillWriter", id: 10, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformPartitionBucket", id: 11, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 12, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 13, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 14, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "HashJoinBuild", id: 15, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [] }, Node { name: "BlockPartitionSource", id: 16, state: "Finished", inputs_status: [], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "AsyncReadParquetDataTransform", id: 17, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "DeserializeDataTransform", id: 18, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "TransformPartialAggregate", id: 19, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "ScatterTransform", id: 20, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformExchangeAggregateSerializer", id: 21, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformExchangeAsyncBarrier", id: 22, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformExchangeSorting", id: 23, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "ExchangeShuffleTransform", id: 24, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")], details: "Display { queue_status: [(0, 0), (1, 0)], inputs: 1, finished_inputs: 1, outputs: 2, finished_outputs: 2, waiting_outputs: [0, 1], waiting_inputs: [] }" }, Node { name: "ExchangeWriterSink", id: 25, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [], details: "Display { source: \"DSwIiSPPh7QKX13wrinBg3\", destination: \"7zynrpdQxg7PI5M3A5q656\", fragment: 0 }" }, Node { name: "Resize", id: 26, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")] }, Node { name: "ExchangeSourceReader", id: 27, state: "Finished", inputs_status: [], outputs_status: [("Finished", "Nodata", "UnNeeded")], details: "Display { source: \"7zynrpdQxg7PI5M3A5q656\", destination: \"DSwIiSPPh7QKX13wrinBg3\", fragment: 0, can_push: false }" }, Node { name: "TransformDeserializer", id: 28, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 29, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 30, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 31, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 32, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 33, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 34, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 35, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 36, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 37, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 38, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 39, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 40, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 41, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 42, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 43, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformDeserializer", id: 44, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformPartitionBucket", id: 45, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "Resize", id: 46, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "UnNeeded"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 47, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 48, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 49, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 50, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 51, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 52, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 53, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 54, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 55, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 56, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 57, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 58, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 59, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 60, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 61, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 62, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSpillReader", id: 63, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 64, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 65, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 66, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 67, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 68, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 69, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 70, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 71, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 72, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 73, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 74, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 75, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 76, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 77, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 78, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 79, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformFinalAggregate", id: 80, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 81, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 82, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 83, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 84, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 85, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 86, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 87, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 88, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 89, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 90, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 91, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 92, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 93, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 94, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 95, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 96, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 97, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 98, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 99, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 100, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 101, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 102, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 103, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 104, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 105, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 106, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 107, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 108, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 109, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 110, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 111, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "SortPartialTransform", id: 112, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 113, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "SortPartialTransform", id: 114, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 115, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 116, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 117, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 118, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 119, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 120, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 121, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 122, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 123, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 124, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 125, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 126, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 127, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 128, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 129, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 130, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortMerge", id: 131, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 132, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 133, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 134, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 135, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 136, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 137, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 138, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 139, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 140, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 141, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 142, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 143, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 144, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 145, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 146, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 147, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformSortSpill", id: 148, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergePartitioner", id: 149, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 150, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 151, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 152, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 153, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 154, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 155, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 156, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 157, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 158, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 159, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 160, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 161, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 162, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 163, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 164, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 165, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeCombiner", id: 166, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "UnNeeded")] }, Node { name: "DummyTransform", id: 167, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "ExchangeSourceReader", id: 168, state: "Finished", inputs_status: [], outputs_status: [("Finished", "Nodata", "UnNeeded")], details: "Display { source: \"7zynrpdQxg7PI5M3A5q656\", destination: \"DSwIiSPPh7QKX13wrinBg3\", fragment: 1, can_push: false }" }, Node { name: "TransformExchangeDeserializer", id: 169, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "TransformExchangeDeserializer", id: 170, state: "Finished", inputs_status: [("Finished", "Nodata", "UnNeeded")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergePartitioner", id: 171, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 172, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 173, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 174, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 175, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 176, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 177, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 178, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 179, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 180, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 181, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 182, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 183, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 184, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 185, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 186, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeWorker", id: 187, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "KWayMergeCombiner", id: 188, state: "Finished", inputs_status: [("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData"), ("Finished", "Nodata", "NeedData")], outputs_status: [("Finished", "Nodata", "NeedData")] }, Node { name: "HashJoinBuild", id: 189, state: "Idle", inputs_status: [("Finished", "Nodata", "NeedData")], outputs_status: [] }, Node { name: "BlockPartitionSource", id: 190, state: "Idle", inputs_status: [], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "AsyncReadParquetDataTransform", id: 191, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "DeserializeDataTransform", id: 192, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "DummyTransform", id: 193, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "ExchangeSourceReader", id: 194, state: "Idle", inputs_status: [], outputs_status: [("Unfinished", "Nodata", "UnNeeded")], details: "Display { source: \"7zynrpdQxg7PI5M3A5q656\", destination: \"DSwIiSPPh7QKX13wrinBg3\", fragment: 3, can_push: false }" }, Node { name: "Resize", id: 195, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded"), ("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "TransformExchangeDeserializer", id: 196, state: "Idle", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "UnNeeded")] }, Node { name: "HashJoinProbe", id: 197, state: "Processing", inputs_status: [("Unfinished", "Nodata", "UnNeeded")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "Resize", id: 198, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Map)", id: 199, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "CompoundBlockOperator(Project)", id: 200, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "BlockCompactBuilder", id: 201, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformCompactBlock", id: 202, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformSerializeBlock", id: 203, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "TransformSerializeSegment", id: 204, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "MutationAggregator", id: 205, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [("Unfinished", "Nodata", "NeedData")] }, Node { name: "CommitSink", id: 206, state: "Idle", inputs_status: [("Unfinished", "Nodata", "NeedData")], outputs_status: [] }]
58485388-fae6-4b22-b850-5cd3ffda1ad4 2025-01-23T11:23:34.318224Z  WARN databend_query::pipelines::executor::processor_async_task: processor_async_task.rs:146 Very slow processor async task, query_id:"58485388-fae6-4b22-b850-5cd3ffda1ad4", processor id: NodeIndex(197), name: "HashJoinProbe", elapsed: 205.05331144s, active sync workers: 0

[sundy-li]

Can you trigger the hang with enable_parallel_multi_merge_sort = 0?

[rad-pat]

It looks like setting that does indeed fix the issue. I set to 0, could not reproduce. Set it back and it hang on the first execution

[rad-pat]

Do you still need the data, or do you have an idea where to look?

[sundy-li]

Do you still need the data?

Yes, better to provide the data that could reproduce the issue.

You can use siphash64(varchar) to mask the data into a new table.

create table mask_t as select siphash64(v1)::string, siphash64(v2)::string,  siphash64(i3)::Int ... from t;

[rad-pat]

OK, I have the data and a script that should demonstrate the issue.

tables.zip

CREATE OR REPLACE TRANSIENT TABLE t1 (
  "Controlling Area" VARCHAR NULL,
  "Record Type" VARCHAR NULL,
  "Plan\Actual Indicator" VARCHAR NULL,
  "Version" VARCHAR NULL,
  "Month" VARCHAR NULL,
  "Period" VARCHAR NULL,
  "Year" VARCHAR NULL,
  "Posting Date" VARCHAR NULL,
  "Created On" VARCHAR NULL,
  "Created By" VARCHAR NULL,
  "Company Code" VARCHAR NULL,
  "Business Area" VARCHAR NULL,
  "Profit Center" VARCHAR NULL,
  "Partner Profit Center" VARCHAR NULL,
  "DocumentNumber" VARCHAR NULL,
  "Item Number" VARCHAR NULL,
  "Reference Doc Number" VARCHAR NULL,
  "Sales Order" VARCHAR NULL,
  "Invoice Number" VARCHAR NULL,
  "Order Number" VARCHAR NULL,
  "Customer" VARCHAR NULL,
  "End Customer Bill-to" VARCHAR NULL,
  "End Customer Name" VARCHAR NULL,
  "End Customer Ship-to" VARCHAR NULL,
  "Customer Country" VARCHAR NULL,
  "Delivery Bill-to" VARCHAR NULL,
  "Bill-to Country" VARCHAR NULL,
  "Delivery Ship-to" VARCHAR NULL,
  "Ship-to Country" VARCHAR NULL,
  "Customer Type" VARCHAR NULL,
  "Marketing Channel" VARCHAR NULL,
  "Marketing Region" VARCHAR NULL,
  "Region" VARCHAR NULL,
  "Division" VARCHAR NULL,
  "Sales Org" VARCHAR NULL,
  "Distribution Channel" VARCHAR NULL,
  "Sales Type" VARCHAR NULL,
  "Build Plant" VARCHAR NULL,
  "Clear Plant" VARCHAR NULL,
  "Brand" VARCHAR NULL,
  "Class" VARCHAR NULL,
  "Product Family" VARCHAR NULL,
  "Meta Series" VARCHAR NULL,
  "Series" VARCHAR NULL,
  "Model" VARCHAR NULL,
  "Serial Number" VARCHAR NULL,
  "Program Code" VARCHAR NULL,
  "Parts Category" VARCHAR NULL,
  "Product" VARCHAR NULL,
  "Product Hierarchy" VARCHAR NULL,
  "Material Group" VARCHAR NULL,
  "Material Group 1" VARCHAR NULL,
  "Material Group 5" VARCHAR NULL,
  "Brake Type" VARCHAR NULL,
  "E Hydraulic Type" VARCHAR NULL,
  "Engine Family Code" VARCHAR NULL,
  "Engine Type" VARCHAR NULL,
  "Fuel Type" VARCHAR NULL,
  "Mast Type" VARCHAR NULL,
  "SPED Category" VARCHAR NULL,
  "Tire Type" VARCHAR NULL,
  "Transmission Type" VARCHAR NULL,
  "Work Unit" VARCHAR NULL,
  "Reference Transaction" VARCHAR NULL,
  "Currency Type" VARCHAR NULL,
  "Currency Key" VARCHAR NULL,
  "Currency of Record" VARCHAR NULL,
  "Invoice Currency" VARCHAR NULL,
  "Exchange Rate" DECIMAL(38, 10) NULL,
  "Bookings" DECIMAL(38, 10) NULL,
  "Quantity" DECIMAL(38, 10) NULL,
  "Revenue" DECIMAL(38, 10) NULL,
  "DS_Rev" DECIMAL(38, 10) NULL,
  "Cash Discounts" DECIMAL(38, 10) NULL,
  "Discounts" DECIMAL(38, 10) NULL,
  "Addl Discounts" DECIMAL(38, 10) NULL,
  "Tax ICMS" DECIMAL(38, 10) NULL,
  "Tax Other" DECIMAL(38, 10) NULL,
  "Freight Revenue" DECIMAL(38, 10) NULL,
  "Revenue Other" DECIMAL(38, 10) NULL,
  "Sales Leaseback Revenue" DECIMAL(38, 10) NULL,
  "Telemetry Revenue" DECIMAL(38, 10) NULL,
  "COS" DECIMAL(38, 10) NULL,
  "Dearler Commission" DECIMAL(38, 10) NULL,
  "Warranty" DECIMAL(38, 10) NULL,
  "Freight Cost" DECIMAL(38, 10) NULL,
  "COS Other" DECIMAL(38, 10) NULL,
  "Sales Leaseback COS" DECIMAL(38, 10) NULL,
  "Telemetry COS" DECIMAL(38, 10) NULL,
  "IC_Units" DECIMAL(38, 10) NULL,
  "IC_Revenue" DECIMAL(38, 10) NULL,
  "IC_Markup" DECIMAL(38, 10) NULL,
  "IC_COS" DECIMAL(38, 10) NULL,
  "Other Cost Actual" DECIMAL(38, 10) NULL,
  "Other Cost Standard" DECIMAL(38, 10) NULL,
  "REV@Plan" DECIMAL(38, 10) NULL,
  "DISC@Plan" DECIMAL(38, 10) NULL,
  "COS@Plan" DECIMAL(38, 10) NULL,
  "Country" VARCHAR NULL,
  product_category VARCHAR NULL,
  "Rev_pct" DECIMAL(38, 10) NULL,
  "Rev_Oth_pct" DECIMAL(38, 10) NULL,
  "Disc_pct" DECIMAL(38, 10) NULL,
  "COS_pct" DECIMAL(38, 10) NULL
);

CREATE OR REPLACE TABLE t2 (
  year_month VARCHAR NULL,
  invoice_nr VARCHAR NULL,
  "Prod_Cat" VARCHAR NULL,
  "Rev" DECIMAL(38, 10) NULL,
  "Rev_Oth" DECIMAL(38, 10) NULL,
  "Disc" DECIMAL(38, 10) NULL,
  "COS" DECIMAL(38, 10) NULL
);

CREATE OR REPLACE VIEW v1 AS
	SELECT CAST(t2.year_month AS STRING) AS year_month
		,CAST(t2.invoice_nr AS STRING) AS invoice_nr
		,CAST(sum(t2."Rev") AS DECIMAL(38, 10)) AS "Rev"
		,CAST(sum(t2."Rev_Oth") AS DECIMAL(38, 10)) AS "Rev_Oth"
		,CAST(sum(t2."Disc") AS DECIMAL(38, 10)) AS "Disc"
		,CAST(sum(t2."COS") AS DECIMAL(38, 10)) AS "COS"
	FROM t2
	GROUP BY t2.year_month
		,t2.invoice_nr
	ORDER BY CAST(t2.invoice_nr AS STRING) ASC;


CREATE OR REPLACE TRANSIENT TABLE final (
  "Controlling Area" VARCHAR NULL,
  "Record Type" VARCHAR NULL,
  "Plan_Actual Indicator" VARCHAR NULL,
  "Version" VARCHAR NULL,
  "Month" VARCHAR NULL,
  "Period" VARCHAR NULL,
  "Year" VARCHAR NULL,
  "Posting Date" VARCHAR NULL,
  "Created On" VARCHAR NULL,
  "Created By" VARCHAR NULL,
  "Company Code" VARCHAR NULL,
  "Business Area" VARCHAR NULL,
  "Profit Center" VARCHAR NULL,
  "Partner Profit Center" VARCHAR NULL,
  "DocumentNumber" VARCHAR NULL,
  "Item Number" VARCHAR NULL,
  "Reference Doc Number" VARCHAR NULL,
  "Sales Order" VARCHAR NULL,
  "Invoice Number" VARCHAR NULL,
  "Order Number" VARCHAR NULL,
  "Customer" VARCHAR NULL,
  "End Customer Bill-to" VARCHAR NULL,
  "End Customer Name" VARCHAR NULL,
  "End Customer Ship-to" VARCHAR NULL,
  "Customer Country" VARCHAR NULL,
  "Delivery Bill-to" VARCHAR NULL,
  "Bill-to Country" VARCHAR NULL,
  "Delivery Ship-to" VARCHAR NULL,
  "Ship-to Country" VARCHAR NULL,
  "Customer Type" VARCHAR NULL,
  "Marketing Channel" VARCHAR NULL,
  "Marketing Region" VARCHAR NULL,
  "Region" VARCHAR NULL,
  "Division" VARCHAR NULL,
  "Sales Org" VARCHAR NULL,
  "Distribution Channel" VARCHAR NULL,
  "Sales Type" VARCHAR NULL,
  "Build Plant" VARCHAR NULL,
  "Clear Plant" VARCHAR NULL,
  "Brand" VARCHAR NULL,
  "Class" VARCHAR NULL,
  "Product Family" VARCHAR NULL,
  "Meta Series" VARCHAR NULL,
  "Series" VARCHAR NULL,
  "Model" VARCHAR NULL,
  "Serial Number" VARCHAR NULL,
  "Program Code" VARCHAR NULL,
  "Parts Category" VARCHAR NULL,
  "Product" VARCHAR NULL,
  "Product Hierarchy" VARCHAR NULL,
  "Material Group" VARCHAR NULL,
  "Material Group 1" VARCHAR NULL,
  "Material Group 5" VARCHAR NULL,
  "Brake Type" VARCHAR NULL,
  "E Hydraulic Type" VARCHAR NULL,
  "Engine Family Code" VARCHAR NULL,
  "Engine Type" VARCHAR NULL,
  "Fuel Type" VARCHAR NULL,
  "Mast Type" VARCHAR NULL,
  "SPED Category" VARCHAR NULL,
  "Tire Type" VARCHAR NULL,
  "Transmission Type" VARCHAR NULL,
  "Work Unit" VARCHAR NULL,
  "Reference Transaction" VARCHAR NULL,
  "Currency Type" VARCHAR NULL,
  "Currency Key" VARCHAR NULL,
  "Currency of Record" VARCHAR NULL,
  "Invoice Currency" VARCHAR NULL,
  "Exchange Rate" DECIMAL(38, 10) NULL,
  "Bookings" DECIMAL(38, 10) NULL,
  "Quantity" DECIMAL(38, 10) NULL,
  "Revenue" DECIMAL(38, 10) NULL,
  "DS_Rev" DECIMAL(38, 10) NULL,
  "Cash Discounts" DECIMAL(38, 10) NULL,
  "Discounts" DECIMAL(38, 10) NULL,
  "Addl Discounts" DECIMAL(38, 10) NULL,
  "Tax ICMS" DECIMAL(38, 10) NULL,
  "Tax Other" DECIMAL(38, 10) NULL,
  "Freight Revenue" DECIMAL(38, 10) NULL,
  "Revenue Other" DECIMAL(38, 10) NULL,
  "Sales Leaseback Revenue" DECIMAL(38, 10) NULL,
  "Telemetry Revenue" DECIMAL(38, 10) NULL,
  "COS" DECIMAL(38, 10) NULL,
  "Dearler Commission" DECIMAL(38, 10) NULL,
  "Warranty" DECIMAL(38, 10) NULL,
  "Freight Cost" DECIMAL(38, 10) NULL,
  "COS Other" DECIMAL(38, 10) NULL,
  "Sales Leaseback COS" DECIMAL(38, 10) NULL,
  "Telemetry COS" DECIMAL(38, 10) NULL,
  "IC_Units" DECIMAL(38, 10) NULL,
  "IC_Revenue" DECIMAL(38, 10) NULL,
  "IC_Markup" DECIMAL(38, 10) NULL,
  "IC_COS" DECIMAL(38, 10) NULL,
  "Other Cost Actual" DECIMAL(38, 10) NULL,
  "Other Cost Standard" DECIMAL(38, 10) NULL,
  "REV@Plan" DECIMAL(38, 10) NULL,
  "DISC@Plan" DECIMAL(38, 10) NULL,
  "COS@Plan" DECIMAL(38, 10) NULL,
  "Country" VARCHAR NULL,
  product_category VARCHAR NULL,
  "Rev_pct" DECIMAL(38, 10) NULL,
  "Rev_Oth_pct" DECIMAL(38, 10) NULL,
  "Disc_pct" DECIMAL(38, 10) NULL,
  "COS_pct" DECIMAL(38, 10) NULL,
  "EPO_Rev" DECIMAL(38, 10) NULL,
  "EPO_Rev_Oth" DECIMAL(38, 10) NULL,
  "EPO_Disc" DECIMAL(38, 10) NULL,
  "EPO_COS" DECIMAL(38, 10) NULL
);

-- final query that shows the issue
INSERT INTO final
SELECT CAST(t1."Controlling Area" AS STRING) AS "Controlling Area"
	,CAST(t1."Record Type" AS STRING) AS "Record Type"
	,CAST(t1."Plan\Actual Indicator" AS STRING) AS "Plan\Actual Indicator"
	,CAST(t1."Version" AS STRING) AS "Version"
	,CAST(t1."Month" AS STRING) AS "Month"
	,CAST(t1."Period" AS STRING) AS "Period"
	,CAST(t1."Year" AS STRING) AS "Year"
	,CAST(t1."Posting Date" AS STRING) AS "Posting Date"
	,CAST(t1."Created On" AS STRING) AS "Created On"
	,CAST(t1."Created By" AS STRING) AS "Created By"
	,CAST(t1."Company Code" AS STRING) AS "Company Code"
	,CAST(t1."Business Area" AS STRING) AS "Business Area"
	,CAST(t1."Profit Center" AS STRING) AS "Profit Center"
	,CAST(t1."Partner Profit Center" AS STRING) AS "Partner Profit Center"
	,CAST(t1."DocumentNumber" AS STRING) AS "DocumentNumber"
	,CAST(t1."Item Number" AS STRING) AS "Item Number"
	,CAST(t1."Reference Doc Number" AS STRING) AS "Reference Doc Number"
	,CAST(t1."Sales Order" AS STRING) AS "Sales Order"
	,CAST(t1."Invoice Number" AS STRING) AS "Invoice Number"
	,CAST(t1."Order Number" AS STRING) AS "Order Number"
	,CAST(t1."Customer" AS STRING) AS "Customer"
	,CAST(t1."End Customer Bill-to" AS STRING) AS "End Customer Bill-to"
	,CAST(t1."End Customer Name" AS STRING) AS "End Customer Name"
	,CAST(t1."End Customer Ship-to" AS STRING) AS "End Customer Ship-to"
	,CAST(t1."Customer Country" AS STRING) AS "Customer Country"
	,CAST(t1."Delivery Bill-to" AS STRING) AS "Delivery Bill-to"
	,CAST(t1."Bill-to Country" AS STRING) AS "Bill-to Country"
	,CAST(t1."Delivery Ship-to" AS STRING) AS "Delivery Ship-to"
	,CAST(t1."Ship-to Country" AS STRING) AS "Ship-to Country"
	,CAST(t1."Customer Type" AS STRING) AS "Customer Type"
	,CAST(t1."Marketing Channel" AS STRING) AS "Marketing Channel"
	,CAST(t1."Marketing Region" AS STRING) AS "Marketing Region"
	,CAST(t1."Region" AS STRING) AS "Region"
	,CAST(t1."Division" AS STRING) AS "Division"
	,CAST(t1."Sales Org" AS STRING) AS "Sales Org"
	,CAST(t1."Distribution Channel" AS STRING) AS "Distribution Channel"
	,CAST(t1."Sales Type" AS STRING) AS "Sales Type"
	,CAST(t1."Build Plant" AS STRING) AS "Build Plant"
	,CAST(t1."Clear Plant" AS STRING) AS "Clear Plant"
	,CAST(t1."Brand" AS STRING) AS "Brand"
	,CAST(t1."Class" AS STRING) AS "Class"
	,CAST(t1."Product Family" AS STRING) AS "Product Family"
	,CAST(t1."Meta Series" AS STRING) AS "Meta Series"
	,CAST(t1."Series" AS STRING) AS "Series"
	,CAST(t1."Model" AS STRING) AS "Model"
	,CAST(t1."Serial Number" AS STRING) AS "Serial Number"
	,CAST(t1."Program Code" AS STRING) AS "Program Code"
	,CAST(t1."Parts Category" AS STRING) AS "Parts Category"
	,CAST(t1."Product" AS STRING) AS "Product"
	,CAST(t1."Product Hierarchy" AS STRING) AS "Product Hierarchy"
	,CAST(t1."Material Group" AS STRING) AS "Material Group"
	,CAST(t1."Material Group 1" AS STRING) AS "Material Group 1"
	,CAST(t1."Material Group 5" AS STRING) AS "Material Group 5"
	,CAST(t1."Brake Type" AS STRING) AS "Brake Type"
	,CAST(t1."E Hydraulic Type" AS STRING) AS "E Hydraulic Type"
	,CAST(t1."Engine Family Code" AS STRING) AS "Engine Family Code"
	,CAST(t1."Engine Type" AS STRING) AS "Engine Type"
	,CAST(t1."Fuel Type" AS STRING) AS "Fuel Type"
	,CAST(t1."Mast Type" AS STRING) AS "Mast Type"
	,CAST(t1."SPED Category" AS STRING) AS "SPED Category"
	,CAST(t1."Tire Type" AS STRING) AS "Tire Type"
	,CAST(t1."Transmission Type" AS STRING) AS "Transmission Type"
	,CAST(t1."Work Unit" AS STRING) AS "Work Unit"
	,CAST(t1."Reference Transaction" AS STRING) AS "Reference Transaction"
	,CAST(t1."Currency Type" AS STRING) AS "Currency Type"
	,CAST(t1."Currency Key" AS STRING) AS "Currency Key"
	,CAST(t1."Currency of Record" AS STRING) AS "Currency of Record"
	,CAST(t1."Invoice Currency" AS STRING) AS "Invoice Currency"
	,CAST(t1."Exchange Rate" AS DECIMAL(38, 10)) AS "Exchange Rate"
	,CAST(t1."Bookings" AS DECIMAL(38, 10)) AS "Bookings"
	,CAST(t1."Quantity" AS DECIMAL(38, 10)) AS "Quantity"
	,CAST(t1."Revenue" AS DECIMAL(38, 10)) AS "Revenue"
	,CAST(t1."DS_Rev" AS DECIMAL(38, 10)) AS "DS_Rev"
	,CAST(t1."Cash Discounts" AS DECIMAL(38, 10)) AS "Cash Discounts"
	,CAST(t1."Discounts" AS DECIMAL(38, 10)) AS "Discounts"
	,CAST(t1."Addl Discounts" AS DECIMAL(38, 10)) AS "Addl Discounts"
	,CAST(t1."Tax ICMS" AS DECIMAL(38, 10)) AS "Tax ICMS"
	,CAST(t1."Tax Other" AS DECIMAL(38, 10)) AS "Tax Other"
	,CAST(t1."Freight Revenue" AS DECIMAL(38, 10)) AS "Freight Revenue"
	,CAST(t1."Revenue Other" AS DECIMAL(38, 10)) AS "Revenue Other"
	,CAST(t1."Sales Leaseback Revenue" AS DECIMAL(38, 10)) AS "Sales Leaseback Revenue"
	,CAST(t1."Telemetry Revenue" AS DECIMAL(38, 10)) AS "Telemetry Revenue"
	,CAST(t1."COS" AS DECIMAL(38, 10)) AS "COS"
	,CAST(t1."Dearler Commission" AS DECIMAL(38, 10)) AS "Dearler Commission"
	,CAST(t1."Warranty" AS DECIMAL(38, 10)) AS "Warranty"
	,CAST(t1."Freight Cost" AS DECIMAL(38, 10)) AS "Freight Cost"
	,CAST(t1."COS Other" AS DECIMAL(38, 10)) AS "COS Other"
	,CAST(t1."Sales Leaseback COS" AS DECIMAL(38, 10)) AS "Sales Leaseback COS"
	,CAST(t1."Telemetry COS" AS DECIMAL(38, 10)) AS "Telemetry COS"
	,CAST(t1."IC_Units" AS DECIMAL(38, 10)) AS "IC_Units"
	,CAST(t1."IC_Revenue" AS DECIMAL(38, 10)) AS "IC_Revenue"
	,CAST(t1."IC_Markup" AS DECIMAL(38, 10)) AS "IC_Markup"
	,CAST(t1."IC_COS" AS DECIMAL(38, 10)) AS "IC_COS"
	,CAST(t1."Other Cost Actual" AS DECIMAL(38, 10)) AS "Other Cost Actual"
	,CAST(t1."Other Cost Standard" AS DECIMAL(38, 10)) AS "Other Cost Standard"
	,CAST(t1."REV@Plan" AS DECIMAL(38, 10)) AS "REV@Plan"
	,CAST(t1."DISC@Plan" AS DECIMAL(38, 10)) AS "DISC@Plan"
	,CAST(t1."COS@Plan" AS DECIMAL(38, 10)) AS "COS@Plan"
	,CAST(t1."Country" AS STRING) AS "Country"
	,CAST(t1.product_category AS STRING) AS product_category
	,CAST(t1."Rev_pct" AS DECIMAL(38, 10)) AS "Rev_pct"
	,CAST(t1."Rev_Oth_pct" AS DECIMAL(38, 10)) AS "Rev_Oth_pct"
	,CAST(t1."Disc_pct" AS DECIMAL(38, 10)) AS "Disc_pct"
	,CAST(t1."COS_pct" AS DECIMAL(38, 10)) AS "COS_pct"
	,CAST(CASE 
			WHEN anon_1."Rev" IS NOT NULL
				THEN anon_1."Rev"
			ELSE t1."Revenue"
			END AS DECIMAL(38, 10)) AS "EPO_Rev"
	,CAST(CASE 
			WHEN anon_1."Rev_Oth" IS NOT NULL
				THEN anon_1."Rev_Oth"
			ELSE t1."Revenue Other"
			END AS DECIMAL(38, 10)) AS "EPO_Rev_Oth"
	,CAST(CASE 
			WHEN anon_1."Disc" IS NOT NULL
				THEN anon_1."Disc"
			ELSE t1."Discounts"
			END AS DECIMAL(38, 10)) AS "EPO_Disc"
	,CAST(CASE 
			WHEN anon_1."COS" IS NOT NULL
				THEN anon_1."COS"
			ELSE t1."COS"
			END AS DECIMAL(38, 10)) AS "EPO_COS"
FROM t1
LEFT OUTER JOIN (
	SELECT CAST(min(v1.year_month) AS STRING) AS year_month
		,CAST(v1.invoice_nr AS STRING) AS invoice_nr
		,CAST(min(v1."Rev") AS DECIMAL(38, 10)) AS "Rev"
		,CAST(min(v1."Rev_Oth") AS DECIMAL(38, 10)) AS "Rev_Oth"
		,CAST(min(v1."Disc") AS DECIMAL(38, 10)) AS "Disc"
		,CAST(min(v1."COS") AS DECIMAL(38, 10)) AS "COS"
	FROM v1 AS v1
	WHERE EXISTS (
			SELECT *
			FROM t1 AS a_exists
			WHERE v1.invoice_nr = a_exists."Invoice Number"
			)
	GROUP BY v1.invoice_nr
	) AS anon_1 ON t1."Invoice Number" = anon_1.invoice_nr;

[sundy-li]

I reproduced it with simple case with 2 nodes.

select year_month, invoice_nr  FROM v1 AS v1
WHERE EXISTS (
	SELECT *
	FROM t1 AS a_exists
	WHERE v1.invoice_nr = a_exists."Invoice Number"
	) ignore_result;
	

https://pastila.nl/?000c2302/608024eb42a672312ff98d192fe62ca5#tLmRducW0uZHtzduF9Nuzw==

[sundy-li]

using cte to replace the view v1

1. works fine

with v2 as (
	SELECT CAST(t2.invoice_nr AS STRING) AS invoice_nr
	FROM t2
	GROUP BY t2.invoice_nr 
)
select   invoice_nr  FROM v2 AS v2
WHERE EXISTS (
	SELECT 1
	FROM t1 AS a_exists
	WHERE v2.invoice_nr = a_exists."Invoice Number"
	) ignore_result;

	

2. hang with order by

with v2 as (
	SELECT CAST(t2.invoice_nr AS STRING) AS invoice_nr
	FROM t2
	GROUP BY t2.invoice_nr 	ORDER BY invoice_nr ASC
)
select   invoice_nr  FROM v2 AS v2
WHERE EXISTS (
	SELECT 1
	FROM t1 AS a_exists
	WHERE v2.invoice_nr = a_exists."Invoice Number"
	) ignore_result;

[sundy-li]

Another reproduce case without loading data

  
with v2 as (
 SELECT
     'xx' || cast(number as string) AS invoice_nr
  FROM
    numbers(13054)
  group by
    invoice_nr order by invoice_nr
)
select   v2.invoice_nr  from v2 where  EXISTS (
	 SELECT
      cast(number as string) AS invoice_nr
    FROM
      numbers(80000) where  v2.invoice_nr = cast(number as string)
	) ignore_result;