collect数据的调用栈

    1. Caused by: java.lang.RuntimeException: No space left on device
    2.     at org.apache.flink.streaming.runtime.io.RecordWriterOutput.pushToRecordWriter(RecordWriterOutput.java:110)
    3.     at org.apache.flink.streaming.runtime.io.RecordWriterOutput.collect(RecordWriterOutput.java:89)
    4.     at org.apache.flink.streaming.runtime.io.RecordWriterOutput.collect(RecordWriterOutput.java:45)
    5.     at org.apache.flink.streaming.api.operators.AbstractStreamOperator$CountingOutput.collect(AbstractStreamOperator.java:727)
    6.     at org.apache.flink.streaming.api.operators.AbstractStreamOperator$CountingOutput.collect(AbstractStreamOperator.java:705)
    7.     at BatchCalc$25.processElement(Unknown Source)
    8.     at org.apache.flink.streaming.runtime.tasks.OperatorChain$ChainingOutput.pushToOperator(OperatorChain.java:546)
    9.     ... 15 more
    10. Caused by: java.io.IOException: No space left on device
    11.     at sun.nio.ch.FileDispatcherImpl.writev0(Native Method)
    12.     at sun.nio.ch.FileDispatcherImpl.writev(FileDispatcherImpl.java:72)
    13.     at sun.nio.ch.IOUtil.write(IOUtil.java:148)
    14.     at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:239)
    15.     at java.nio.channels.FileChannel.write(FileChannel.java:414)
    16.     at org.apache.flink.runtime.io.network.partition.BufferReaderWriterUtil.writeToByteChannel(BufferReaderWriterUtil.java:120)
    17.     at org.apache.flink.runtime.io.network.partition.BufferReaderWriterUtil.writeToByteChannelIfBelowSize(BufferReaderWriterUtil.java:133)
    18.     at org.apache.flink.runtime.io.network.partition.FileChannelMemoryMappedBoundedData.tryWriteBuffer(FileChannelMemoryMappedBoundedData.java:113)
    19.     at org.apache.flink.runtime.io.network.partition.FileChannelMemoryMappedBoundedData.writeBuffer(FileChannelMemoryMappedBoundedData.java:100)
    20.     at org.apache.flink.runtime.io.network.partition.BoundedBlockingSubpartition.writeAndCloseBufferConsumer(BoundedBlockingSubpartition.java:152)
    21.     at org.apache.flink.runtime.io.network.partition.BoundedBlockingSubpartition.flushCurrentBuffer(BoundedBlockingSubpartition.java:143)
    22.     at org.apache.flink.runtime.io.network.partition.BoundedBlockingSubpartition.add(BoundedBlockingSubpartition.java:124)
    23.     at org.apache.flink.runtime.io.network.partition.ResultPartition.addBufferConsumer(ResultPartition.java:198)
    24.     at org.apache.flink.runtime.io.network.api.writer.RecordWriter.requestNewBufferBuilder(RecordWriter.java:258)
    25.     at org.apache.flink.runtime.io.network.api.writer.RecordWriter.copyFromSerializerToTargetChannel(RecordWriter.java:184)
    26.     at org.apache.flink.runtime.io.network.api.writer.RecordWriter.emit(RecordWriter.java:154)
    27.     at org.apache.flink.runtime.io.network.api.writer.RecordWriter.emit(RecordWriter.java:120)
    28.     at org.apache.flink.streaming.runtime.io.RecordWriterOutput.pushToRecordWriter(RecordWriterOutput.java:107)
    29.     ... 21 more

    网络shuffle的数据会通过内存到文件的映射写入到配置io.tmp.dirs指定的文件夹下的文件内