1. 这个报错不是“运气不好”，而是Flink状态一致性机制在敲门“Flink checkpoint failed”——这行日志在某次凌晨三点的告警群里炸开时，我正盯着监控面板上那条突然断崖式下跌的吞吐量曲线。它不像Kafka消费延迟那样有明确的数字指标，也不像SQL语法错误那样能一眼定位到哪行代码；它更像一个沉默的警告：你正在运行的流处理作业，其核心保障——状态容错能力，已经失效。很多人第一反应是“重启试试”，但真正踩过坑的开发者会立刻意识到：这不是服务挂了，而是Flink最底层的状态快照一致性机制在发出求救信号。这个标题背后，藏着Flink区别于其他流处理引擎的根本能力：Exactly-Once语义的工程化落地。Checkpoint不是简单的“把内存里的数据存一下”，它是Flink在分布式、高并发、网络不可靠的生产环境中，为每一条事件流构建时间旅行能力的技术基石。当它失败，意味着你无法保证哪怕一次故障后，下游业务看到的数据和故障前完全一致——订单重复计费、库存超卖、风控规则漏判，这些真实业务风险，都始于这一行看似普通的日志。关键词虽未提供，但根据标题和行业实践，我们必须锚定三个核心维度：状态后端（State Backend）、检查点触发与对齐机制（Checkpoint Triggering & Alignment）、外部存储系统（External Storage System）。它们共同构成Flink checkpoint的“铁三角”。任何一环的微小偏差——比如RocksDB本地磁盘IO饱和、HDFS NameNode响应超时、或TaskManager内存配置不当——都会被这个机制敏锐捕捉，并以“failed”形式拒绝妥协。这不是Bug，而是Flink在用最严格的标准守护你的数据正确性。这篇文章不讲泛泛而谈的“检查点原理”，而是聚焦于真实生产环境里，从日志出现到问题根除的完整闭环。我会带你逐层拆解：如何从一行失败日志中精准提取关键线索？为什么同样的配置在测试环境稳如泰山，在生产集群却频频失败？那些被官方文档轻描淡写带过的参数，实际调优时究竟要动哪些“命脉”？以及，最重要的是——当所有常规手段失效时，那个被90%的教程忽略的、深藏在Flink内部状态机里的“逃生通道”，到底怎么走？如果你的作业正卡在checkpoint失败的泥潭里，这篇内容就是为你写的实操手册。2. 日志解析：从“Failed”二字里榨出500字有效信息Flink的checkpoint失败日志，绝非一句“Failed”就能概括。它是一份结构化的“事故现场报告”，关键信息就藏在日志的层级、时间戳、异常堆栈和上下文字段里。很多开发者习惯性地只看最后一行Caused by:，却错过了前面几行决定排查方向的黄金线索。下面，我们以一个典型的、来自某电商实时推荐系统的失败日志为例，逐行解剖：2024-06-15 02:17:23,882 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 12456 (type=CHECKPOINT) @ 1718417843882 for job 0a1b2c3d4e5f6789 (execution graph version 12455). 2024-06-15 02:17:24,105 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Starting checkpoint 12456. Pending checkpoints: [12456]. 2024-06-15 02:17:24,106 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 triggered for job 0a1b2c3d4e5f6789 at 1718417843882. 2024-06-15 02:17:24,107 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,108 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,109 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,110 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,111 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,112 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,113 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,114 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,115 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,116 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,117 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,118 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,119 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,120 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,121 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,122 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,123 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,124 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,125 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,126 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,127 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,128 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,129 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,130 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,131 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,132 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,133 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,134 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,135 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,136 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,137 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,138 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,139 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,140 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,141 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,142 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,143 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,144 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,145 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,146 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,147 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,148 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,149 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,150 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,151 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,152 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,153 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,154 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,155 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,156 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,157 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,158 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,159 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,160 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,161 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,162 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,163 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,164 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,165 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,166 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,167 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,168 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,169 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,170 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,171 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,172 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,173 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,174 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,175 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,176 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,177 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,178 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,179 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,180 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,181 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,182 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,183 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,184 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,185 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,186 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,187 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,188 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,189 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,190 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,191 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,192 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,193 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,194 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,195 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,196 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,197 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,198 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,199 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,200 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,201 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,202 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,203 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,204 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,205 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,206 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,207 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,208 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,209 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,210 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,211 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,212 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,213 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,214 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,215 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,216 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,217 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,218 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,219 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,220 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,221 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,222 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,223 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,224 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,225 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,226 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,227 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,228 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,229 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,230 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,231 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,232 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,233 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,234 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,235 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,236 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,237 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,238 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,239 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,240 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,241 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,242 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,243 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,244 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,245 INFO org.apache.flink.runtime.check
1. 这个报错不是“运气不好”，而是Flink状态一致性机制在敲门“Flink checkpoint failed”——这行日志在某次凌晨三点的告警群里炸开时，我正盯着监控面板上那条突然断崖式下跌的吞吐量曲线。它不像Kafka消费延迟那样有明确的数字指标，也不像SQL语法错误那样能一眼定位到哪行代码；它更像一个沉默的警告：你正在运行的流处理作业，其核心保障——状态容错能力，已经失效。很多人第一反应是“重启试试”，但真正踩过坑的开发者会立刻意识到：这不是服务挂了，而是Flink最底层的状态快照一致性机制在发出求救信号。这个标题背后，藏着Flink区别于其他流处理引擎的根本能力：Exactly-Once语义的工程化落地。Checkpoint不是简单的“把内存里的数据存一下”，它是Flink在分布式、高并发、网络不可靠的生产环境中，为每一条事件流构建时间旅行能力的技术基石。当它失败，意味着你无法保证哪怕一次故障后，下游业务看到的数据和故障前完全一致——订单重复计费、库存超卖、风控规则漏判，这些真实业务风险，都始于这一行看似普通的日志。关键词虽未提供，但根据标题和行业实践，我们必须锚定三个核心维度：状态后端（State Backend）、检查点触发与对齐机制（Checkpoint Triggering & Alignment）、外部存储系统（External Storage System）。它们共同构成Flink checkpoint的“铁三角”。任何一环的微小偏差——比如RocksDB本地磁盘IO饱和、HDFS NameNode响应超时、或TaskManager内存配置不当——都会被这个机制敏锐捕捉，并以“failed”形式拒绝妥协。这不是Bug，而是Flink在用最严格的标准守护你的数据正确性。这篇文章不讲泛泛而谈的“检查点原理”，而是聚焦于真实生产环境里，从日志出现到问题根除的完整闭环。我会带你逐层拆解：如何从一行失败日志中精准提取关键线索？为什么同样的配置在测试环境稳如泰山，在生产集群却频频失败？那些被官方文档轻描淡写带过的参数，实际调优时究竟要动哪些“命脉”？以及，最重要的是——当所有常规手段失效时，那个被90%的教程忽略的、深藏在Flink内部状态机里的“逃生通道”，到底怎么走？如果你的作业正卡在checkpoint失败的泥潭里，这篇内容就是为你写的实操手册。2. 日志解析：从“Failed”二字里榨出500字有效信息Flink的checkpoint失败日志，绝非一句“Failed”就能概括。它是一份结构化的“事故现场报告”，关键信息就藏在日志的层级、时间戳、异常堆栈和上下文字段里。很多开发者习惯性地只看最后一行Caused by:，却错过了前面几行决定排查方向的黄金线索。下面，我们以一个典型的、来自某电商实时推荐系统的失败日志为例，逐行解剖：2024-06-15 02:17:23,882 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 12456 (type=CHECKPOINT) @ 1718417843882 for job 0a1b2c3d4e5f6789 (execution graph version 12455). 2024-06-15 02:17:24,105 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Starting checkpoint 12456. Pending checkpoints: [12456]. 2024-06-15 02:17:24,106 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 triggered for job 0a1b2c3d4e5f6789 at 1718417843882. 2024-06-15 02:17:24,107 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,108 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,109 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,110 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,111 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,112 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,113 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,114 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,115 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,116 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,117 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,118 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,119 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,120 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,121 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,122 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,123 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,124 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,125 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,126 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,127 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,128 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,129 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,130 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,131 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,132 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,133 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,134 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,135 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,136 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,137 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,138 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,139 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,140 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,141 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,142 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,143 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,144 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,145 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,146 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,147 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,148 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,149 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,150 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,151 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,152 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,153 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,154 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,155 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,156 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,157 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,158 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,159 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,160 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,161 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,162 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,163 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,164 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,165 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,166 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,167 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,168 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,169 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,170 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,171 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,172 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,173 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,174 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,175 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,176 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,177 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,178 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,179 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,180 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,181 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,182 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,183 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,184 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,185 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,186 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,187 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,188 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,189 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,190 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,191 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,192 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,193 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,194 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,195 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,196 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,197 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,198 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,199 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,200 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,201 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,202 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,203 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,204 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,205 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,206 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,207 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,208 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,209 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,210 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,211 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,212 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,213 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,214 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,215 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,216 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,217 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,218 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,219 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,220 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,221 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,222 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,223 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,224 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,225 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,226 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,227 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,228 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,229 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,230 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,231 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,232 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,233 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,234 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,235 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,236 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,237 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,238 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,239 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,240 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,241 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,242 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,243 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,244 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Checkpoint 12456 is in state IN_PROGRESS. 2024-06-15 02:17:24,245 INFO org.apache.flink.runtime.check