Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 15 out of 60 is failed (threshold=3) [...X...XX.X....X..X.X.X.XX......X......X...........XX.X.....] duration: 27.085595966s trace: https://jaeger.dev.storj.io/trace/177321d52ea57ae3 FAIL (2026-01-09 14:51:41 UTC) orbiter warning: context deadline exceeded Duration: 27.085611235s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 8.892350876s trace: https://jaeger.dev.storj.io/trace/5c8004bde8546ffa FAIL (2026-01-09 14:51:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 8.892378519s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 47 out of 60 is failed (threshold=3) [XXXXX.XXXXX.XXXX...X.XXX.XXXXXX.XXXXXXXX.XX.XXXXXXXXX.XXX..X] duration: 30.000927199s trace: https://jaeger.dev.storj.io/trace/31373db6bebfa3c FAIL (2026-01-09 14:51:26 UTC) orbiter warning: context deadline exceeded Duration: 30.000968739s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001873953s trace: https://jaeger.dev.storj.io/trace/62e485515dd6bfd4 FAIL (2026-01-09 14:51:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001921012s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 15 out of 60 is failed (threshold=3) [....X...XX.X....X..X.X.X.XX......X......X...........XX.X....] duration: 49.487465042s trace: https://jaeger.dev.storj.io/trace/177321d52ea57ae3 FAIL (2026-01-09 14:51:13 UTC) orbiter warning: context deadline exceeded Duration: 49.487492144s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 7.776631489s trace: https://jaeger.dev.storj.io/trace/5c8004bde8546ffa FAIL (2026-01-09 14:51:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.776658581s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 47 out of 60 is failed (threshold=3) [XXXXXX.XXXXX.XXXX...X.XXX.XXXXXX.XXXXXXXX.XX.XXXXXXXXX.XXX..] duration: 28.032663174s trace: https://jaeger.dev.storj.io/trace/2892ee520c321d99 FAIL (2026-01-09 14:50:54 UTC) orbiter warning: context deadline exceeded Duration: 28.032683021s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.930023264s trace: https://jaeger.dev.storj.io/trace/a75b88dbc4fd94e FAIL (2026-01-09 14:50:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, Piece ID: J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ) context deadline exceeded; piecestore: (Node ID: 12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, Piece ID: FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: 373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA) context deadline exceeded; piecestore: (Node ID: 16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, Piece ID: NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ) context deadline exceeded ======LOGS====== Jan 9 14:34:29.352561709 (839h5m29.223644744s) [upload=733959]: Starting upload Jan 9 14:34:29.352630921 (839h5m29.223713956s) [upload=733959]: Done starting upload Jan 9 14:34:29.352756570 (839h5m29.223839616s) [upload=733959]: Uploading segments... Jan 9 14:34:29.352865598 (839h5m29.223948643s) [upload=733959]: Got next segment. Inline: false Jan 9 14:34:29.352903270 (839h5m29.223986315s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 9 14:34:29.352907828 (839h5m29.223990863s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 9 14:34:29.599774521 (839h5m29.470857556s) [seg_pos={0 0}, upload=733959]: Begin upload segment... Jan 9 14:34:29.599817554 (839h5m29.470900589s) [seg_pos={0 0}, upload=733959]: Done begin upload segment. Jan 9 14:34:29.599844224 (839h5m29.470927259s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.599906102 (839h5m29.470989147s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.600730652 (839h5m29.471813688s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601078745 (839h5m29.47216179s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601406779 (839h5m29.472489825s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601723883 (839h5m29.472806918s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602076596 (839h5m29.473159641s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602400803 (839h5m29.473483838s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.603946956 (839h5m29.475029992s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.604094298 (839h5m29.475177343s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.606012120 (839h5m29.477095165s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.607630691 (839h5m29.478713726s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.608969500 (839h5m29.480052535s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.610181799 (839h5m29.481264834s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611434344 (839h5m29.482517379s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611719196 (839h5m29.482802241s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:31.439631348 (839h5m31.310714383s) [upload=733959]: Next returned nil segment Jan 9 14:34:31.439647950 (839h5m31.310730986s) [upload=733959]: Waiting for error group managing segments... Jan 9 14:34:31.743740138 (839h5m31.614823173s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.822459018 (839h5m31.693542053s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.841653115 (839h5m31.712736151s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.842127229 (839h5m31.713210264s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.854665382 (839h5m31.725748417s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.859312432 (839h5m31.730395467s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.860795285 (839h5m31.73187832s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.925596614 (839h5m31.796679649s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.981361566 (839h5m31.852444601s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.060172001 (839h5m31.931255046s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.068726830 (839h5m31.939809865s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.148546557 (839h5m32.019629592s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174302359 (839h5m32.045385394s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174349318 (839h5m32.045432363s) [seg_pos={0 0}, upload=733959]: Segment reached optimal threshold of 13 pieces. Jan 9 14:34:32.174517268 (839h5m32.045600303s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174523881 (839h5m32.045606916s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174627959 (839h5m32.045710994s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection Jan 9 14:34:32.174647096 (839h5m32.045730141s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174682192 (839h5m32.045765228s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174690819 (839h5m32.045773854s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174707520 (839h5m32.045790555s) [seg_pos={0 0}, upload=733959]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 9 14:34:32.174875750 (839h5m32.045958786s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 14:34:32.174882102 (839h5m32.045965137s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 14:34:32.470465289 (839h5m32.341548334s) [upload=733959]: Done uploading segments... Jan 9 14:34:32.470495607 (839h5m32.341578652s) [upload=733959]: Upload finished. err: <nil> Duration: 5.930051457s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 9.513621364s trace: https://jaeger.dev.storj.io/trace/5c8004bde8546ffa FAIL (2026-01-09 14:50:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.513647012s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001016029s trace: https://jaeger.dev.storj.io/trace/686539a8ca7db52f FAIL (2026-01-09 14:50:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001040846s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.817725835s trace: https://jaeger.dev.storj.io/trace/a75b88dbc4fd94e FAIL (2026-01-09 14:50:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, Piece ID: J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ) context deadline exceeded; piecestore: (Node ID: 12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, Piece ID: FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: 373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA) context deadline exceeded; piecestore: (Node ID: 16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, Piece ID: NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ) context deadline exceeded ======LOGS====== Jan 9 14:34:29.352561709 (839h5m29.223644744s) [upload=733959]: Starting upload Jan 9 14:34:29.352630921 (839h5m29.223713956s) [upload=733959]: Done starting upload Jan 9 14:34:29.352756570 (839h5m29.223839616s) [upload=733959]: Uploading segments... Jan 9 14:34:29.352865598 (839h5m29.223948643s) [upload=733959]: Got next segment. Inline: false Jan 9 14:34:29.352903270 (839h5m29.223986315s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 9 14:34:29.352907828 (839h5m29.223990863s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 9 14:34:29.599774521 (839h5m29.470857556s) [seg_pos={0 0}, upload=733959]: Begin upload segment... Jan 9 14:34:29.599817554 (839h5m29.470900589s) [seg_pos={0 0}, upload=733959]: Done begin upload segment. Jan 9 14:34:29.599844224 (839h5m29.470927259s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.599906102 (839h5m29.470989147s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.600730652 (839h5m29.471813688s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601078745 (839h5m29.47216179s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601406779 (839h5m29.472489825s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601723883 (839h5m29.472806918s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602076596 (839h5m29.473159641s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602400803 (839h5m29.473483838s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.603946956 (839h5m29.475029992s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.604094298 (839h5m29.475177343s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.606012120 (839h5m29.477095165s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.607630691 (839h5m29.478713726s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.608969500 (839h5m29.480052535s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.610181799 (839h5m29.481264834s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611434344 (839h5m29.482517379s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611719196 (839h5m29.482802241s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:31.439631348 (839h5m31.310714383s) [upload=733959]: Next returned nil segment Jan 9 14:34:31.439647950 (839h5m31.310730986s) [upload=733959]: Waiting for error group managing segments... Jan 9 14:34:31.743740138 (839h5m31.614823173s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.822459018 (839h5m31.693542053s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.841653115 (839h5m31.712736151s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.842127229 (839h5m31.713210264s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.854665382 (839h5m31.725748417s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.859312432 (839h5m31.730395467s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.860795285 (839h5m31.73187832s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.925596614 (839h5m31.796679649s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.981361566 (839h5m31.852444601s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.060172001 (839h5m31.931255046s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.068726830 (839h5m31.939809865s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.148546557 (839h5m32.019629592s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174302359 (839h5m32.045385394s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174349318 (839h5m32.045432363s) [seg_pos={0 0}, upload=733959]: Segment reached optimal threshold of 13 pieces. Jan 9 14:34:32.174517268 (839h5m32.045600303s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174523881 (839h5m32.045606916s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174627959 (839h5m32.045710994s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection Jan 9 14:34:32.174647096 (839h5m32.045730141s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174682192 (839h5m32.045765228s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174690819 (839h5m32.045773854s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174707520 (839h5m32.045790555s) [seg_pos={0 0}, upload=733959]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 9 14:34:32.174875750 (839h5m32.045958786s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 14:34:32.174882102 (839h5m32.045965137s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 14:34:32.470465289 (839h5m32.341548334s) [upload=733959]: Done uploading segments... Jan 9 14:34:32.470495607 (839h5m32.341578652s) [upload=733959]: Upload finished. err: <nil> Duration: 5.817749921s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 15 out of 60 is failed (threshold=3) [.....X...XX.X....X..X.X.X.XX......X......X...........XX.X...] duration: 37.748708439s trace: https://jaeger.dev.storj.io/trace/177321d52ea57ae3 FAIL (2026-01-09 14:50:15 UTC) orbiter warning: context deadline exceeded Duration: 37.74872999s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001294661s trace: https://jaeger.dev.storj.io/trace/56a60a1d82c1c913 FAIL (2026-01-09 14:50:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001322182s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 16.732871293s trace: https://jaeger.dev.storj.io/trace/5c8004bde8546ffa FAIL (2026-01-09 14:49:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 16.732887964s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 48 out of 60 is failed (threshold=3) [XXXXXXX.XXXXX.XXXX...X.XXX.XXXXXX.XXXXXXXX.XX.XXXXXXXXX.XXX.] duration: 30.000744776s trace: https://jaeger.dev.storj.io/trace/2892ee520c321d99 FAIL (2026-01-09 14:49:43 UTC) orbiter warning: context deadline exceeded Duration: 30.000771917s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.907942046s trace: https://jaeger.dev.storj.io/trace/a75b88dbc4fd94e FAIL (2026-01-09 14:49:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, Piece ID: J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ) context deadline exceeded; piecestore: (Node ID: 12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, Piece ID: FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: 373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA) context deadline exceeded; piecestore: (Node ID: 16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, Piece ID: NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ) context deadline exceeded ======LOGS====== Jan 9 14:34:29.352561709 (839h5m29.223644744s) [upload=733959]: Starting upload Jan 9 14:34:29.352630921 (839h5m29.223713956s) [upload=733959]: Done starting upload Jan 9 14:34:29.352756570 (839h5m29.223839616s) [upload=733959]: Uploading segments... Jan 9 14:34:29.352865598 (839h5m29.223948643s) [upload=733959]: Got next segment. Inline: false Jan 9 14:34:29.352903270 (839h5m29.223986315s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 9 14:34:29.352907828 (839h5m29.223990863s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 9 14:34:29.599774521 (839h5m29.470857556s) [seg_pos={0 0}, upload=733959]: Begin upload segment... Jan 9 14:34:29.599817554 (839h5m29.470900589s) [seg_pos={0 0}, upload=733959]: Done begin upload segment. Jan 9 14:34:29.599844224 (839h5m29.470927259s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.599906102 (839h5m29.470989147s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.600730652 (839h5m29.471813688s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601078745 (839h5m29.47216179s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601406779 (839h5m29.472489825s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601723883 (839h5m29.472806918s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602076596 (839h5m29.473159641s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602400803 (839h5m29.473483838s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.603946956 (839h5m29.475029992s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.604094298 (839h5m29.475177343s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.606012120 (839h5m29.477095165s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.607630691 (839h5m29.478713726s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.608969500 (839h5m29.480052535s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.610181799 (839h5m29.481264834s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611434344 (839h5m29.482517379s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611719196 (839h5m29.482802241s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:31.439631348 (839h5m31.310714383s) [upload=733959]: Next returned nil segment Jan 9 14:34:31.439647950 (839h5m31.310730986s) [upload=733959]: Waiting for error group managing segments... Jan 9 14:34:31.743740138 (839h5m31.614823173s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.822459018 (839h5m31.693542053s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.841653115 (839h5m31.712736151s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.842127229 (839h5m31.713210264s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.854665382 (839h5m31.725748417s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.859312432 (839h5m31.730395467s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.860795285 (839h5m31.73187832s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.925596614 (839h5m31.796679649s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.981361566 (839h5m31.852444601s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.060172001 (839h5m31.931255046s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.068726830 (839h5m31.939809865s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.148546557 (839h5m32.019629592s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174302359 (839h5m32.045385394s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174349318 (839h5m32.045432363s) [seg_pos={0 0}, upload=733959]: Segment reached optimal threshold of 13 pieces. Jan 9 14:34:32.174517268 (839h5m32.045600303s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174523881 (839h5m32.045606916s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174627959 (839h5m32.045710994s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection Jan 9 14:34:32.174647096 (839h5m32.045730141s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174682192 (839h5m32.045765228s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174690819 (839h5m32.045773854s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174707520 (839h5m32.045790555s) [seg_pos={0 0}, upload=733959]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 9 14:34:32.174875750 (839h5m32.045958786s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 14:34:32.174882102 (839h5m32.045965137s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 14:34:32.470465289 (839h5m32.341548334s) [upload=733959]: Done uploading segments... Jan 9 14:34:32.470495607 (839h5m32.341578652s) [upload=733959]: Upload finished. err: <nil> Duration: 5.907968506s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 15 out of 60 is failed (threshold=3) [......X...XX.X....X..X.X.X.XX......X......X...........XX.X..] duration: 44.07107691s trace: https://jaeger.dev.storj.io/trace/177321d52ea57ae3 FAIL (2026-01-09 14:49:11 UTC) orbiter warning: context deadline exceeded Duration: 44.07109261s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.224865026s trace: https://jaeger.dev.storj.io/trace/a75b88dbc4fd94e FAIL (2026-01-09 14:49:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, Piece ID: J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ) context deadline exceeded; piecestore: (Node ID: 12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, Piece ID: FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: 373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA) context deadline exceeded; piecestore: (Node ID: 16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, Piece ID: NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ) context deadline exceeded ======LOGS====== Jan 9 14:34:29.352561709 (839h5m29.223644744s) [upload=733959]: Starting upload Jan 9 14:34:29.352630921 (839h5m29.223713956s) [upload=733959]: Done starting upload Jan 9 14:34:29.352756570 (839h5m29.223839616s) [upload=733959]: Uploading segments... Jan 9 14:34:29.352865598 (839h5m29.223948643s) [upload=733959]: Got next segment. Inline: false Jan 9 14:34:29.352903270 (839h5m29.223986315s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 9 14:34:29.352907828 (839h5m29.223990863s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 9 14:34:29.599774521 (839h5m29.470857556s) [seg_pos={0 0}, upload=733959]: Begin upload segment... Jan 9 14:34:29.599817554 (839h5m29.470900589s) [seg_pos={0 0}, upload=733959]: Done begin upload segment. Jan 9 14:34:29.599844224 (839h5m29.470927259s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.599906102 (839h5m29.470989147s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.600730652 (839h5m29.471813688s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601078745 (839h5m29.47216179s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601406779 (839h5m29.472489825s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601723883 (839h5m29.472806918s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602076596 (839h5m29.473159641s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602400803 (839h5m29.473483838s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.603946956 (839h5m29.475029992s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.604094298 (839h5m29.475177343s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.606012120 (839h5m29.477095165s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.607630691 (839h5m29.478713726s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.608969500 (839h5m29.480052535s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.610181799 (839h5m29.481264834s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611434344 (839h5m29.482517379s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611719196 (839h5m29.482802241s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:31.439631348 (839h5m31.310714383s) [upload=733959]: Next returned nil segment Jan 9 14:34:31.439647950 (839h5m31.310730986s) [upload=733959]: Waiting for error group managing segments... Jan 9 14:34:31.743740138 (839h5m31.614823173s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.822459018 (839h5m31.693542053s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.841653115 (839h5m31.712736151s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.842127229 (839h5m31.713210264s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.854665382 (839h5m31.725748417s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.859312432 (839h5m31.730395467s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.860795285 (839h5m31.73187832s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.925596614 (839h5m31.796679649s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.981361566 (839h5m31.852444601s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.060172001 (839h5m31.931255046s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.068726830 (839h5m31.939809865s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.148546557 (839h5m32.019629592s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174302359 (839h5m32.045385394s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174349318 (839h5m32.045432363s) [seg_pos={0 0}, upload=733959]: Segment reached optimal threshold of 13 pieces. Jan 9 14:34:32.174517268 (839h5m32.045600303s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174523881 (839h5m32.045606916s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174627959 (839h5m32.045710994s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection Jan 9 14:34:32.174647096 (839h5m32.045730141s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174682192 (839h5m32.045765228s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174690819 (839h5m32.045773854s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174707520 (839h5m32.045790555s) [seg_pos={0 0}, upload=733959]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 9 14:34:32.174875750 (839h5m32.045958786s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 14:34:32.174882102 (839h5m32.045965137s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 14:34:32.470465289 (839h5m32.341548334s) [upload=733959]: Done uploading segments... Jan 9 14:34:32.470495607 (839h5m32.341578652s) [upload=733959]: Upload finished. err: <nil> Duration: 6.224912336s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000775719s trace: https://jaeger.dev.storj.io/trace/2aa87eff0919952a FAIL (2026-01-09 14:49:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000787623s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 7.688840043s trace: https://jaeger.dev.storj.io/trace/5c8004bde8546ffa FAIL (2026-01-09 14:48:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.688899315s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 48 out of 60 is failed (threshold=3) [.XXXXXXX.XXXXX.XXXX...X.XXX.XXXXXX.XXXXXXXX.XX.XXXXXXXXX.XXX] duration: 30.00073618s trace: https://jaeger.dev.storj.io/trace/2892ee520c321d99 FAIL (2026-01-09 14:48:49 UTC) orbiter warning: context deadline exceeded Duration: 30.000758322s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 12.251253554s trace: https://jaeger.dev.storj.io/trace/5c8004bde8546ffa FAIL (2026-01-09 14:48:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 12.251279004s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001439987s trace: https://jaeger.dev.storj.io/trace/158eca74e0a2b1a6 FAIL (2026-01-09 14:48:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00146238s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 16 out of 60 is failed (threshold=3) [X......X...XX.X....X..X.X.X.XX......X......X...........XX.X.] duration: 28.849990253s trace: https://jaeger.dev.storj.io/trace/177321d52ea57ae3 FAIL (2026-01-09 14:48:26 UTC) orbiter warning: context deadline exceeded Duration: 28.850009078s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.914727909s trace: https://jaeger.dev.storj.io/trace/a75b88dbc4fd94e FAIL (2026-01-09 14:48:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, Piece ID: J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ) context deadline exceeded; piecestore: (Node ID: 12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, Piece ID: FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: 373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA) context deadline exceeded; piecestore: (Node ID: 16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, Piece ID: NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ) context deadline exceeded ======LOGS====== Jan 9 14:34:29.352561709 (839h5m29.223644744s) [upload=733959]: Starting upload Jan 9 14:34:29.352630921 (839h5m29.223713956s) [upload=733959]: Done starting upload Jan 9 14:34:29.352756570 (839h5m29.223839616s) [upload=733959]: Uploading segments... Jan 9 14:34:29.352865598 (839h5m29.223948643s) [upload=733959]: Got next segment. Inline: false Jan 9 14:34:29.352903270 (839h5m29.223986315s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 9 14:34:29.352907828 (839h5m29.223990863s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 9 14:34:29.599774521 (839h5m29.470857556s) [seg_pos={0 0}, upload=733959]: Begin upload segment... Jan 9 14:34:29.599817554 (839h5m29.470900589s) [seg_pos={0 0}, upload=733959]: Done begin upload segment. Jan 9 14:34:29.599844224 (839h5m29.470927259s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.599906102 (839h5m29.470989147s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.600730652 (839h5m29.471813688s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601078745 (839h5m29.47216179s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601406779 (839h5m29.472489825s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601723883 (839h5m29.472806918s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602076596 (839h5m29.473159641s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602400803 (839h5m29.473483838s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.603946956 (839h5m29.475029992s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.604094298 (839h5m29.475177343s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.606012120 (839h5m29.477095165s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.607630691 (839h5m29.478713726s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.608969500 (839h5m29.480052535s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.610181799 (839h5m29.481264834s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611434344 (839h5m29.482517379s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611719196 (839h5m29.482802241s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:31.439631348 (839h5m31.310714383s) [upload=733959]: Next returned nil segment Jan 9 14:34:31.439647950 (839h5m31.310730986s) [upload=733959]: Waiting for error group managing segments... Jan 9 14:34:31.743740138 (839h5m31.614823173s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.822459018 (839h5m31.693542053s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.841653115 (839h5m31.712736151s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.842127229 (839h5m31.713210264s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.854665382 (839h5m31.725748417s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.859312432 (839h5m31.730395467s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.860795285 (839h5m31.73187832s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.925596614 (839h5m31.796679649s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.981361566 (839h5m31.852444601s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.060172001 (839h5m31.931255046s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.068726830 (839h5m31.939809865s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.148546557 (839h5m32.019629592s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174302359 (839h5m32.045385394s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174349318 (839h5m32.045432363s) [seg_pos={0 0}, upload=733959]: Segment reached optimal threshold of 13 pieces. Jan 9 14:34:32.174517268 (839h5m32.045600303s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174523881 (839h5m32.045606916s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174627959 (839h5m32.045710994s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection Jan 9 14:34:32.174647096 (839h5m32.045730141s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174682192 (839h5m32.045765228s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174690819 (839h5m32.045773854s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174707520 (839h5m32.045790555s) [seg_pos={0 0}, upload=733959]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 9 14:34:32.174875750 (839h5m32.045958786s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 14:34:32.174882102 (839h5m32.045965137s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 14:34:32.470465289 (839h5m32.341548334s) [upload=733959]: Done uploading segments... Jan 9 14:34:32.470495607 (839h5m32.341578652s) [upload=733959]: Upload finished. err: <nil> Duration: 5.914755943s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 48 out of 60 is failed (threshold=3) [X.XXXXXXX.XXXXX.XXXX...X.XXX.XXXXXX.XXXXXXXX.XX.XXXXXXXXX.XX] duration: 30.001173809s trace: https://jaeger.dev.storj.io/trace/7181a6fb7600166a FAIL (2026-01-09 14:48:04 UTC) orbiter warning: context deadline exceeded Duration: 30.00119612s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 16 out of 60 is failed (threshold=3) [.X......X...XX.X....X..X.X.X.XX......X......X...........XX.X] duration: 1m0.001656493s trace: https://jaeger.dev.storj.io/trace/177321d52ea57ae3 FAIL (2026-01-09 14:47:57 UTC) orbiter warning: context deadline exceeded Duration: 1m0.001680078s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001014144s trace: https://jaeger.dev.storj.io/trace/2b2b8af3a5233e59 FAIL (2026-01-09 14:47:55 UTC) orbiter warning: context deadline exceeded Duration: 5.001032089s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 9.050580041s trace: https://jaeger.dev.storj.io/trace/5c8004bde8546ffa FAIL (2026-01-09 14:47:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.050609556s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.019473019s trace: https://jaeger.dev.storj.io/trace/a75b88dbc4fd94e FAIL (2026-01-09 14:47:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, Piece ID: J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ) context deadline exceeded; piecestore: (Node ID: 12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, Piece ID: FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: 373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA) context deadline exceeded; piecestore: (Node ID: 16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, Piece ID: NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ) context deadline exceeded ======LOGS====== Jan 9 14:34:29.352561709 (839h5m29.223644744s) [upload=733959]: Starting upload Jan 9 14:34:29.352630921 (839h5m29.223713956s) [upload=733959]: Done starting upload Jan 9 14:34:29.352756570 (839h5m29.223839616s) [upload=733959]: Uploading segments... Jan 9 14:34:29.352865598 (839h5m29.223948643s) [upload=733959]: Got next segment. Inline: false Jan 9 14:34:29.352903270 (839h5m29.223986315s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 9 14:34:29.352907828 (839h5m29.223990863s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 9 14:34:29.599774521 (839h5m29.470857556s) [seg_pos={0 0}, upload=733959]: Begin upload segment... Jan 9 14:34:29.599817554 (839h5m29.470900589s) [seg_pos={0 0}, upload=733959]: Done begin upload segment. Jan 9 14:34:29.599844224 (839h5m29.470927259s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.599906102 (839h5m29.470989147s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.600730652 (839h5m29.471813688s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601078745 (839h5m29.47216179s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601406779 (839h5m29.472489825s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601723883 (839h5m29.472806918s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602076596 (839h5m29.473159641s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602400803 (839h5m29.473483838s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.603946956 (839h5m29.475029992s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.604094298 (839h5m29.475177343s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.606012120 (839h5m29.477095165s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.607630691 (839h5m29.478713726s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.608969500 (839h5m29.480052535s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.610181799 (839h5m29.481264834s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611434344 (839h5m29.482517379s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611719196 (839h5m29.482802241s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:31.439631348 (839h5m31.310714383s) [upload=733959]: Next returned nil segment Jan 9 14:34:31.439647950 (839h5m31.310730986s) [upload=733959]: Waiting for error group managing segments... Jan 9 14:34:31.743740138 (839h5m31.614823173s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.822459018 (839h5m31.693542053s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.841653115 (839h5m31.712736151s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.842127229 (839h5m31.713210264s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.854665382 (839h5m31.725748417s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.859312432 (839h5m31.730395467s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.860795285 (839h5m31.73187832s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.925596614 (839h5m31.796679649s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.981361566 (839h5m31.852444601s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.060172001 (839h5m31.931255046s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.068726830 (839h5m31.939809865s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.148546557 (839h5m32.019629592s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174302359 (839h5m32.045385394s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174349318 (839h5m32.045432363s) [seg_pos={0 0}, upload=733959]: Segment reached optimal threshold of 13 pieces. Jan 9 14:34:32.174517268 (839h5m32.045600303s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174523881 (839h5m32.045606916s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174627959 (839h5m32.045710994s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection Jan 9 14:34:32.174647096 (839h5m32.045730141s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174682192 (839h5m32.045765228s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174690819 (839h5m32.045773854s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174707520 (839h5m32.045790555s) [seg_pos={0 0}, upload=733959]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 9 14:34:32.174875750 (839h5m32.045958786s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 14:34:32.174882102 (839h5m32.045965137s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 14:34:32.470465289 (839h5m32.341548334s) [upload=733959]: Done uploading segments... Jan 9 14:34:32.470495607 (839h5m32.341578652s) [upload=733959]: Upload finished. err: <nil> Duration: 6.019500371s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001353592s trace: https://jaeger.dev.storj.io/trace/48183f273a0b7864 FAIL (2026-01-09 14:47:24 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001375392s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 48 out of 60 is failed (threshold=3) [XX.XXXXXXX.XXXXX.XXXX...X.XXX.XXXXXX.XXXXXXXX.XX.XXXXXXXXX.X] duration: 30.001228885s trace: https://jaeger.dev.storj.io/trace/836d2ecb5cfde0a FAIL (2026-01-09 14:47:12 UTC) orbiter warning: context deadline exceeded Duration: 30.001247822s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.878442193s trace: https://jaeger.dev.storj.io/trace/a75b88dbc4fd94e FAIL (2026-01-09 14:47:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, Piece ID: J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ) context deadline exceeded; piecestore: (Node ID: 12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, Piece ID: FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: 373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA) context deadline exceeded; piecestore: (Node ID: 16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, Piece ID: NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ) context deadline exceeded ======LOGS====== Jan 9 14:34:29.352561709 (839h5m29.223644744s) [upload=733959]: Starting upload Jan 9 14:34:29.352630921 (839h5m29.223713956s) [upload=733959]: Done starting upload Jan 9 14:34:29.352756570 (839h5m29.223839616s) [upload=733959]: Uploading segments... Jan 9 14:34:29.352865598 (839h5m29.223948643s) [upload=733959]: Got next segment. Inline: false Jan 9 14:34:29.352903270 (839h5m29.223986315s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 9 14:34:29.352907828 (839h5m29.223990863s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 9 14:34:29.599774521 (839h5m29.470857556s) [seg_pos={0 0}, upload=733959]: Begin upload segment... Jan 9 14:34:29.599817554 (839h5m29.470900589s) [seg_pos={0 0}, upload=733959]: Done begin upload segment. Jan 9 14:34:29.599844224 (839h5m29.470927259s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.599906102 (839h5m29.470989147s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.600730652 (839h5m29.471813688s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601078745 (839h5m29.47216179s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601406779 (839h5m29.472489825s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601723883 (839h5m29.472806918s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602076596 (839h5m29.473159641s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602400803 (839h5m29.473483838s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.603946956 (839h5m29.475029992s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.604094298 (839h5m29.475177343s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.606012120 (839h5m29.477095165s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.607630691 (839h5m29.478713726s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.608969500 (839h5m29.480052535s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.610181799 (839h5m29.481264834s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611434344 (839h5m29.482517379s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611719196 (839h5m29.482802241s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:31.439631348 (839h5m31.310714383s) [upload=733959]: Next returned nil segment Jan 9 14:34:31.439647950 (839h5m31.310730986s) [upload=733959]: Waiting for error group managing segments... Jan 9 14:34:31.743740138 (839h5m31.614823173s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.822459018 (839h5m31.693542053s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.841653115 (839h5m31.712736151s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.842127229 (839h5m31.713210264s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.854665382 (839h5m31.725748417s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.859312432 (839h5m31.730395467s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.860795285 (839h5m31.73187832s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.925596614 (839h5m31.796679649s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.981361566 (839h5m31.852444601s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.060172001 (839h5m31.931255046s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.068726830 (839h5m31.939809865s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.148546557 (839h5m32.019629592s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174302359 (839h5m32.045385394s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174349318 (839h5m32.045432363s) [seg_pos={0 0}, upload=733959]: Segment reached optimal threshold of 13 pieces. Jan 9 14:34:32.174517268 (839h5m32.045600303s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174523881 (839h5m32.045606916s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174627959 (839h5m32.045710994s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection Jan 9 14:34:32.174647096 (839h5m32.045730141s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174682192 (839h5m32.045765228s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174690819 (839h5m32.045773854s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174707520 (839h5m32.045790555s) [seg_pos={0 0}, upload=733959]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 9 14:34:32.174875750 (839h5m32.045958786s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 14:34:32.174882102 (839h5m32.045965137s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 14:34:32.470465289 (839h5m32.341548334s) [upload=733959]: Done uploading segments... Jan 9 14:34:32.470495607 (839h5m32.341578652s) [upload=733959]: Upload finished. err: <nil> Duration: 5.878475897s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001261975s trace: https://jaeger.dev.storj.io/trace/5f008f12e67a53a7 FAIL (2026-01-09 14:46:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001283127s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 9.611138609s trace: https://jaeger.dev.storj.io/trace/5c8004bde8546ffa FAIL (2026-01-09 14:46:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.611165059s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 15 out of 60 is failed (threshold=3) [..X......X...XX.X....X..X.X.X.XX......X......X...........XX.] duration: 35.565184183s trace: https://jaeger.dev.storj.io/trace/485455d05d25a1c1 FAIL (2026-01-09 14:46:29 UTC) orbiter warning: context deadline exceeded Duration: 35.56519842s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 30.00033835s trace: https://jaeger.dev.storj.io/trace/5c8004bde8546ffa FAIL (2026-01-09 14:46:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000354149s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 47 out of 60 is failed (threshold=3) [.XX.XXXXXXX.XXXXX.XXXX...X.XXX.XXXXXX.XXXXXXXX.XX.XXXXXXXXX.] duration: 11.027183057s trace: https://jaeger.dev.storj.io/trace/36b40c0881127b6a FAIL (2026-01-09 14:46:16 UTC) orbiter warning: context deadline exceeded Duration: 11.027234205s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001110259s trace: https://jaeger.dev.storj.io/trace/307845741a801d9 FAIL (2026-01-09 14:45:54 UTC) orbiter warning: context deadline exceeded Duration: 5.001135419s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 15 out of 60 is failed (threshold=3) [...X......X...XX.X....X..X.X.X.XX......X......X...........XX] duration: 1m0.001111334s trace: https://jaeger.dev.storj.io/trace/485455d05d25a1c1 FAIL (2026-01-09 14:45:53 UTC) orbiter warning: context deadline exceeded Duration: 1m0.001133386s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.990236799s trace: https://jaeger.dev.storj.io/trace/a75b88dbc4fd94e FAIL (2026-01-09 14:45:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, Piece ID: J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ) context deadline exceeded; piecestore: (Node ID: 12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, Piece ID: FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: 373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA) context deadline exceeded; piecestore: (Node ID: 16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, Piece ID: NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ) context deadline exceeded ======LOGS====== Jan 9 14:34:29.352561709 (839h5m29.223644744s) [upload=733959]: Starting upload Jan 9 14:34:29.352630921 (839h5m29.223713956s) [upload=733959]: Done starting upload Jan 9 14:34:29.352756570 (839h5m29.223839616s) [upload=733959]: Uploading segments... Jan 9 14:34:29.352865598 (839h5m29.223948643s) [upload=733959]: Got next segment. Inline: false Jan 9 14:34:29.352903270 (839h5m29.223986315s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 9 14:34:29.352907828 (839h5m29.223990863s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 9 14:34:29.599774521 (839h5m29.470857556s) [seg_pos={0 0}, upload=733959]: Begin upload segment... Jan 9 14:34:29.599817554 (839h5m29.470900589s) [seg_pos={0 0}, upload=733959]: Done begin upload segment. Jan 9 14:34:29.599844224 (839h5m29.470927259s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.599906102 (839h5m29.470989147s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.600730652 (839h5m29.471813688s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601078745 (839h5m29.47216179s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601406779 (839h5m29.472489825s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601723883 (839h5m29.472806918s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602076596 (839h5m29.473159641s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602400803 (839h5m29.473483838s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.603946956 (839h5m29.475029992s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.604094298 (839h5m29.475177343s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.606012120 (839h5m29.477095165s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.607630691 (839h5m29.478713726s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.608969500 (839h5m29.480052535s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.610181799 (839h5m29.481264834s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611434344 (839h5m29.482517379s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611719196 (839h5m29.482802241s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:31.439631348 (839h5m31.310714383s) [upload=733959]: Next returned nil segment Jan 9 14:34:31.439647950 (839h5m31.310730986s) [upload=733959]: Waiting for error group managing segments... Jan 9 14:34:31.743740138 (839h5m31.614823173s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.822459018 (839h5m31.693542053s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.841653115 (839h5m31.712736151s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.842127229 (839h5m31.713210264s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.854665382 (839h5m31.725748417s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.859312432 (839h5m31.730395467s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.860795285 (839h5m31.73187832s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.925596614 (839h5m31.796679649s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.981361566 (839h5m31.852444601s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.060172001 (839h5m31.931255046s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.068726830 (839h5m31.939809865s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.148546557 (839h5m32.019629592s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174302359 (839h5m32.045385394s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174349318 (839h5m32.045432363s) [seg_pos={0 0}, upload=733959]: Segment reached optimal threshold of 13 pieces. Jan 9 14:34:32.174517268 (839h5m32.045600303s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174523881 (839h5m32.045606916s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174627959 (839h5m32.045710994s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection Jan 9 14:34:32.174647096 (839h5m32.045730141s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174682192 (839h5m32.045765228s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174690819 (839h5m32.045773854s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174707520 (839h5m32.045790555s) [seg_pos={0 0}, upload=733959]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 9 14:34:32.174875750 (839h5m32.045958786s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 14:34:32.174882102 (839h5m32.045965137s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 14:34:32.470465289 (839h5m32.341548334s) [upload=733959]: Done uploading segments... Jan 9 14:34:32.470495607 (839h5m32.341578652s) [upload=733959]: Upload finished. err: <nil> Duration: 5.990272516s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 10.444457495s trace: https://jaeger.dev.storj.io/trace/5c8004bde8546ffa FAIL (2026-01-09 14:45:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.44446992s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 25.339137629s trace: https://jaeger.dev.storj.io/trace/5c8004bde8546ffa FAIL (2026-01-09 14:45:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 25.339166813s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 48 out of 60 is failed (threshold=3) [X.XX.XXXXXXX.XXXXX.XXXX...X.XXX.XXXXXX.XXXXXXXX.XX.XXXXXXXXX] duration: 30.001705507s trace: https://jaeger.dev.storj.io/trace/36b40c0881127b6a FAIL (2026-01-09 14:45:23 UTC) orbiter warning: context deadline exceeded Duration: 30.00171724s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.9678801s trace: https://jaeger.dev.storj.io/trace/a75b88dbc4fd94e FAIL (2026-01-09 14:45:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, Piece ID: J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ) context deadline exceeded; piecestore: (Node ID: 12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, Piece ID: FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: 373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA) context deadline exceeded; piecestore: (Node ID: 16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, Piece ID: NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ) context deadline exceeded ======LOGS====== Jan 9 14:34:29.352561709 (839h5m29.223644744s) [upload=733959]: Starting upload Jan 9 14:34:29.352630921 (839h5m29.223713956s) [upload=733959]: Done starting upload Jan 9 14:34:29.352756570 (839h5m29.223839616s) [upload=733959]: Uploading segments... Jan 9 14:34:29.352865598 (839h5m29.223948643s) [upload=733959]: Got next segment. Inline: false Jan 9 14:34:29.352903270 (839h5m29.223986315s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 9 14:34:29.352907828 (839h5m29.223990863s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 9 14:34:29.599774521 (839h5m29.470857556s) [seg_pos={0 0}, upload=733959]: Begin upload segment... Jan 9 14:34:29.599817554 (839h5m29.470900589s) [seg_pos={0 0}, upload=733959]: Done begin upload segment. Jan 9 14:34:29.599844224 (839h5m29.470927259s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.599906102 (839h5m29.470989147s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.600730652 (839h5m29.471813688s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601078745 (839h5m29.47216179s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601406779 (839h5m29.472489825s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601723883 (839h5m29.472806918s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602076596 (839h5m29.473159641s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602400803 (839h5m29.473483838s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.603946956 (839h5m29.475029992s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.604094298 (839h5m29.475177343s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.606012120 (839h5m29.477095165s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.607630691 (839h5m29.478713726s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.608969500 (839h5m29.480052535s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.610181799 (839h5m29.481264834s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611434344 (839h5m29.482517379s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611719196 (839h5m29.482802241s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:31.439631348 (839h5m31.310714383s) [upload=733959]: Next returned nil segment Jan 9 14:34:31.439647950 (839h5m31.310730986s) [upload=733959]: Waiting for error group managing segments... Jan 9 14:34:31.743740138 (839h5m31.614823173s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.822459018 (839h5m31.693542053s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.841653115 (839h5m31.712736151s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.842127229 (839h5m31.713210264s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.854665382 (839h5m31.725748417s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.859312432 (839h5m31.730395467s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.860795285 (839h5m31.73187832s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.925596614 (839h5m31.796679649s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.981361566 (839h5m31.852444601s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.060172001 (839h5m31.931255046s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.068726830 (839h5m31.939809865s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.148546557 (839h5m32.019629592s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174302359 (839h5m32.045385394s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174349318 (839h5m32.045432363s) [seg_pos={0 0}, upload=733959]: Segment reached optimal threshold of 13 pieces. Jan 9 14:34:32.174517268 (839h5m32.045600303s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174523881 (839h5m32.045606916s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174627959 (839h5m32.045710994s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection Jan 9 14:34:32.174647096 (839h5m32.045730141s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174682192 (839h5m32.045765228s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174690819 (839h5m32.045773854s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174707520 (839h5m32.045790555s) [seg_pos={0 0}, upload=733959]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 9 14:34:32.174875750 (839h5m32.045958786s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 14:34:32.174882102 (839h5m32.045965137s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 14:34:32.470465289 (839h5m32.341548334s) [upload=733959]: Done uploading segments... Jan 9 14:34:32.470495607 (839h5m32.341578652s) [upload=733959]: Upload finished. err: <nil> Duration: 5.967905698s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000782921s trace: https://jaeger.dev.storj.io/trace/2e376eaa34654546 FAIL (2026-01-09 14:45:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000806707s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 47 out of 60 is failed (threshold=3) [.X.XX.XXXXXXX.XXXXX.XXXX...X.XXX.XXXXXX.XXXXXXXX.XX.XXXXXXXX] duration: 30.000772462s trace: https://jaeger.dev.storj.io/trace/3dc634367a289d39 FAIL (2026-01-09 14:44:53 UTC) orbiter warning: context deadline exceeded Duration: 30.000793943s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.096018381s trace: https://jaeger.dev.storj.io/trace/a75b88dbc4fd94e FAIL (2026-01-09 14:44:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: piecestore: (Node ID: 1nvvNczHtQrSEJuJbErnjiAWa4BRDzBrQmBNbB7RrrqN1JWNHT, Piece ID: J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ) context deadline exceeded; piecestore: (Node ID: 12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, Piece ID: FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ) context deadline exceeded; piecestore: (Node ID: 1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, Piece ID: 373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA) context deadline exceeded; piecestore: (Node ID: 16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, Piece ID: NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ) context deadline exceeded ======LOGS====== Jan 9 14:34:29.352561709 (839h5m29.223644744s) [upload=733959]: Starting upload Jan 9 14:34:29.352630921 (839h5m29.223713956s) [upload=733959]: Done starting upload Jan 9 14:34:29.352756570 (839h5m29.223839616s) [upload=733959]: Uploading segments... Jan 9 14:34:29.352865598 (839h5m29.223948643s) [upload=733959]: Got next segment. Inline: false Jan 9 14:34:29.352903270 (839h5m29.223986315s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 9 14:34:29.352907828 (839h5m29.223990863s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 9 14:34:29.599774521 (839h5m29.470857556s) [seg_pos={0 0}, upload=733959]: Begin upload segment... Jan 9 14:34:29.599817554 (839h5m29.470900589s) [seg_pos={0 0}, upload=733959]: Done begin upload segment. Jan 9 14:34:29.599844224 (839h5m29.470927259s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.599906102 (839h5m29.470989147s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.600730652 (839h5m29.471813688s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601078745 (839h5m29.47216179s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601406779 (839h5m29.472489825s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.601723883 (839h5m29.472806918s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602076596 (839h5m29.473159641s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.602400803 (839h5m29.473483838s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.603946956 (839h5m29.475029992s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.604094298 (839h5m29.475177343s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.606012120 (839h5m29.477095165s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.607630691 (839h5m29.478713726s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.608969500 (839h5m29.480052535s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.610181799 (839h5m29.481264834s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611434344 (839h5m29.482517379s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:29.611719196 (839h5m29.482802241s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Uploading piece... Jan 9 14:34:31.439631348 (839h5m31.310714383s) [upload=733959]: Next returned nil segment Jan 9 14:34:31.439647950 (839h5m31.310730986s) [upload=733959]: Waiting for error group managing segments... Jan 9 14:34:31.743740138 (839h5m31.614823173s) [noise=true , address=145.79.227.48:4303 , piece_id=IEUZWHRDKS2KMP3LC6AKJWQFP6XL4NVNOHSC4IBU2GRNSG76NZ5Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.822459018 (839h5m31.693542053s) [noise=true , address=145.79.227.43:4157 , piece_id=QQG3RNC6CVYAGLA6FJIFZXQZWBNDLQON6AED5YO2N2U53TKBTS4A, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.841653115 (839h5m31.712736151s) [noise=true , address=145.79.227.37:4565 , piece_id=J3SCNTE3HTTIETDMDK6NDSVYIAVTFCYKXJDY6GJBRDNXVK2ER5TQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.842127229 (839h5m31.713210264s) [noise=true , address=145.79.227.45:4231 , piece_id=UPHQU6XESHUEOUW7MTHEODG2MTS2SUTL4BONFDCGK2VCC3NN4VMA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.854665382 (839h5m31.725748417s) [noise=true , address=145.79.227.34:4906 , piece_id=E7CQDIFFZNWLW3IEU5A7DMDCT3ZREX6MVJHMABNYVMYFJ5MPUD7Q, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.859312432 (839h5m31.730395467s) [noise=true , address=45.91.116.5:4300 , piece_id=ODVRDTB5UI4JEAAEAGNKE4F73J225RH35VE4EM7JDJEJKYLUEHJQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.860795285 (839h5m31.73187832s) [noise=true , address=145.79.227.14:4837 , piece_id=MQC66KPKLTCG22BQ6PBDIYID5RQFTKJSKR37XM7BBY3YPBI5EGPA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.925596614 (839h5m31.796679649s) [noise=true , address=45.91.116.11:4118 , piece_id=2DKSL6L2SSDUXWEGASUXMKIKNGQZMYFOOTWFAAXMVO5GLYWD3EJA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:31.981361566 (839h5m31.852444601s) [noise=true , address=45.91.116.9:4262 , piece_id=FM6JWAF2WPTE7XN7XBMANAFT4YNCIPVYNJWOG2E5LCOKGNJPGJVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.060172001 (839h5m31.931255046s) [noise=true , address=77.90.31.13:4626 , piece_id=4T5LLKNIX5FELGMW4XAQLBKNPNX6WUF2P4EWV7UTOVAMEEB25NDA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.068726830 (839h5m31.939809865s) [noise=true , address=145.79.227.46:4602 , piece_id=45INIPHHYYT72OJ5WOW2TFAB2Q4L4Q3T6QZB5FITRBWJHOPWW2CQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.148546557 (839h5m32.019629592s) [noise=true , address=145.79.227.2:4113 , piece_id=373TF7XHZWQDR6PGVROOCGTYDUSHTZ4L2DJHMZS4NA3BZ37OFDAA, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174302359 (839h5m32.045385394s) [noise=true , address=145.79.227.4:4186 , piece_id=NXHBD2IYSRQEXGRNDEHMUTK5XIQ7CCYWHEW6WPCP2MUEKMZA6KVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: <nil> Jan 9 14:34:32.174349318 (839h5m32.045432363s) [seg_pos={0 0}, upload=733959]: Segment reached optimal threshold of 13 pieces. Jan 9 14:34:32.174517268 (839h5m32.045600303s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174523881 (839h5m32.045606916s) [noise=true , address=145.79.227.33:4870 , piece_id=PALRBZC7EUKJFX5UOVKX2UFO27PDA2PFLCY56NYMUL5OOOFLEZPQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174627959 (839h5m32.045710994s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12B518TvbbRhj6LiXxV4GwUgAoUYmWMWeTpyYerKnKuZYBjXoma): protocol: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34462->145.79.227.38:4979: use of closed network connection Jan 9 14:34:32.174647096 (839h5m32.045730141s) [noise=true , address=145.79.227.38:4979 , piece_id=33SALG3J6ZZWMCIQAJ6TU237KW3E5L2CZAFQWENMBM2JL34QFZRQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174682192 (839h5m32.045765228s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP): protocol: expected piece hash; context canceled; EOF Jan 9 14:34:32.174690819 (839h5m32.045773854s) [noise=true , address=145.79.227.15:4876 , piece_id=QUFOPPPDHHDIWLKPLMBADYLEQRWZIM4OQXUDOGXXPESTV7BJ5CVQ, seg_pos={0 0}, upload=733959]: Long tail cancellation due to optimal threshold Jan 9 14:34:32.174707520 (839h5m32.045790555s) [seg_pos={0 0}, upload=733959]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 9 14:34:32.174875750 (839h5m32.045958786s) [upload=733959]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 14:34:32.174882102 (839h5m32.045965137s) [upload=733959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 14:34:32.470465289 (839h5m32.341548334s) [upload=733959]: Done uploading segments... Jan 9 14:34:32.470495607 (839h5m32.341578652s) [upload=733959]: Upload finished. err: <nil> Duration: 6.096043728s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 14 out of 60 is failed (threshold=3) [....X......X...XX.X....X..X.X.X.XX......X......X...........X] duration: 1m0.00131225s trace: https://jaeger.dev.storj.io/trace/6afb7d70cf6eb385 FAIL (2026-01-09 14:44:46 UTC) orbiter warning: context deadline exceeded Duration: 1m0.001335032s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.427362415s trace: https://jaeger.dev.storj.io/trace/5c8004bde8546ffa FAIL (2026-01-09 14:44:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.427389616s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)