Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.766823015s trace: https://jaeger.dev.storj.io/trace/29c19112d1fd5982 FAIL (2025-12-09 06:34:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.766850888s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.797440294s trace: https://jaeger.dev.storj.io/trace/29c19112d1fd5982 FAIL (2025-12-09 06:34:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.797461153s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X......................X.................] duration: 1.94461042s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:34:16 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.944640966s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 15m10.477411593s trace: https://jaeger.dev.storj.io/trace/29c19112d1fd5982 FAIL (2025-12-09 06:34:10 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 15m10.477438083s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [......................X................X...................X] duration: 5.000721842s trace: https://jaeger.dev.storj.io/trace/6cd8a6af8898f26d FAIL (2025-12-09 06:34:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000750357s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.391959054s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:33:58 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.392024339s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.694683683s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:33:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.694710373s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [........X.....X......................X..........X.........X.] duration: 5.991709176s trace: https://jaeger.dev.storj.io/trace/678665e54230a74b FAIL (2025-12-09 06:33:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.99172741s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.........X.....X......................X..........X.........X] duration: 1m0.001007632s trace: https://jaeger.dev.storj.io/trace/678665e54230a74b FAIL (2025-12-09 06:33:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001130886s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.666935356s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:33:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.666960715s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X......................X................] duration: 2.011705093s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:33:32 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.011729089s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 1.366087159s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:33:08 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.366124631s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.......................X................X...................] duration: 3.44171324s trace: https://jaeger.dev.storj.io/trace/529a12c089e9f0a8 FAIL (2025-12-09 06:32:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.441739792s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.812842441s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:32:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.812895783s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X......................X...............] duration: 1.996467096s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:32:42 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.996498575s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.421782925s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:32:14 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.42194366s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [........................X................X..................] duration: 3.424218521s trace: https://jaeger.dev.storj.io/trace/529a12c089e9f0a8 FAIL (2025-12-09 06:32:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.424250173s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..........X.....X......................X..........X.........] duration: 5.991431712s trace: https://jaeger.dev.storj.io/trace/12ae6d2571419b82 FAIL (2025-12-09 06:32:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.991451068s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.626119025s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:31:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.626146058s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X......................X..............] duration: 1.970316617s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:31:41 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.970350161s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X......................X.............] duration: 1.975252427s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:31:23 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.97528013s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.69306653s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:31:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.693093541s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...........X.....X......................X..........X........] duration: 5.867444613s trace: https://jaeger.dev.storj.io/trace/12ae6d2571419b82 FAIL (2025-12-09 06:31:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.867509937s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.........................X................X.................] duration: 3.408128705s trace: https://jaeger.dev.storj.io/trace/529a12c089e9f0a8 FAIL (2025-12-09 06:31:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.408162711s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 1.380704773s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:31:00 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.380735661s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X......................X............] duration: 2.028165545s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:30:54 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.028191936s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [............X.....X......................X..........X.......] duration: 5.721843437s trace: https://jaeger.dev.storj.io/trace/12ae6d2571419b82 FAIL (2025-12-09 06:30:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.721875539s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.654945343s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:30:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.654976012s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 1.38171593s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:30:20 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.381749443s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [X.........................X................X................] duration: 3.504047477s trace: https://jaeger.dev.storj.io/trace/529a12c089e9f0a8 FAIL (2025-12-09 06:30:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.50407972s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X......................X...........] duration: 1.942218673s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:29:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.942248791s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.............X.....X......................X..........X......] duration: 5.571981949s trace: https://jaeger.dev.storj.io/trace/12ae6d2571419b82 FAIL (2025-12-09 06:29:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.5720138s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.612609793s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:29:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.612637356s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.439578471s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:29:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.439602907s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.663084407s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:29:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.663113743s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.X.........................X................X...............] duration: 3.518757694s trace: https://jaeger.dev.storj.io/trace/529a12c089e9f0a8 FAIL (2025-12-09 06:29:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.518789305s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..............X.....X......................X..........X.....] duration: 5.678545639s trace: https://jaeger.dev.storj.io/trace/12ae6d2571419b82 FAIL (2025-12-09 06:28:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.678573974s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X......................X..........] duration: 1.978873953s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:28:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.978947243s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..X.........................X................X..............] duration: 3.542597673s trace: https://jaeger.dev.storj.io/trace/529a12c089e9f0a8 FAIL (2025-12-09 06:28:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.542626467s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.434426541s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:28:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.434454975s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.653296142s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:28:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.653399638s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................X......................X.........] duration: 2.004811975s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:28:08 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.004844127s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...............X.....X......................X..........X....] duration: 5.68087451s trace: https://jaeger.dev.storj.io/trace/12ae6d2571419b82 FAIL (2025-12-09 06:28:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.680903045s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...X.........................X................X.............] duration: 3.446618082s trace: https://jaeger.dev.storj.io/trace/529a12c089e9f0a8 FAIL (2025-12-09 06:27:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.446645443s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [................X.....X......................X..........X...] duration: 5.983615005s trace: https://jaeger.dev.storj.io/trace/12ae6d2571419b82 FAIL (2025-12-09 06:27:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.983636557s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.379315026s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:27:14 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.379358971s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.683594294s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:27:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.683632486s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................X......................X........] duration: 2.015113622s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:26:57 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.015139921s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.7798745s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:26:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.779904166s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [....X.........................X................X............] duration: 3.532105s trace: https://jaeger.dev.storj.io/trace/529a12c089e9f0a8 FAIL (2025-12-09 06:26:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.532131199s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)