Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.89866995s trace: https://jaeger.dev.storj.io/trace/29c19112d1fd5982 FAIL (2025-12-09 06:44:25 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.898699267s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......................X..........X.........X................] duration: 5.765585769s trace: https://jaeger.dev.storj.io/trace/678665e54230a74b FAIL (2025-12-09 06:44:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.765603714s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X......................X..............................] duration: 1.957981533s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:44:17 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.958096062s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 4.989094866s trace: https://jaeger.dev.storj.io/trace/488f36bcf1592ab1 FAIL (2025-12-09 06:44:12 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.989113411s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.764073542s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:44:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.764095276s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 2m46.150881071s trace: https://jaeger.dev.storj.io/trace/488f36bcf1592ab1 FAIL (2025-12-09 06:44:07 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2m46.15090142s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [........X................X...................X..............] duration: 3.577643535s trace: https://jaeger.dev.storj.io/trace/6cd8a6af8898f26d FAIL (2025-12-09 06:44:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.577672631s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [X......................X..........X.........X...............] duration: 5.62656032s trace: https://jaeger.dev.storj.io/trace/678665e54230a74b FAIL (2025-12-09 06:43:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.626582743s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.031884339s trace: https://jaeger.dev.storj.io/trace/29c19112d1fd5982 FAIL (2025-12-09 06:43:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.031914606s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 1.409871596s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:43:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.409901424s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.136741398s trace: https://jaeger.dev.storj.io/trace/29c19112d1fd5982 FAIL (2025-12-09 06:43:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 6.136815149s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 1.375521837s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:43:23 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.375547275s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X......................X.............................] duration: 2.013269032s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:43:22 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.013288038s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.........X................X...................X.............] duration: 3.567226666s trace: https://jaeger.dev.storj.io/trace/6cd8a6af8898f26d FAIL (2025-12-09 06:43:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.567248988s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.X......................X..........X.........X..............] duration: 5.853894216s trace: https://jaeger.dev.storj.io/trace/678665e54230a74b FAIL (2025-12-09 06:43:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.853957366s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.460457494s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:42:56 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.460494073s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.68230249s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:42:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.682333028s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..X......................X..........X.........X.............] duration: 5.868476364s trace: https://jaeger.dev.storj.io/trace/678665e54230a74b FAIL (2025-12-09 06:42:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.868507684s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..........X................X...................X............] duration: 3.560208031s trace: https://jaeger.dev.storj.io/trace/6cd8a6af8898f26d FAIL (2025-12-09 06:42:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.560236626s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 1.453773583s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:42:32 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.453804952s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.73922973s trace: https://jaeger.dev.storj.io/trace/29c19112d1fd5982 FAIL (2025-12-09 06:42:31 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.739274195s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X......................X............................] duration: 1.950464266s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:42:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.950543887s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...X......................X..........X.........X............] duration: 5.890497049s trace: https://jaeger.dev.storj.io/trace/678665e54230a74b FAIL (2025-12-09 06:42:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.890525936s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...........X................X...................X...........] duration: 3.40191056s trace: https://jaeger.dev.storj.io/trace/6cd8a6af8898f26d FAIL (2025-12-09 06:42:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.401939947s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.753230934s trace: https://jaeger.dev.storj.io/trace/29c19112d1fd5982 FAIL (2025-12-09 06:42:03 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.75326603s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 1.395819466s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:42:00 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.395849353s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.706789793s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:41:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.706822687s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 1.446864786s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:41:39 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.446892739s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [....X......................X..........X.........X...........] duration: 5.731474471s trace: https://jaeger.dev.storj.io/trace/678665e54230a74b FAIL (2025-12-09 06:41:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.731504949s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [............X................X...................X..........] duration: 3.487728576s trace: https://jaeger.dev.storj.io/trace/6cd8a6af8898f26d FAIL (2025-12-09 06:41:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.487750858s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.....X......................X..........X.........X..........] duration: 5.917227608s trace: https://jaeger.dev.storj.io/trace/678665e54230a74b FAIL (2025-12-09 06:41:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.917255773s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X......................X...........................] duration: 1.951360917s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:41:19 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.951390573s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.77912125s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:41:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.779152079s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X......................X..........................] duration: 1.980817936s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:40:51 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.980850588s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.951385479s trace: https://jaeger.dev.storj.io/trace/29c19112d1fd5982 FAIL (2025-12-09 06:40:49 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.951414365s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.679209539s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:40:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.679238084s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [.............X................X...................X.........] duration: 3.397755629s trace: https://jaeger.dev.storj.io/trace/6cd8a6af8898f26d FAIL (2025-12-09 06:40:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.397785085s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.417955117s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:40:28 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.418000303s core uplink eu1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [X.....X......................X..........X.........X.........] duration: 5.850521183s trace: https://jaeger.dev.storj.io/trace/678665e54230a74b FAIL (2025-12-09 06:40:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.850553155s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X......................X.........................] duration: 2.019525153s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:40:21 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.019555913s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.701927329s trace: https://jaeger.dev.storj.io/trace/29c19112d1fd5982 FAIL (2025-12-09 06:40:13 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.701959562s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [..............X................X...................X........] duration: 3.49910629s trace: https://jaeger.dev.storj.io/trace/6cd8a6af8898f26d FAIL (2025-12-09 06:40:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.499154602s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X......................X........................] duration: 1.954567702s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:40:02 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.954597118s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.X.....X......................X..........X.........X........] duration: 5.787918518s trace: https://jaeger.dev.storj.io/trace/678665e54230a74b FAIL (2025-12-09 06:39:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.787977119s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.630032411s trace: https://jaeger.dev.storj.io/trace/6a76cc4dec98d162 FAIL (2025-12-09 06:39:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 9 06:25:23.469204493 (86h56m23.340287538s) [upload=75907]: Starting upload Dec 9 06:25:23.469275578 (86h56m23.340358623s) [upload=75907]: Done starting upload Dec 9 06:25:23.469476681 (86h56m23.340559716s) [upload=75907]: Uploading segments... Dec 9 06:25:23.469590518 (86h56m23.340673563s) [upload=75907]: Got next segment. Inline: false Dec 9 06:25:23.469654340 (86h56m23.340737385s) [upload=75907]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 9 06:25:23.469661263 (86h56m23.340744298s) [upload=75907]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 9 06:25:23.720931063 (86h56m23.592014109s) [seg_pos={0 0}, upload=75907]: Begin upload segment... Dec 9 06:25:23.721042075 (86h56m23.59212512s) [seg_pos={0 0}, upload=75907]: Done begin upload segment. Dec 9 06:25:23.721074316 (86h56m23.592157361s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721325344 (86h56m23.592408399s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.721965964 (86h56m23.593049019s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722389791 (86h56m23.593472866s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.722829147 (86h56m23.593912192s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723241933 (86h56m23.594324978s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.723674007 (86h56m23.594757042s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.724099817 (86h56m23.595182862s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.726753881 (86h56m23.597836926s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.728534733 (86h56m23.599617778s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.732887922 (86h56m23.603970967s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.734759606 (86h56m23.605842651s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.736023332 (86h56m23.607106377s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.737582792 (86h56m23.608665837s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.738211790 (86h56m23.609294835s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:23.739723208 (86h56m23.610806253s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Uploading piece... Dec 9 06:25:24.790601693 (86h56m24.661684728s) [noise=true , address=77.90.31.15:4698 , piece_id=FGC5V3I3WE62I6TDQA3QMOEZOUCAROKM6TZPRA6PHV4GWGV5TSCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: storage node overloaded, request limit: 2000 Dec 9 06:25:25.333036304 (86h56m25.204119339s) [upload=75907]: Next returned nil segment Dec 9 06:25:25.333049930 (86h56m25.204132975s) [upload=75907]: Waiting for error group managing segments... Dec 9 06:25:25.714287308 (86h56m25.585370353s) [noise=true , address=145.79.227.13:4803 , piece_id=ZIPUJXDKR4GRT66LO5434WE6IKQF4OIIWAF7Y43OZNPA6AQAABBQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.722863118 (86h56m25.593946164s) [noise=true , address=145.79.227.42:4122 , piece_id=LHPOQSDTRIG2GIYKTBGNEEUA2KOOF3SWPH2EGFXNPWDRYPGEBG3A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.726641674 (86h56m25.597724719s) [noise=true , address=145.79.227.39:4015 , piece_id=6PCE2OJNRRG4GWUBXTDN445GV422X56VWP7G32BN3WNDODZIBTYQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.728719821 (86h56m25.599802866s) [noise=true , address=145.79.227.42:4121 , piece_id=KMN6X2IG5IJI6JPD7XEH6KCAIT7NZVE2DROBYBELRD3XORW4YUWA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737189449 (86h56m25.608272494s) [noise=true , address=145.79.227.27:4690 , piece_id=4ZNB4K46CDHG22KJ7DJG6KDOP4YFYOKPR6WGBVJ5WQDJSUCKFQNA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.737613757 (86h56m25.608696802s) [noise=true , address=145.79.227.21:4475 , piece_id=4YGI2ZBVDH3FFVSLC7RYJNY4S3QQKFFPIHK4RXLCSFIY2ZDBZHSA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.739188736 (86h56m25.610271781s) [noise=true , address=145.79.227.28:4725 , piece_id=72Z5O3XEMDUQLWX5PVWVUMOQU5ZGGNEBAV3N3AI2FBS5TMA3H66A, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.740480416 (86h56m25.611563461s) [noise=true , address=145.79.227.31:4798 , piece_id=FHZVRH3VARVTBIGJDMJE3BO5MPLDL4UT3IH4QJ3CJ22UJJXCICCQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743482112 (86h56m25.614565157s) [noise=true , address=145.79.227.14:4837 , piece_id=T7LM3LTVGE5S3XEXP5FTBAESZUE7KZFSWRQMMG7AUUGGLPTU4TKQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.743717891 (86h56m25.614800927s) [noise=true , address=145.79.227.34:4906 , piece_id=MDOC6ZO64BZTAS4JGJSBPXFJ5HWTAV4HNQO2RI6344GLVMD63TUQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.761675145 (86h56m25.63275819s) [noise=true , address=145.79.227.34:4905 , piece_id=DFOWKICXU77ODJMAIHCK4PE47YDISNZSQTW6JDKWISFXUAQUV37Q, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:25.916356020 (86h56m25.787439075s) [noise=true , address=77.90.31.10:4517 , piece_id=UFO23FVYC4QQKXSSY4C6YUIE6Q2Z4BOXJBJXAOCDU4W2SFBKF5DA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: <nil> Dec 9 06:25:52.777304158 (86h56m52.648387203s) [noise=true , address=145.79.227.33:4870 , piece_id=JJIGEEINDYECBVLFZXB3P4UIU4GDMJDLUZJDDONOJPWMV2JFZQOQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:12sDH7ccMQhjePqpbTkkxMAtumNLxpMHiT56cnfaYrUTFYxuPVt, address:145.79.227.33:4870): protocol: read tcp 188.166.225.170:40960->145.79.227.33:4870: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777648945 (86h56m52.64873199s) [noise=true , address=145.79.227.41:4085 , piece_id=EPM6DM3PDD46YMN5SIOHLCBWXGVE5SRA3X4JSR3ERNYRUIMN4KFQ, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:17x7QtnZsENMZPU3tqkh8jEd29JdowLvT855W4kuourgUA6y5C, address:145.79.227.41:4085): protocol: read tcp 188.166.225.170:57632->145.79.227.41:4085: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777892609 (86h56m52.648975644s) [noise=true , address=145.79.227.8:4329 , piece_id=UHCAKIHKILQ5X2ZFOV2WT3LWTLWRLL5PF65GUMYPIVUHTRHKHUVA, seg_pos={0 0}, upload=75907]: Done uploading piece. err: ecclient: upload failed (node:124ht9BFK3Y12gKG8i1Szefj4jkP71hgXZ5XLT4schym7GX5ycW, address:145.79.227.8:4329): protocol: read tcp 188.166.225.170:59796->145.79.227.8:4329: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Dec 9 06:25:52.777919761 (86h56m52.649002806s) [seg_pos={0 0}, upload=75907]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 9 06:25:53.016069287 (86h56m52.887152322s) [upload=75907]: Done uploading segments... Dec 9 06:25:53.016115405 (86h56m52.88719845s) [upload=75907]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.630069932s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 3 out of 60 is failed (threshold=6) [...............X................X...................X.......] duration: 3.425097793s trace: https://jaeger.dev.storj.io/trace/6cd8a6af8898f26d FAIL (2025-12-09 06:39:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.42512814s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 1.426868751s trace: https://jaeger.dev.storj.io/trace/66b2ccb4b553cce8 FAIL (2025-12-09 06:39:20 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 1.426899029s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X......................X.......................] duration: 2.010698112s trace: https://jaeger.dev.storj.io/trace/61580621ad164dbd FAIL (2025-12-09 06:39:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 2.010728179s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.666454658s trace: https://jaeger.dev.storj.io/trace/29c19112d1fd5982 FAIL (2025-12-09 06:39:08 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.666488322s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [..X.....X......................X..........X.........X.......] duration: 6.009295834s trace: https://jaeger.dev.storj.io/trace/678665e54230a74b FAIL (2025-12-09 06:38:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.009322996s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)