Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 48 out of 60 is failed (threshold=6) [XXX.X..XXXX.XX.XXXXXXXX.X.XXX.XX.XXXXXX.XXXXXXXXXXXXXX..XXXX] duration: 5.001172567s trace: https://jaeger.dev.storj.io/trace/37afdb48fbf733f0 FAIL (2026-01-12 14:46:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001189809s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 25 out of 60 is failed (threshold=3) [.XX.X.X...XX...XX..X.X..X.XXX.X.X..X..XXX.X..X..XXX.........] duration: 6.425022296s trace: https://jaeger.dev.storj.io/trace/52dabc253ed75695 FAIL (2026-01-12 14:46:45 UTC) orbiter warning: context deadline exceeded Duration: 6.425054075s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [X...X...X...X.............X..XXX..................X.........] duration: 21.881004972s trace: https://jaeger.dev.storj.io/trace/69f69cf14c8b272c FAIL (2026-01-12 14:46:29 UTC) orbiter warning: context deadline exceeded Duration: 21.881029128s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.790951176s trace: https://jaeger.dev.storj.io/trace/62457ac9390c0b68 FAIL (2026-01-12 14:46:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 12 14:10:16.214443221 (910h41m16.085526256s) [upload=797081]: Starting upload Jan 12 14:10:16.214501773 (910h41m16.085584808s) [upload=797081]: Done starting upload Jan 12 14:10:16.214529335 (910h41m16.08561237s) [upload=797081]: Uploading segments... Jan 12 14:10:16.214820539 (910h41m16.085903575s) [upload=797081]: Got next segment. Inline: false Jan 12 14:10:16.214857710 (910h41m16.085940755s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 12 14:10:16.214862800 (910h41m16.085945835s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 12 14:10:16.725378405 (910h41m16.59646144s) [seg_pos={0 0}, upload=797081]: Begin upload segment... Jan 12 14:10:16.725422480 (910h41m16.596505515s) [seg_pos={0 0}, upload=797081]: Done begin upload segment. Jan 12 14:10:16.725445774 (910h41m16.596528809s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.725501781 (910h41m16.596584816s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726116811 (910h41m16.597199846s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726412845 (910h41m16.59749588s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726772159 (910h41m16.597855194s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727073553 (910h41m16.598156598s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727623851 (910h41m16.598706886s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727995899 (910h41m16.599078934s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.729145138 (910h41m16.600228183s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.730429523 (910h41m16.601512558s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.732089985 (910h41m16.60317302s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.734072910 (910h41m16.605155945s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.735553440 (910h41m16.606636475s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.736428867 (910h41m16.607511902s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.737513312 (910h41m16.608596357s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.738969535 (910h41m16.61005257s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:18.481875246 (910h41m18.352958281s) [upload=797081]: Next returned nil segment Jan 12 14:10:18.481893851 (910h41m18.352976896s) [upload=797081]: Waiting for error group managing segments... Jan 12 14:10:18.865443483 (910h41m18.736526518s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.874831919 (910h41m18.745914954s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.912617466 (910h41m18.783700501s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.972954513 (910h41m18.844037548s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.977638962 (910h41m18.848722007s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.996512569 (910h41m18.867595604s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.004938513 (910h41m18.876021568s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.011100415 (910h41m18.882183461s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.068340406 (910h41m18.939423451s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.251481592 (910h41m19.122564637s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.563768072 (910h41m19.434851107s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.581405435 (910h41m19.45248848s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646368661 (910h41m19.517451696s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646388719 (910h41m19.517471754s) [seg_pos={0 0}, upload=797081]: Segment reached optimal threshold of 13 pieces. Jan 12 14:10:19.646563071 (910h41m19.517646106s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646570135 (910h41m19.51765318s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.646875135 (910h41m19.51795817s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646901976 (910h41m19.517985011s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647079855 (910h41m19.5181629s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1229E58YirF37sZU6hfZGrDNFSxQDYsWSo4x3mG9BoYsNsLNtjy): protocol: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection Jan 12 14:10:19.647093291 (910h41m19.518176326s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647125863 (910h41m19.518208908s) [seg_pos={0 0}, upload=797081]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 12 14:10:19.647203160 (910h41m19.518286195s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 12 14:10:19.647208149 (910h41m19.518291194s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 12 14:10:19.967827495 (910h41m19.838910541s) [upload=797081]: Done uploading segments... Jan 12 14:10:19.967846733 (910h41m19.838929768s) [upload=797081]: Upload finished. err: <nil> Duration: 5.79097997s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X..................................X.] duration: 10.068016157s trace: https://jaeger.dev.storj.io/trace/570cafb027e3f2fe FAIL (2026-01-12 14:46:24 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.068039582s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 26 out of 60 is failed (threshold=3) [X.XX.X.X...XX...XX..X.X..X.XXX.X.X..X..XXX.X..X..XXX........] duration: 13.232341235s trace: https://jaeger.dev.storj.io/trace/52dabc253ed75695 FAIL (2026-01-12 14:46:16 UTC) orbiter warning: context deadline exceeded Duration: 13.232367616s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X..................................X] duration: 30.001107813s trace: https://jaeger.dev.storj.io/trace/570cafb027e3f2fe FAIL (2026-01-12 14:46:11 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001129284s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 48 out of 60 is failed (threshold=6) [XXXX.X..XXXX.XX.XXXXXXXX.X.XXX.XX.XXXXXX.XXXXXXXXXXXXXX..XXX] duration: 5.00155965s trace: https://jaeger.dev.storj.io/trace/2649bd7c8543d1a7 FAIL (2026-01-12 14:46:03 UTC) orbiter warning: context deadline exceeded Duration: 5.001583797s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [.X...X...X...X.............X..XXX..................X........] duration: 28.040665103s trace: https://jaeger.dev.storj.io/trace/69f69cf14c8b272c FAIL (2026-01-12 14:45:41 UTC) orbiter warning: context deadline exceeded Duration: 28.040694729s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.778837153s trace: https://jaeger.dev.storj.io/trace/62457ac9390c0b68 FAIL (2026-01-12 14:45:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 12 14:10:16.214443221 (910h41m16.085526256s) [upload=797081]: Starting upload Jan 12 14:10:16.214501773 (910h41m16.085584808s) [upload=797081]: Done starting upload Jan 12 14:10:16.214529335 (910h41m16.08561237s) [upload=797081]: Uploading segments... Jan 12 14:10:16.214820539 (910h41m16.085903575s) [upload=797081]: Got next segment. Inline: false Jan 12 14:10:16.214857710 (910h41m16.085940755s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 12 14:10:16.214862800 (910h41m16.085945835s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 12 14:10:16.725378405 (910h41m16.59646144s) [seg_pos={0 0}, upload=797081]: Begin upload segment... Jan 12 14:10:16.725422480 (910h41m16.596505515s) [seg_pos={0 0}, upload=797081]: Done begin upload segment. Jan 12 14:10:16.725445774 (910h41m16.596528809s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.725501781 (910h41m16.596584816s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726116811 (910h41m16.597199846s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726412845 (910h41m16.59749588s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726772159 (910h41m16.597855194s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727073553 (910h41m16.598156598s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727623851 (910h41m16.598706886s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727995899 (910h41m16.599078934s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.729145138 (910h41m16.600228183s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.730429523 (910h41m16.601512558s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.732089985 (910h41m16.60317302s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.734072910 (910h41m16.605155945s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.735553440 (910h41m16.606636475s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.736428867 (910h41m16.607511902s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.737513312 (910h41m16.608596357s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.738969535 (910h41m16.61005257s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:18.481875246 (910h41m18.352958281s) [upload=797081]: Next returned nil segment Jan 12 14:10:18.481893851 (910h41m18.352976896s) [upload=797081]: Waiting for error group managing segments... Jan 12 14:10:18.865443483 (910h41m18.736526518s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.874831919 (910h41m18.745914954s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.912617466 (910h41m18.783700501s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.972954513 (910h41m18.844037548s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.977638962 (910h41m18.848722007s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.996512569 (910h41m18.867595604s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.004938513 (910h41m18.876021568s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.011100415 (910h41m18.882183461s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.068340406 (910h41m18.939423451s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.251481592 (910h41m19.122564637s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.563768072 (910h41m19.434851107s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.581405435 (910h41m19.45248848s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646368661 (910h41m19.517451696s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646388719 (910h41m19.517471754s) [seg_pos={0 0}, upload=797081]: Segment reached optimal threshold of 13 pieces. Jan 12 14:10:19.646563071 (910h41m19.517646106s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646570135 (910h41m19.51765318s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.646875135 (910h41m19.51795817s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646901976 (910h41m19.517985011s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647079855 (910h41m19.5181629s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1229E58YirF37sZU6hfZGrDNFSxQDYsWSo4x3mG9BoYsNsLNtjy): protocol: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection Jan 12 14:10:19.647093291 (910h41m19.518176326s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647125863 (910h41m19.518208908s) [seg_pos={0 0}, upload=797081]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 12 14:10:19.647203160 (910h41m19.518286195s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 12 14:10:19.647208149 (910h41m19.518291194s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 12 14:10:19.967827495 (910h41m19.838910541s) [upload=797081]: Done uploading segments... Jan 12 14:10:19.967846733 (910h41m19.838929768s) [upload=797081]: Upload finished. err: <nil> Duration: 5.778864094s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 27 out of 60 is failed (threshold=3) [XX.XX.X.X...XX...XX..X.X..X.XXX.X.X..X..XXX.X..X..XXX.......] duration: 8.10702875s trace: https://jaeger.dev.storj.io/trace/52dabc253ed75695 FAIL (2026-01-12 14:45:34 UTC) orbiter warning: context deadline exceeded Duration: 8.107053377s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.847060869s trace: https://jaeger.dev.storj.io/trace/62457ac9390c0b68 FAIL (2026-01-12 14:45:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 12 14:10:16.214443221 (910h41m16.085526256s) [upload=797081]: Starting upload Jan 12 14:10:16.214501773 (910h41m16.085584808s) [upload=797081]: Done starting upload Jan 12 14:10:16.214529335 (910h41m16.08561237s) [upload=797081]: Uploading segments... Jan 12 14:10:16.214820539 (910h41m16.085903575s) [upload=797081]: Got next segment. Inline: false Jan 12 14:10:16.214857710 (910h41m16.085940755s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 12 14:10:16.214862800 (910h41m16.085945835s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 12 14:10:16.725378405 (910h41m16.59646144s) [seg_pos={0 0}, upload=797081]: Begin upload segment... Jan 12 14:10:16.725422480 (910h41m16.596505515s) [seg_pos={0 0}, upload=797081]: Done begin upload segment. Jan 12 14:10:16.725445774 (910h41m16.596528809s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.725501781 (910h41m16.596584816s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726116811 (910h41m16.597199846s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726412845 (910h41m16.59749588s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726772159 (910h41m16.597855194s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727073553 (910h41m16.598156598s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727623851 (910h41m16.598706886s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727995899 (910h41m16.599078934s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.729145138 (910h41m16.600228183s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.730429523 (910h41m16.601512558s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.732089985 (910h41m16.60317302s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.734072910 (910h41m16.605155945s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.735553440 (910h41m16.606636475s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.736428867 (910h41m16.607511902s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.737513312 (910h41m16.608596357s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.738969535 (910h41m16.61005257s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:18.481875246 (910h41m18.352958281s) [upload=797081]: Next returned nil segment Jan 12 14:10:18.481893851 (910h41m18.352976896s) [upload=797081]: Waiting for error group managing segments... Jan 12 14:10:18.865443483 (910h41m18.736526518s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.874831919 (910h41m18.745914954s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.912617466 (910h41m18.783700501s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.972954513 (910h41m18.844037548s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.977638962 (910h41m18.848722007s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.996512569 (910h41m18.867595604s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.004938513 (910h41m18.876021568s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.011100415 (910h41m18.882183461s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.068340406 (910h41m18.939423451s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.251481592 (910h41m19.122564637s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.563768072 (910h41m19.434851107s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.581405435 (910h41m19.45248848s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646368661 (910h41m19.517451696s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646388719 (910h41m19.517471754s) [seg_pos={0 0}, upload=797081]: Segment reached optimal threshold of 13 pieces. Jan 12 14:10:19.646563071 (910h41m19.517646106s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646570135 (910h41m19.51765318s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.646875135 (910h41m19.51795817s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646901976 (910h41m19.517985011s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647079855 (910h41m19.5181629s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1229E58YirF37sZU6hfZGrDNFSxQDYsWSo4x3mG9BoYsNsLNtjy): protocol: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection Jan 12 14:10:19.647093291 (910h41m19.518176326s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647125863 (910h41m19.518208908s) [seg_pos={0 0}, upload=797081]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 12 14:10:19.647203160 (910h41m19.518286195s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 12 14:10:19.647208149 (910h41m19.518291194s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 12 14:10:19.967827495 (910h41m19.838910541s) [upload=797081]: Done uploading segments... Jan 12 14:10:19.967846733 (910h41m19.838929768s) [upload=797081]: Upload finished. err: <nil> Duration: 5.847145622s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 48 out of 60 is failed (threshold=6) [XXXXX.X..XXXX.XX.XXXXXXXX.X.XXX.XX.XXXXXX.XXXXXXXXXXXXXX..XX] duration: 5.001476784s trace: https://jaeger.dev.storj.io/trace/23fcfc63b5259d46 FAIL (2026-01-12 14:45:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001507964s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 28 out of 60 is failed (threshold=3) [XXX.XX.X.X...XX...XX..X.X..X.XXX.X.X..X..XXX.X..X..XXX......] duration: 19.766870223s trace: https://jaeger.dev.storj.io/trace/52dabc253ed75695 FAIL (2026-01-12 14:45:02 UTC) orbiter warning: context deadline exceeded Duration: 19.766887076s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.509310079s trace: https://jaeger.dev.storj.io/trace/351b474724be2a1d FAIL (2026-01-12 14:44:58 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 5.509332681s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [..X...X...X...X.............X..XXX..................X.......] duration: 23.508527442s trace: https://jaeger.dev.storj.io/trace/69f69cf14c8b272c FAIL (2026-01-12 14:44:57 UTC) orbiter warning: context deadline exceeded Duration: 23.50854221s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.802597884s trace: https://jaeger.dev.storj.io/trace/62457ac9390c0b68 FAIL (2026-01-12 14:44:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 12 14:10:16.214443221 (910h41m16.085526256s) [upload=797081]: Starting upload Jan 12 14:10:16.214501773 (910h41m16.085584808s) [upload=797081]: Done starting upload Jan 12 14:10:16.214529335 (910h41m16.08561237s) [upload=797081]: Uploading segments... Jan 12 14:10:16.214820539 (910h41m16.085903575s) [upload=797081]: Got next segment. Inline: false Jan 12 14:10:16.214857710 (910h41m16.085940755s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 12 14:10:16.214862800 (910h41m16.085945835s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 12 14:10:16.725378405 (910h41m16.59646144s) [seg_pos={0 0}, upload=797081]: Begin upload segment... Jan 12 14:10:16.725422480 (910h41m16.596505515s) [seg_pos={0 0}, upload=797081]: Done begin upload segment. Jan 12 14:10:16.725445774 (910h41m16.596528809s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.725501781 (910h41m16.596584816s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726116811 (910h41m16.597199846s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726412845 (910h41m16.59749588s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726772159 (910h41m16.597855194s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727073553 (910h41m16.598156598s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727623851 (910h41m16.598706886s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727995899 (910h41m16.599078934s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.729145138 (910h41m16.600228183s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.730429523 (910h41m16.601512558s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.732089985 (910h41m16.60317302s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.734072910 (910h41m16.605155945s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.735553440 (910h41m16.606636475s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.736428867 (910h41m16.607511902s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.737513312 (910h41m16.608596357s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.738969535 (910h41m16.61005257s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:18.481875246 (910h41m18.352958281s) [upload=797081]: Next returned nil segment Jan 12 14:10:18.481893851 (910h41m18.352976896s) [upload=797081]: Waiting for error group managing segments... Jan 12 14:10:18.865443483 (910h41m18.736526518s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.874831919 (910h41m18.745914954s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.912617466 (910h41m18.783700501s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.972954513 (910h41m18.844037548s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.977638962 (910h41m18.848722007s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.996512569 (910h41m18.867595604s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.004938513 (910h41m18.876021568s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.011100415 (910h41m18.882183461s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.068340406 (910h41m18.939423451s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.251481592 (910h41m19.122564637s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.563768072 (910h41m19.434851107s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.581405435 (910h41m19.45248848s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646368661 (910h41m19.517451696s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646388719 (910h41m19.517471754s) [seg_pos={0 0}, upload=797081]: Segment reached optimal threshold of 13 pieces. Jan 12 14:10:19.646563071 (910h41m19.517646106s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646570135 (910h41m19.51765318s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.646875135 (910h41m19.51795817s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646901976 (910h41m19.517985011s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647079855 (910h41m19.5181629s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1229E58YirF37sZU6hfZGrDNFSxQDYsWSo4x3mG9BoYsNsLNtjy): protocol: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection Jan 12 14:10:19.647093291 (910h41m19.518176326s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647125863 (910h41m19.518208908s) [seg_pos={0 0}, upload=797081]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 12 14:10:19.647203160 (910h41m19.518286195s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 12 14:10:19.647208149 (910h41m19.518291194s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 12 14:10:19.967827495 (910h41m19.838910541s) [upload=797081]: Done uploading segments... Jan 12 14:10:19.967846733 (910h41m19.838929768s) [upload=797081]: Upload finished. err: <nil> Duration: 5.802626129s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 28 out of 60 is failed (threshold=3) [.XXX.XX.X.X...XX...XX..X.X..X.XXX.X.X..X..XXX.X..X..XXX.....] duration: 20.021805608s trace: https://jaeger.dev.storj.io/trace/52dabc253ed75695 FAIL (2026-01-12 14:44:42 UTC) orbiter warning: context deadline exceeded Duration: 20.021828912s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 48 out of 60 is failed (threshold=6) [XXXXXX.X..XXXX.XX.XXXXXXXX.X.XXX.XX.XXXXXX.XXXXXXXXXXXXXX..X] duration: 5.001468652s trace: https://jaeger.dev.storj.io/trace/3616bb7596fe96d4 FAIL (2026-01-12 14:44:40 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001492518s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [...X...X...X...X.............X..XXX..................X......] duration: 25.078830355s trace: https://jaeger.dev.storj.io/trace/69f69cf14c8b272c FAIL (2026-01-12 14:44:33 UTC) orbiter warning: context deadline exceeded Duration: 25.078854812s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.23673213s trace: https://jaeger.dev.storj.io/trace/351b474724be2a1d FAIL (2026-01-12 14:44:33 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.236761978s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 47 out of 60 is failed (threshold=6) [.XXXXXX.X..XXXX.XX.XXXXXXXX.X.XXX.XX.XXXXXX.XXXXXXXXXXXXXX..] duration: 4.325887434s trace: https://jaeger.dev.storj.io/trace/5a122928645e57b FAIL (2026-01-12 14:44:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.325913473s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.873635155s trace: https://jaeger.dev.storj.io/trace/62457ac9390c0b68 FAIL (2026-01-12 14:44:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 12 14:10:16.214443221 (910h41m16.085526256s) [upload=797081]: Starting upload Jan 12 14:10:16.214501773 (910h41m16.085584808s) [upload=797081]: Done starting upload Jan 12 14:10:16.214529335 (910h41m16.08561237s) [upload=797081]: Uploading segments... Jan 12 14:10:16.214820539 (910h41m16.085903575s) [upload=797081]: Got next segment. Inline: false Jan 12 14:10:16.214857710 (910h41m16.085940755s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 12 14:10:16.214862800 (910h41m16.085945835s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 12 14:10:16.725378405 (910h41m16.59646144s) [seg_pos={0 0}, upload=797081]: Begin upload segment... Jan 12 14:10:16.725422480 (910h41m16.596505515s) [seg_pos={0 0}, upload=797081]: Done begin upload segment. Jan 12 14:10:16.725445774 (910h41m16.596528809s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.725501781 (910h41m16.596584816s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726116811 (910h41m16.597199846s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726412845 (910h41m16.59749588s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726772159 (910h41m16.597855194s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727073553 (910h41m16.598156598s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727623851 (910h41m16.598706886s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727995899 (910h41m16.599078934s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.729145138 (910h41m16.600228183s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.730429523 (910h41m16.601512558s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.732089985 (910h41m16.60317302s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.734072910 (910h41m16.605155945s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.735553440 (910h41m16.606636475s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.736428867 (910h41m16.607511902s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.737513312 (910h41m16.608596357s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.738969535 (910h41m16.61005257s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:18.481875246 (910h41m18.352958281s) [upload=797081]: Next returned nil segment Jan 12 14:10:18.481893851 (910h41m18.352976896s) [upload=797081]: Waiting for error group managing segments... Jan 12 14:10:18.865443483 (910h41m18.736526518s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.874831919 (910h41m18.745914954s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.912617466 (910h41m18.783700501s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.972954513 (910h41m18.844037548s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.977638962 (910h41m18.848722007s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.996512569 (910h41m18.867595604s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.004938513 (910h41m18.876021568s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.011100415 (910h41m18.882183461s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.068340406 (910h41m18.939423451s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.251481592 (910h41m19.122564637s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.563768072 (910h41m19.434851107s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.581405435 (910h41m19.45248848s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646368661 (910h41m19.517451696s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646388719 (910h41m19.517471754s) [seg_pos={0 0}, upload=797081]: Segment reached optimal threshold of 13 pieces. Jan 12 14:10:19.646563071 (910h41m19.517646106s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646570135 (910h41m19.51765318s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.646875135 (910h41m19.51795817s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646901976 (910h41m19.517985011s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647079855 (910h41m19.5181629s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1229E58YirF37sZU6hfZGrDNFSxQDYsWSo4x3mG9BoYsNsLNtjy): protocol: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection Jan 12 14:10:19.647093291 (910h41m19.518176326s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647125863 (910h41m19.518208908s) [seg_pos={0 0}, upload=797081]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 12 14:10:19.647203160 (910h41m19.518286195s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 12 14:10:19.647208149 (910h41m19.518291194s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 12 14:10:19.967827495 (910h41m19.838910541s) [upload=797081]: Done uploading segments... Jan 12 14:10:19.967846733 (910h41m19.838929768s) [upload=797081]: Upload finished. err: <nil> Duration: 5.873665623s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 29 out of 60 is failed (threshold=3) [X.XXX.XX.X.X...XX...XX..X.X..X.XXX.X.X..X..XXX.X..X..XXX....] duration: 29.039999512s trace: https://jaeger.dev.storj.io/trace/52dabc253ed75695 FAIL (2026-01-12 14:43:40 UTC) orbiter warning: context deadline exceeded Duration: 29.040022114s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 8.089097116s trace: https://jaeger.dev.storj.io/trace/351b474724be2a1d FAIL (2026-01-12 14:43:39 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 8.089121022s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 48 out of 60 is failed (threshold=6) [X.XXXXXX.X..XXXX.XX.XXXXXXXX.X.XXX.XX.XXXXXX.XXXXXXXXXXXXXX.] duration: 4.944623651s trace: https://jaeger.dev.storj.io/trace/5a122928645e57b FAIL (2026-01-12 14:43:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.944651515s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [....X...X...X...X.............X..XXX..................X.....] duration: 21.045589525s trace: https://jaeger.dev.storj.io/trace/69f69cf14c8b272c FAIL (2026-01-12 14:43:30 UTC) orbiter warning: context deadline exceeded Duration: 21.045607901s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.919237528s trace: https://jaeger.dev.storj.io/trace/62457ac9390c0b68 FAIL (2026-01-12 14:43:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 12 14:10:16.214443221 (910h41m16.085526256s) [upload=797081]: Starting upload Jan 12 14:10:16.214501773 (910h41m16.085584808s) [upload=797081]: Done starting upload Jan 12 14:10:16.214529335 (910h41m16.08561237s) [upload=797081]: Uploading segments... Jan 12 14:10:16.214820539 (910h41m16.085903575s) [upload=797081]: Got next segment. Inline: false Jan 12 14:10:16.214857710 (910h41m16.085940755s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 12 14:10:16.214862800 (910h41m16.085945835s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 12 14:10:16.725378405 (910h41m16.59646144s) [seg_pos={0 0}, upload=797081]: Begin upload segment... Jan 12 14:10:16.725422480 (910h41m16.596505515s) [seg_pos={0 0}, upload=797081]: Done begin upload segment. Jan 12 14:10:16.725445774 (910h41m16.596528809s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.725501781 (910h41m16.596584816s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726116811 (910h41m16.597199846s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726412845 (910h41m16.59749588s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726772159 (910h41m16.597855194s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727073553 (910h41m16.598156598s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727623851 (910h41m16.598706886s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727995899 (910h41m16.599078934s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.729145138 (910h41m16.600228183s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.730429523 (910h41m16.601512558s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.732089985 (910h41m16.60317302s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.734072910 (910h41m16.605155945s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.735553440 (910h41m16.606636475s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.736428867 (910h41m16.607511902s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.737513312 (910h41m16.608596357s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.738969535 (910h41m16.61005257s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:18.481875246 (910h41m18.352958281s) [upload=797081]: Next returned nil segment Jan 12 14:10:18.481893851 (910h41m18.352976896s) [upload=797081]: Waiting for error group managing segments... Jan 12 14:10:18.865443483 (910h41m18.736526518s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.874831919 (910h41m18.745914954s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.912617466 (910h41m18.783700501s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.972954513 (910h41m18.844037548s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.977638962 (910h41m18.848722007s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.996512569 (910h41m18.867595604s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.004938513 (910h41m18.876021568s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.011100415 (910h41m18.882183461s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.068340406 (910h41m18.939423451s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.251481592 (910h41m19.122564637s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.563768072 (910h41m19.434851107s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.581405435 (910h41m19.45248848s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646368661 (910h41m19.517451696s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646388719 (910h41m19.517471754s) [seg_pos={0 0}, upload=797081]: Segment reached optimal threshold of 13 pieces. Jan 12 14:10:19.646563071 (910h41m19.517646106s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646570135 (910h41m19.51765318s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.646875135 (910h41m19.51795817s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646901976 (910h41m19.517985011s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647079855 (910h41m19.5181629s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1229E58YirF37sZU6hfZGrDNFSxQDYsWSo4x3mG9BoYsNsLNtjy): protocol: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection Jan 12 14:10:19.647093291 (910h41m19.518176326s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647125863 (910h41m19.518208908s) [seg_pos={0 0}, upload=797081]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 12 14:10:19.647203160 (910h41m19.518286195s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 12 14:10:19.647208149 (910h41m19.518291194s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 12 14:10:19.967827495 (910h41m19.838910541s) [upload=797081]: Done uploading segments... Jan 12 14:10:19.967846733 (910h41m19.838929768s) [upload=797081]: Upload finished. err: <nil> Duration: 5.919284236s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 29 out of 60 is failed (threshold=3) [.X.XXX.XX.X.X...XX...XX..X.X..X.XXX.X.X..X..XXX.X..X..XXX...] duration: 30.0013594s trace: https://jaeger.dev.storj.io/trace/52dabc253ed75695 FAIL (2026-01-12 14:42:57 UTC) orbiter warning: context deadline exceeded Duration: 30.001443411s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 49 out of 60 is failed (threshold=6) [XX.XXXXXX.X..XXXX.XX.XXXXXXXX.X.XXX.XX.XXXXXX.XXXXXXXXXXXXXX] duration: 5.000723269s trace: https://jaeger.dev.storj.io/trace/5a122928645e57b FAIL (2026-01-12 14:42:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000744189s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.980948193s trace: https://jaeger.dev.storj.io/trace/351b474724be2a1d FAIL (2026-01-12 14:42:50 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 5.980970726s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 49 out of 60 is failed (threshold=6) [XXX.XXXXXX.X..XXXX.XX.XXXXXXXX.X.XXX.XX.XXXXXX.XXXXXXXXXXXXX] duration: 5.000835687s trace: https://jaeger.dev.storj.io/trace/513023da618e6fb5 FAIL (2026-01-12 14:42:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000859551s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [.....X...X...X...X.............X..XXX..................X....] duration: 14.302565702s trace: https://jaeger.dev.storj.io/trace/69f69cf14c8b272c FAIL (2026-01-12 14:42:10 UTC) orbiter warning: context deadline exceeded Duration: 14.30259574s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 8.269442485s trace: https://jaeger.dev.storj.io/trace/351b474724be2a1d FAIL (2026-01-12 14:41:57 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 8.26946498s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.846013443s trace: https://jaeger.dev.storj.io/trace/62457ac9390c0b68 FAIL (2026-01-12 14:41:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 12 14:10:16.214443221 (910h41m16.085526256s) [upload=797081]: Starting upload Jan 12 14:10:16.214501773 (910h41m16.085584808s) [upload=797081]: Done starting upload Jan 12 14:10:16.214529335 (910h41m16.08561237s) [upload=797081]: Uploading segments... Jan 12 14:10:16.214820539 (910h41m16.085903575s) [upload=797081]: Got next segment. Inline: false Jan 12 14:10:16.214857710 (910h41m16.085940755s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 12 14:10:16.214862800 (910h41m16.085945835s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 12 14:10:16.725378405 (910h41m16.59646144s) [seg_pos={0 0}, upload=797081]: Begin upload segment... Jan 12 14:10:16.725422480 (910h41m16.596505515s) [seg_pos={0 0}, upload=797081]: Done begin upload segment. Jan 12 14:10:16.725445774 (910h41m16.596528809s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.725501781 (910h41m16.596584816s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726116811 (910h41m16.597199846s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726412845 (910h41m16.59749588s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726772159 (910h41m16.597855194s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727073553 (910h41m16.598156598s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727623851 (910h41m16.598706886s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727995899 (910h41m16.599078934s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.729145138 (910h41m16.600228183s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.730429523 (910h41m16.601512558s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.732089985 (910h41m16.60317302s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.734072910 (910h41m16.605155945s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.735553440 (910h41m16.606636475s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.736428867 (910h41m16.607511902s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.737513312 (910h41m16.608596357s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.738969535 (910h41m16.61005257s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:18.481875246 (910h41m18.352958281s) [upload=797081]: Next returned nil segment Jan 12 14:10:18.481893851 (910h41m18.352976896s) [upload=797081]: Waiting for error group managing segments... Jan 12 14:10:18.865443483 (910h41m18.736526518s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.874831919 (910h41m18.745914954s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.912617466 (910h41m18.783700501s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.972954513 (910h41m18.844037548s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.977638962 (910h41m18.848722007s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.996512569 (910h41m18.867595604s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.004938513 (910h41m18.876021568s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.011100415 (910h41m18.882183461s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.068340406 (910h41m18.939423451s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.251481592 (910h41m19.122564637s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.563768072 (910h41m19.434851107s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.581405435 (910h41m19.45248848s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646368661 (910h41m19.517451696s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646388719 (910h41m19.517471754s) [seg_pos={0 0}, upload=797081]: Segment reached optimal threshold of 13 pieces. Jan 12 14:10:19.646563071 (910h41m19.517646106s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646570135 (910h41m19.51765318s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.646875135 (910h41m19.51795817s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646901976 (910h41m19.517985011s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647079855 (910h41m19.5181629s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1229E58YirF37sZU6hfZGrDNFSxQDYsWSo4x3mG9BoYsNsLNtjy): protocol: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection Jan 12 14:10:19.647093291 (910h41m19.518176326s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647125863 (910h41m19.518208908s) [seg_pos={0 0}, upload=797081]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 12 14:10:19.647203160 (910h41m19.518286195s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 12 14:10:19.647208149 (910h41m19.518291194s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 12 14:10:19.967827495 (910h41m19.838910541s) [upload=797081]: Done uploading segments... Jan 12 14:10:19.967846733 (910h41m19.838929768s) [upload=797081]: Upload finished. err: <nil> Duration: 5.846036517s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 30 out of 60 is failed (threshold=3) [X.X.XXX.XX.X.X...XX...XX..X.X..X.XXX.X.X..X..XXX.X..X..XXX..] duration: 20.644995324s trace: https://jaeger.dev.storj.io/trace/52dabc253ed75695 FAIL (2026-01-12 14:41:53 UTC) orbiter warning: context deadline exceeded Duration: 20.645008919s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 49 out of 60 is failed (threshold=6) [XXXX.XXXXXX.X..XXXX.XX.XXXXXXXX.X.XXX.XX.XXXXXX.XXXXXXXXXXXX] duration: 5.001554964s trace: https://jaeger.dev.storj.io/trace/d656e3e216d1af0 FAIL (2026-01-12 14:41:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001575863s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [......X...X...X...X.............X..XXX..................X...] duration: 29.984949318s trace: https://jaeger.dev.storj.io/trace/69f69cf14c8b272c FAIL (2026-01-12 14:41:26 UTC) orbiter warning: context deadline exceeded Duration: 29.98497095s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 31 out of 60 is failed (threshold=3) [XX.X.XXX.XX.X.X...XX...XX..X.X..X.XXX.X.X..X..XXX.X..X..XXX.] duration: 26.609108369s trace: https://jaeger.dev.storj.io/trace/52dabc253ed75695 FAIL (2026-01-12 14:41:02 UTC) orbiter warning: context deadline exceeded Duration: 26.609138304s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 8.114632516s trace: https://jaeger.dev.storj.io/trace/351b474724be2a1d FAIL (2026-01-12 14:40:59 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 8.114654247s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.818409993s trace: https://jaeger.dev.storj.io/trace/62457ac9390c0b68 FAIL (2026-01-12 14:40:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 12 14:10:16.214443221 (910h41m16.085526256s) [upload=797081]: Starting upload Jan 12 14:10:16.214501773 (910h41m16.085584808s) [upload=797081]: Done starting upload Jan 12 14:10:16.214529335 (910h41m16.08561237s) [upload=797081]: Uploading segments... Jan 12 14:10:16.214820539 (910h41m16.085903575s) [upload=797081]: Got next segment. Inline: false Jan 12 14:10:16.214857710 (910h41m16.085940755s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 12 14:10:16.214862800 (910h41m16.085945835s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 12 14:10:16.725378405 (910h41m16.59646144s) [seg_pos={0 0}, upload=797081]: Begin upload segment... Jan 12 14:10:16.725422480 (910h41m16.596505515s) [seg_pos={0 0}, upload=797081]: Done begin upload segment. Jan 12 14:10:16.725445774 (910h41m16.596528809s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.725501781 (910h41m16.596584816s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726116811 (910h41m16.597199846s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726412845 (910h41m16.59749588s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726772159 (910h41m16.597855194s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727073553 (910h41m16.598156598s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727623851 (910h41m16.598706886s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727995899 (910h41m16.599078934s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.729145138 (910h41m16.600228183s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.730429523 (910h41m16.601512558s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.732089985 (910h41m16.60317302s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.734072910 (910h41m16.605155945s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.735553440 (910h41m16.606636475s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.736428867 (910h41m16.607511902s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.737513312 (910h41m16.608596357s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.738969535 (910h41m16.61005257s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:18.481875246 (910h41m18.352958281s) [upload=797081]: Next returned nil segment Jan 12 14:10:18.481893851 (910h41m18.352976896s) [upload=797081]: Waiting for error group managing segments... Jan 12 14:10:18.865443483 (910h41m18.736526518s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.874831919 (910h41m18.745914954s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.912617466 (910h41m18.783700501s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.972954513 (910h41m18.844037548s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.977638962 (910h41m18.848722007s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.996512569 (910h41m18.867595604s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.004938513 (910h41m18.876021568s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.011100415 (910h41m18.882183461s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.068340406 (910h41m18.939423451s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.251481592 (910h41m19.122564637s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.563768072 (910h41m19.434851107s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.581405435 (910h41m19.45248848s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646368661 (910h41m19.517451696s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646388719 (910h41m19.517471754s) [seg_pos={0 0}, upload=797081]: Segment reached optimal threshold of 13 pieces. Jan 12 14:10:19.646563071 (910h41m19.517646106s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646570135 (910h41m19.51765318s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.646875135 (910h41m19.51795817s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646901976 (910h41m19.517985011s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647079855 (910h41m19.5181629s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1229E58YirF37sZU6hfZGrDNFSxQDYsWSo4x3mG9BoYsNsLNtjy): protocol: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection Jan 12 14:10:19.647093291 (910h41m19.518176326s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647125863 (910h41m19.518208908s) [seg_pos={0 0}, upload=797081]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 12 14:10:19.647203160 (910h41m19.518286195s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 12 14:10:19.647208149 (910h41m19.518291194s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 12 14:10:19.967827495 (910h41m19.838910541s) [upload=797081]: Done uploading segments... Jan 12 14:10:19.967846733 (910h41m19.838929768s) [upload=797081]: Upload finished. err: <nil> Duration: 5.818433128s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [.......X...X...X...X.............X..XXX..................X..] duration: 25.018779853s trace: https://jaeger.dev.storj.io/trace/69f69cf14c8b272c FAIL (2026-01-12 14:40:47 UTC) orbiter warning: context deadline exceeded Duration: 25.01880418s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 49 out of 60 is failed (threshold=6) [XXXXX.XXXXXX.X..XXXX.XX.XXXXXXXX.X.XXX.XX.XXXXXX.XXXXXXXXXXX] duration: 5.001124344s trace: https://jaeger.dev.storj.io/trace/7ba1bb509fc45fb FAIL (2026-01-12 14:40:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001154251s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 32 out of 60 is failed (threshold=3) [XXX.X.XXX.XX.X.X...XX...XX..X.X..X.XXX.X.X..X..XXX.X..X..XXX] duration: 30.000789286s trace: https://jaeger.dev.storj.io/trace/52dabc253ed75695 FAIL (2026-01-12 14:40:30 UTC) orbiter warning: context deadline exceeded Duration: 30.000812621s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 12.384043976s trace: https://jaeger.dev.storj.io/trace/351b474724be2a1d FAIL (2026-01-12 14:40:16 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 12.384078634s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 31 out of 60 is failed (threshold=3) [.XXX.X.XXX.XX.X.X...XX...XX..X.X..X.XXX.X.X..X..XXX.X..X..XX] duration: 30.001268781s trace: https://jaeger.dev.storj.io/trace/5593bc520c85c0b9 FAIL (2026-01-12 14:39:47 UTC) orbiter warning: context deadline exceeded Duration: 30.001292847s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 49 out of 60 is failed (threshold=6) [XXXXXX.XXXXXX.X..XXXX.XX.XXXXXXXX.X.XXX.XX.XXXXXX.XXXXXXXXXX] duration: 5.000944218s trace: https://jaeger.dev.storj.io/trace/3cfda176058218cb FAIL (2026-01-12 14:39:42 UTC) orbiter warning: context deadline exceeded Duration: 5.000962553s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.876907996s trace: https://jaeger.dev.storj.io/trace/62457ac9390c0b68 FAIL (2026-01-12 14:39:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 12 14:10:16.214443221 (910h41m16.085526256s) [upload=797081]: Starting upload Jan 12 14:10:16.214501773 (910h41m16.085584808s) [upload=797081]: Done starting upload Jan 12 14:10:16.214529335 (910h41m16.08561237s) [upload=797081]: Uploading segments... Jan 12 14:10:16.214820539 (910h41m16.085903575s) [upload=797081]: Got next segment. Inline: false Jan 12 14:10:16.214857710 (910h41m16.085940755s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 12 14:10:16.214862800 (910h41m16.085945835s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 12 14:10:16.725378405 (910h41m16.59646144s) [seg_pos={0 0}, upload=797081]: Begin upload segment... Jan 12 14:10:16.725422480 (910h41m16.596505515s) [seg_pos={0 0}, upload=797081]: Done begin upload segment. Jan 12 14:10:16.725445774 (910h41m16.596528809s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.725501781 (910h41m16.596584816s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726116811 (910h41m16.597199846s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726412845 (910h41m16.59749588s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.726772159 (910h41m16.597855194s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727073553 (910h41m16.598156598s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727623851 (910h41m16.598706886s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.727995899 (910h41m16.599078934s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.729145138 (910h41m16.600228183s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.730429523 (910h41m16.601512558s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.732089985 (910h41m16.60317302s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.734072910 (910h41m16.605155945s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.735553440 (910h41m16.606636475s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.736428867 (910h41m16.607511902s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.737513312 (910h41m16.608596357s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:16.738969535 (910h41m16.61005257s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Uploading piece... Jan 12 14:10:18.481875246 (910h41m18.352958281s) [upload=797081]: Next returned nil segment Jan 12 14:10:18.481893851 (910h41m18.352976896s) [upload=797081]: Waiting for error group managing segments... Jan 12 14:10:18.865443483 (910h41m18.736526518s) [noise=true , address=77.90.31.17:4773 , piece_id=5GONMY42UZABMNKH7VEKP4DNQRKHQRDPWDQIFXS2TU3ZD4OGKUHA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.874831919 (910h41m18.745914954s) [noise=true , address=145.79.227.8:4329 , piece_id=OV53BYUU5J4JJRP6RCS6LFCGAFM4GVVXQQ7EOWNY7S2L7BTC6M3A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.912617466 (910h41m18.783700501s) [noise=true , address=145.79.227.51:4410 , piece_id=JHH7QYI3SEC6UIRPAN2KVPXVP3I5BM2IUDC5COS27VVS3DWIXMIQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.972954513 (910h41m18.844037548s) [noise=true , address=45.91.116.11:4120 , piece_id=3FJMTDZDXLLJH7CZC62LKO3M6HQLJWASXIR3TVFSWHGZC4JRHJNA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.977638962 (910h41m18.848722007s) [noise=true , address=145.79.227.3:4150 , piece_id=UYVQ2ZSQEO6YMEYD6N36AASIVFLERJ7FZDVAGPU37W7FCTGVTLRA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:18.996512569 (910h41m18.867595604s) [noise=true , address=145.79.227.39:4015 , piece_id=6SVVXMZDSR6NSTW62KAQ43SD6DNZ3NPL7GIVGALAN7IHHEWPN3UQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.004938513 (910h41m18.876021568s) [noise=true , address=45.91.116.7:4010 , piece_id=PF5Y7RDLRPNHWUKM2WBN7I4GLEWUDC4OVFTDNZ52TF2OCNBZO5MQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.011100415 (910h41m18.882183461s) [noise=true , address=45.91.116.4:4940 , piece_id=YHCUZPDIZXCKIQZMXDMEM2UFMDWKTP4ZBZH3WD4YKQDKLCV3FPWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.068340406 (910h41m18.939423451s) [noise=true , address=45.91.116.12:4226 , piece_id=LW2SXKY7MVKXVUQPCFSVIHJWSZOJENBJ5S7MBJWJQNKT5WCEWL4A, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.251481592 (910h41m19.122564637s) [noise=true , address=145.79.227.13:4804 , piece_id=HCPA472DYKBR2FOFLWOF43TWZXZL7JJIGFMKSPI2PNO7EZG7WUPA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.563768072 (910h41m19.434851107s) [noise=true , address=145.79.227.7:4293 , piece_id=GHVSTBWK44UQ3GKKEHGGNFT3IJAIXVARD3HBL7XJQ67MCMST5UWQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.581405435 (910h41m19.45248848s) [noise=true , address=145.79.227.2:4114 , piece_id=CQMEYBMBI32LEQES66BCXMRUROHIO3367MANXQW6RYTS72TTFI4Q, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646368661 (910h41m19.517451696s) [noise=true , address=145.79.227.16:4909 , piece_id=25Z7ECFJQBG3K3UJKVL3UQNKCZUTPKCF3QLMSLWEHFL4QTGBXQZA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: <nil> Jan 12 14:10:19.646388719 (910h41m19.517471754s) [seg_pos={0 0}, upload=797081]: Segment reached optimal threshold of 13 pieces. Jan 12 14:10:19.646563071 (910h41m19.517646106s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646570135 (910h41m19.51765318s) [noise=true , address=145.79.227.42:4121 , piece_id=Q2ADXCPCMQVJEZKYSOFFAFF3U2IZNJA3H3IALYETZVOPSOGWJ4BQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.646875135 (910h41m19.51795817s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jan 12 14:10:19.646901976 (910h41m19.517985011s) [noise=true , address=145.79.227.14:4840 , piece_id=L7Q5VDDJQ7QMOJDJYTA5TE6V57UMRL2WSRBFT3QRQXTYB5FM36OA, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647079855 (910h41m19.5181629s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1229E58YirF37sZU6hfZGrDNFSxQDYsWSo4x3mG9BoYsNsLNtjy): protocol: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51734->145.79.227.22:4509: use of closed network connection Jan 12 14:10:19.647093291 (910h41m19.518176326s) [noise=true , address=145.79.227.22:4509 , piece_id=5BXZPLQ3EVX7MFVQBIUDEU37U7OU734U3Z6PT6LCVQ56ZA7G26DQ, seg_pos={0 0}, upload=797081]: Long tail cancellation due to optimal threshold Jan 12 14:10:19.647125863 (910h41m19.518208908s) [seg_pos={0 0}, upload=797081]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 12 14:10:19.647203160 (910h41m19.518286195s) [upload=797081]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 12 14:10:19.647208149 (910h41m19.518291194s) [upload=797081]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 12 14:10:19.967827495 (910h41m19.838910541s) [upload=797081]: Done uploading segments... Jan 12 14:10:19.967846733 (910h41m19.838929768s) [upload=797081]: Upload finished. err: <nil> Duration: 5.876931962s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 9 out of 60 is failed (threshold=3) [........X...X...X...X.............X..XXX..................X.] duration: 22.631337812s trace: https://jaeger.dev.storj.io/trace/69f69cf14c8b272c FAIL (2026-01-12 14:39:37 UTC) orbiter warning: context deadline exceeded Duration: 22.631437894s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.870103915s trace: https://jaeger.dev.storj.io/trace/351b474724be2a1d FAIL (2026-01-12 14:39:26 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.870128803s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)