Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXX] duration: 5.000679298s trace: https://jaeger.dev.storj.io/trace/38c9f025d222b05a FAIL (2026-01-09 11:35:58 UTC) orbiter warning: context deadline exceeded Duration: 5.000708662s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [..X..........X.........XX...X...X.XX..X.XXX.X....X..XX..XX..] duration: 29.833684084s trace: https://jaeger.dev.storj.io/trace/4a8062d26ce689df FAIL (2026-01-09 11:35:51 UTC) orbiter warning: context deadline exceeded Duration: 29.833719673s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [..................................X...X...X........X.......X] duration: 1m0.001742124s trace: https://jaeger.dev.storj.io/trace/6cc770b315666165 FAIL (2026-01-09 11:35:22 UTC) orbiter warning: context deadline exceeded Duration: 1m0.001766712s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [...X..........X.........XX...X...X.XX..X.XXX.X....X..XX..XX.] duration: 20.398011398s trace: https://jaeger.dev.storj.io/trace/4a8062d26ce689df FAIL (2026-01-09 11:34:57 UTC) orbiter warning: context deadline exceeded Duration: 20.398035895s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXX] duration: 5.000981075s trace: https://jaeger.dev.storj.io/trace/10c9eca0155684ba FAIL (2026-01-09 11:34:53 UTC) orbiter warning: context deadline exceeded Duration: 5.001004028s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.642148775s trace: https://jaeger.dev.storj.io/trace/5637bf42dd3ae530 FAIL (2026-01-09 11:34:18 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== FACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355190787 (835h20m47.226273832s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355202760 (835h20m47.226285806s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355514103 (835h20m47.226597138s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355543229 (835h20m47.226626264s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355815477 (835h20m47.226898522s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355822010 (835h20m47.226905045s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356121189 (835h20m47.227204234s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356156556 (835h20m47.227239601s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356418776 (835h20m47.227501821s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356471616 (835h20m47.227554651s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356805663 (835h20m47.227888698s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356924218 (835h20m47.228007253s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357129028 (835h20m47.228212063s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357224250 (835h20m47.228307285s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357456683 (835h20m47.228539718s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.358609427 (835h20m47.229692463s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:48.775784669 (835h20m48.646867714s) [upload=730683]: Next returned nil segment Jan 9 10:49:48.775796972 (835h20m48.646880007s) [upload=730683]: Waiting for error group managing segments... Jan 9 10:49:49.176111669 (835h20m49.047194704s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.381724343 (835h20m49.252807388s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.406288056 (835h20m49.277371091s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.431670719 (835h20m49.302753774s) [noise=true , address=145.79.227.49:4341 , piece_id=SX2OPLTAX2274VYVWFACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.436116914 (835h20m49.307199949s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.447697075 (835h20m49.31878011s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.450386596 (835h20m49.321469632s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460009109 (835h20m49.331092144s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460651291 (835h20m49.331734326s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.467339557 (835h20m49.338422602s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.717024371 (835h20m49.588107406s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.968229030 (835h20m49.839312065s) [noise=true , address=45.91.116.9:4273 , piece_id=CIF6IAT4QKIEMIHSC54ZFIHKJOFHNNYVETKRCRGLRH2BITNLW54Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.067335843 (835h20m49.938418878s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084374528 (835h20m49.955457573s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084395047 (835h20m49.955478082s) [seg_pos={0 0}, upload=730683]: Segment reached optimal threshold of 14 pieces. Jan 9 10:49:50.084894708 (835h20m49.955977773s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.084913094 (835h20m49.955996129s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085306763 (835h20m49.956389808s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085316281 (835h20m49.956399326s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085450537 (835h20m49.956533582s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBvE64jDPhNfGqS1Zj9cB5DJH8NjBfCgPKbWRRzMRHFd1xxju): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085456017 (835h20m49.956539052s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085651860 (835h20m49.956734895s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: read tcp 188.166.225.170:43994->45.91.116.5:4321: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 9 10:49:50.085659655 (835h20m49.95674269s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085679282 (835h20m49.956762317s) [seg_pos={0 0}, upload=730683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 9 10:49:50.085747111 (835h20m49.956830146s) [upload=730683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 10:49:50.085752582 (835h20m49.956835617s) [upload=730683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 10:49:50.378436022 (835h20m50.249519067s) [upload=730683]: Done uploading segments... Jan 9 10:49:50.378458726 (835h20m50.249541781s) [upload=730683]: Upload finished. err: <nil> Duration: 5.642174303s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XX] duration: 5.001131942s trace: https://jaeger.dev.storj.io/trace/65c6f8127fc367e7 FAIL (2026-01-09 11:34:16 UTC) orbiter warning: context deadline exceeded Duration: 5.001153472s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [....X..........X.........XX...X...X.XX..X.XXX.X....X..XX..XX] duration: 30.000972009s trace: https://jaeger.dev.storj.io/trace/4a8062d26ce689df FAIL (2026-01-09 11:34:09 UTC) orbiter warning: context deadline exceeded Duration: 30.000999983s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...................................X...X...X........X.......] duration: 22.176702044s trace: https://jaeger.dev.storj.io/trace/1b132a26cea3ba6 FAIL (2026-01-09 11:33:38 UTC) orbiter warning: context deadline exceeded Duration: 22.176727664s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.X] duration: 5.000843932s trace: https://jaeger.dev.storj.io/trace/4164cf4baaafec05 FAIL (2026-01-09 11:33:32 UTC) orbiter warning: context deadline exceeded Duration: 5.000864049s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.176680522s trace: https://jaeger.dev.storj.io/trace/5637bf42dd3ae530 FAIL (2026-01-09 11:33:17 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== FACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355190787 (835h20m47.226273832s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355202760 (835h20m47.226285806s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355514103 (835h20m47.226597138s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355543229 (835h20m47.226626264s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355815477 (835h20m47.226898522s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355822010 (835h20m47.226905045s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356121189 (835h20m47.227204234s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356156556 (835h20m47.227239601s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356418776 (835h20m47.227501821s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356471616 (835h20m47.227554651s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356805663 (835h20m47.227888698s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356924218 (835h20m47.228007253s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357129028 (835h20m47.228212063s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357224250 (835h20m47.228307285s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357456683 (835h20m47.228539718s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.358609427 (835h20m47.229692463s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:48.775784669 (835h20m48.646867714s) [upload=730683]: Next returned nil segment Jan 9 10:49:48.775796972 (835h20m48.646880007s) [upload=730683]: Waiting for error group managing segments... Jan 9 10:49:49.176111669 (835h20m49.047194704s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.381724343 (835h20m49.252807388s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.406288056 (835h20m49.277371091s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.431670719 (835h20m49.302753774s) [noise=true , address=145.79.227.49:4341 , piece_id=SX2OPLTAX2274VYVWFACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.436116914 (835h20m49.307199949s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.447697075 (835h20m49.31878011s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.450386596 (835h20m49.321469632s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460009109 (835h20m49.331092144s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460651291 (835h20m49.331734326s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.467339557 (835h20m49.338422602s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.717024371 (835h20m49.588107406s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.968229030 (835h20m49.839312065s) [noise=true , address=45.91.116.9:4273 , piece_id=CIF6IAT4QKIEMIHSC54ZFIHKJOFHNNYVETKRCRGLRH2BITNLW54Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.067335843 (835h20m49.938418878s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084374528 (835h20m49.955457573s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084395047 (835h20m49.955478082s) [seg_pos={0 0}, upload=730683]: Segment reached optimal threshold of 14 pieces. Jan 9 10:49:50.084894708 (835h20m49.955977773s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.084913094 (835h20m49.955996129s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085306763 (835h20m49.956389808s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085316281 (835h20m49.956399326s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085450537 (835h20m49.956533582s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBvE64jDPhNfGqS1Zj9cB5DJH8NjBfCgPKbWRRzMRHFd1xxju): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085456017 (835h20m49.956539052s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085651860 (835h20m49.956734895s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: read tcp 188.166.225.170:43994->45.91.116.5:4321: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 9 10:49:50.085659655 (835h20m49.95674269s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085679282 (835h20m49.956762317s) [seg_pos={0 0}, upload=730683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 9 10:49:50.085747111 (835h20m49.956830146s) [upload=730683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 10:49:50.085752582 (835h20m49.956835617s) [upload=730683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 10:49:50.378436022 (835h20m50.249519067s) [upload=730683]: Done uploading segments... Jan 9 10:49:50.378458726 (835h20m50.249541781s) [upload=730683]: Upload finished. err: <nil> Duration: 6.176712574s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [.....X..........X.........XX...X...X.XX..X.XXX.X....X..XX..X] duration: 30.001566189s trace: https://jaeger.dev.storj.io/trace/6bec2ccb919ff1c4 FAIL (2026-01-09 11:33:15 UTC) orbiter warning: context deadline exceeded Duration: 30.001587489s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.] duration: 3.689074151s trace: https://jaeger.dev.storj.io/trace/195129e89e779fc FAIL (2026-01-09 11:33:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.689104418s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [....................................X...X...X........X......] duration: 16.888827449s trace: https://jaeger.dev.storj.io/trace/1b132a26cea3ba6 FAIL (2026-01-09 11:33:12 UTC) orbiter warning: context deadline exceeded Duration: 16.888852175s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.561689047s trace: https://jaeger.dev.storj.io/trace/5637bf42dd3ae530 FAIL (2026-01-09 11:32:33 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== FACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355190787 (835h20m47.226273832s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355202760 (835h20m47.226285806s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355514103 (835h20m47.226597138s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355543229 (835h20m47.226626264s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355815477 (835h20m47.226898522s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355822010 (835h20m47.226905045s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356121189 (835h20m47.227204234s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356156556 (835h20m47.227239601s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356418776 (835h20m47.227501821s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356471616 (835h20m47.227554651s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356805663 (835h20m47.227888698s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356924218 (835h20m47.228007253s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357129028 (835h20m47.228212063s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357224250 (835h20m47.228307285s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357456683 (835h20m47.228539718s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.358609427 (835h20m47.229692463s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:48.775784669 (835h20m48.646867714s) [upload=730683]: Next returned nil segment Jan 9 10:49:48.775796972 (835h20m48.646880007s) [upload=730683]: Waiting for error group managing segments... Jan 9 10:49:49.176111669 (835h20m49.047194704s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.381724343 (835h20m49.252807388s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.406288056 (835h20m49.277371091s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.431670719 (835h20m49.302753774s) [noise=true , address=145.79.227.49:4341 , piece_id=SX2OPLTAX2274VYVWFACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.436116914 (835h20m49.307199949s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.447697075 (835h20m49.31878011s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.450386596 (835h20m49.321469632s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460009109 (835h20m49.331092144s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460651291 (835h20m49.331734326s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.467339557 (835h20m49.338422602s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.717024371 (835h20m49.588107406s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.968229030 (835h20m49.839312065s) [noise=true , address=45.91.116.9:4273 , piece_id=CIF6IAT4QKIEMIHSC54ZFIHKJOFHNNYVETKRCRGLRH2BITNLW54Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.067335843 (835h20m49.938418878s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084374528 (835h20m49.955457573s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084395047 (835h20m49.955478082s) [seg_pos={0 0}, upload=730683]: Segment reached optimal threshold of 14 pieces. Jan 9 10:49:50.084894708 (835h20m49.955977773s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.084913094 (835h20m49.955996129s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085306763 (835h20m49.956389808s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085316281 (835h20m49.956399326s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085450537 (835h20m49.956533582s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBvE64jDPhNfGqS1Zj9cB5DJH8NjBfCgPKbWRRzMRHFd1xxju): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085456017 (835h20m49.956539052s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085651860 (835h20m49.956734895s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: read tcp 188.166.225.170:43994->45.91.116.5:4321: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 9 10:49:50.085659655 (835h20m49.95674269s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085679282 (835h20m49.956762317s) [seg_pos={0 0}, upload=730683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 9 10:49:50.085747111 (835h20m49.956830146s) [upload=730683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 10:49:50.085752582 (835h20m49.956835617s) [upload=730683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 10:49:50.378436022 (835h20m50.249519067s) [upload=730683]: Done uploading segments... Jan 9 10:49:50.378458726 (835h20m50.249541781s) [upload=730683]: Upload finished. err: <nil> Duration: 5.561717922s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.....................................X...X...X........X.....] duration: 21.886759462s trace: https://jaeger.dev.storj.io/trace/1b132a26cea3ba6 FAIL (2026-01-09 11:32:33 UTC) orbiter warning: context deadline exceeded Duration: 21.886800029s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.625644522s trace: https://jaeger.dev.storj.io/trace/5637bf42dd3ae530 FAIL (2026-01-09 11:32:09 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== FACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355190787 (835h20m47.226273832s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355202760 (835h20m47.226285806s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355514103 (835h20m47.226597138s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355543229 (835h20m47.226626264s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355815477 (835h20m47.226898522s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355822010 (835h20m47.226905045s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356121189 (835h20m47.227204234s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356156556 (835h20m47.227239601s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356418776 (835h20m47.227501821s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356471616 (835h20m47.227554651s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356805663 (835h20m47.227888698s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356924218 (835h20m47.228007253s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357129028 (835h20m47.228212063s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357224250 (835h20m47.228307285s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357456683 (835h20m47.228539718s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.358609427 (835h20m47.229692463s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:48.775784669 (835h20m48.646867714s) [upload=730683]: Next returned nil segment Jan 9 10:49:48.775796972 (835h20m48.646880007s) [upload=730683]: Waiting for error group managing segments... Jan 9 10:49:49.176111669 (835h20m49.047194704s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.381724343 (835h20m49.252807388s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.406288056 (835h20m49.277371091s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.431670719 (835h20m49.302753774s) [noise=true , address=145.79.227.49:4341 , piece_id=SX2OPLTAX2274VYVWFACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.436116914 (835h20m49.307199949s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.447697075 (835h20m49.31878011s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.450386596 (835h20m49.321469632s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460009109 (835h20m49.331092144s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460651291 (835h20m49.331734326s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.467339557 (835h20m49.338422602s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.717024371 (835h20m49.588107406s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.968229030 (835h20m49.839312065s) [noise=true , address=45.91.116.9:4273 , piece_id=CIF6IAT4QKIEMIHSC54ZFIHKJOFHNNYVETKRCRGLRH2BITNLW54Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.067335843 (835h20m49.938418878s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084374528 (835h20m49.955457573s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084395047 (835h20m49.955478082s) [seg_pos={0 0}, upload=730683]: Segment reached optimal threshold of 14 pieces. Jan 9 10:49:50.084894708 (835h20m49.955977773s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.084913094 (835h20m49.955996129s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085306763 (835h20m49.956389808s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085316281 (835h20m49.956399326s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085450537 (835h20m49.956533582s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBvE64jDPhNfGqS1Zj9cB5DJH8NjBfCgPKbWRRzMRHFd1xxju): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085456017 (835h20m49.956539052s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085651860 (835h20m49.956734895s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: read tcp 188.166.225.170:43994->45.91.116.5:4321: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 9 10:49:50.085659655 (835h20m49.95674269s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085679282 (835h20m49.956762317s) [seg_pos={0 0}, upload=730683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 9 10:49:50.085747111 (835h20m49.956830146s) [upload=730683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 10:49:50.085752582 (835h20m49.956835617s) [upload=730683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 10:49:50.378436022 (835h20m50.249519067s) [upload=730683]: Done uploading segments... Jan 9 10:49:50.378458726 (835h20m50.249541781s) [upload=730683]: Upload finished. err: <nil> Duration: 5.625673677s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 16 out of 60 is failed (threshold=3) [......X..........X.........XX...X...X.XX..X.XXX.X....X..XX..] duration: 26.54133024s trace: https://jaeger.dev.storj.io/trace/535d86d67802dbf1 FAIL (2026-01-09 11:32:05 UTC) orbiter warning: context deadline exceeded Duration: 26.54134552s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000946806s trace: https://jaeger.dev.storj.io/trace/195129e89e779fc FAIL (2026-01-09 11:32:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000971634s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [X......X..........X.........XX...X...X.XX..X.XXX.X....X..XX.] duration: 30.001482588s trace: https://jaeger.dev.storj.io/trace/535d86d67802dbf1 FAIL (2026-01-09 11:31:38 UTC) orbiter warning: context deadline exceeded Duration: 30.001576096s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [......................................X...X...X........X....] duration: 20.046253631s trace: https://jaeger.dev.storj.io/trace/1b132a26cea3ba6 FAIL (2026-01-09 11:31:27 UTC) orbiter warning: context deadline exceeded Duration: 20.04627994s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.689713452s trace: https://jaeger.dev.storj.io/trace/5637bf42dd3ae530 FAIL (2026-01-09 11:31:12 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== FACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355190787 (835h20m47.226273832s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355202760 (835h20m47.226285806s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355514103 (835h20m47.226597138s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355543229 (835h20m47.226626264s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355815477 (835h20m47.226898522s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355822010 (835h20m47.226905045s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356121189 (835h20m47.227204234s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356156556 (835h20m47.227239601s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356418776 (835h20m47.227501821s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356471616 (835h20m47.227554651s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356805663 (835h20m47.227888698s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356924218 (835h20m47.228007253s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357129028 (835h20m47.228212063s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357224250 (835h20m47.228307285s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357456683 (835h20m47.228539718s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.358609427 (835h20m47.229692463s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:48.775784669 (835h20m48.646867714s) [upload=730683]: Next returned nil segment Jan 9 10:49:48.775796972 (835h20m48.646880007s) [upload=730683]: Waiting for error group managing segments... Jan 9 10:49:49.176111669 (835h20m49.047194704s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.381724343 (835h20m49.252807388s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.406288056 (835h20m49.277371091s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.431670719 (835h20m49.302753774s) [noise=true , address=145.79.227.49:4341 , piece_id=SX2OPLTAX2274VYVWFACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.436116914 (835h20m49.307199949s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.447697075 (835h20m49.31878011s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.450386596 (835h20m49.321469632s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460009109 (835h20m49.331092144s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460651291 (835h20m49.331734326s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.467339557 (835h20m49.338422602s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.717024371 (835h20m49.588107406s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.968229030 (835h20m49.839312065s) [noise=true , address=45.91.116.9:4273 , piece_id=CIF6IAT4QKIEMIHSC54ZFIHKJOFHNNYVETKRCRGLRH2BITNLW54Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.067335843 (835h20m49.938418878s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084374528 (835h20m49.955457573s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084395047 (835h20m49.955478082s) [seg_pos={0 0}, upload=730683]: Segment reached optimal threshold of 14 pieces. Jan 9 10:49:50.084894708 (835h20m49.955977773s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.084913094 (835h20m49.955996129s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085306763 (835h20m49.956389808s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085316281 (835h20m49.956399326s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085450537 (835h20m49.956533582s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBvE64jDPhNfGqS1Zj9cB5DJH8NjBfCgPKbWRRzMRHFd1xxju): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085456017 (835h20m49.956539052s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085651860 (835h20m49.956734895s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: read tcp 188.166.225.170:43994->45.91.116.5:4321: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 9 10:49:50.085659655 (835h20m49.95674269s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085679282 (835h20m49.956762317s) [seg_pos={0 0}, upload=730683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 9 10:49:50.085747111 (835h20m49.956830146s) [upload=730683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 10:49:50.085752582 (835h20m49.956835617s) [upload=730683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 10:49:50.378436022 (835h20m50.249519067s) [upload=730683]: Done uploading segments... Jan 9 10:49:50.378458726 (835h20m50.249541781s) [upload=730683]: Upload finished. err: <nil> Duration: 5.689737228s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.......................................X...X...X........X...] duration: 17.473950691s trace: https://jaeger.dev.storj.io/trace/1b132a26cea3ba6 FAIL (2026-01-09 11:31:05 UTC) orbiter warning: context deadline exceeded Duration: 17.473976641s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000904794s trace: https://jaeger.dev.storj.io/trace/52dd00a3699de9e FAIL (2026-01-09 11:31:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000930481s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [XX......X..........X.........XX...X...X.XX..X.XXX.X....X..XX] duration: 30.001527171s trace: https://jaeger.dev.storj.io/trace/535d86d67802dbf1 FAIL (2026-01-09 11:30:55 UTC) orbiter warning: context deadline exceeded Duration: 30.001549523s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001552093s trace: https://jaeger.dev.storj.io/trace/79c987dc0adcb58f FAIL (2026-01-09 11:30:20 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001566111s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [........................................X...X...X........X..] duration: 22.465477777s trace: https://jaeger.dev.storj.io/trace/1b132a26cea3ba6 FAIL (2026-01-09 11:30:06 UTC) orbiter warning: context deadline exceeded Duration: 22.465502024s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.652464427s trace: https://jaeger.dev.storj.io/trace/5637bf42dd3ae530 FAIL (2026-01-09 11:30:04 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== FACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355190787 (835h20m47.226273832s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355202760 (835h20m47.226285806s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355514103 (835h20m47.226597138s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355543229 (835h20m47.226626264s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355815477 (835h20m47.226898522s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355822010 (835h20m47.226905045s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356121189 (835h20m47.227204234s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356156556 (835h20m47.227239601s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356418776 (835h20m47.227501821s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356471616 (835h20m47.227554651s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356805663 (835h20m47.227888698s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356924218 (835h20m47.228007253s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357129028 (835h20m47.228212063s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357224250 (835h20m47.228307285s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357456683 (835h20m47.228539718s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.358609427 (835h20m47.229692463s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:48.775784669 (835h20m48.646867714s) [upload=730683]: Next returned nil segment Jan 9 10:49:48.775796972 (835h20m48.646880007s) [upload=730683]: Waiting for error group managing segments... Jan 9 10:49:49.176111669 (835h20m49.047194704s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.381724343 (835h20m49.252807388s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.406288056 (835h20m49.277371091s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.431670719 (835h20m49.302753774s) [noise=true , address=145.79.227.49:4341 , piece_id=SX2OPLTAX2274VYVWFACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.436116914 (835h20m49.307199949s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.447697075 (835h20m49.31878011s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.450386596 (835h20m49.321469632s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460009109 (835h20m49.331092144s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460651291 (835h20m49.331734326s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.467339557 (835h20m49.338422602s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.717024371 (835h20m49.588107406s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.968229030 (835h20m49.839312065s) [noise=true , address=45.91.116.9:4273 , piece_id=CIF6IAT4QKIEMIHSC54ZFIHKJOFHNNYVETKRCRGLRH2BITNLW54Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.067335843 (835h20m49.938418878s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084374528 (835h20m49.955457573s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084395047 (835h20m49.955478082s) [seg_pos={0 0}, upload=730683]: Segment reached optimal threshold of 14 pieces. Jan 9 10:49:50.084894708 (835h20m49.955977773s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.084913094 (835h20m49.955996129s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085306763 (835h20m49.956389808s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085316281 (835h20m49.956399326s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085450537 (835h20m49.956533582s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBvE64jDPhNfGqS1Zj9cB5DJH8NjBfCgPKbWRRzMRHFd1xxju): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085456017 (835h20m49.956539052s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085651860 (835h20m49.956734895s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: read tcp 188.166.225.170:43994->45.91.116.5:4321: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 9 10:49:50.085659655 (835h20m49.95674269s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085679282 (835h20m49.956762317s) [seg_pos={0 0}, upload=730683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 9 10:49:50.085747111 (835h20m49.956830146s) [upload=730683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 10:49:50.085752582 (835h20m49.956835617s) [upload=730683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 10:49:50.378436022 (835h20m50.249519067s) [upload=730683]: Done uploading segments... Jan 9 10:49:50.378458726 (835h20m50.249541781s) [upload=730683]: Upload finished. err: <nil> Duration: 5.65248714s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 18 out of 60 is failed (threshold=3) [XXX......X..........X.........XX...X...X.XX..X.XXX.X....X..X] duration: 30.001719169s trace: https://jaeger.dev.storj.io/trace/69e3c59ae83016f FAIL (2026-01-09 11:30:02 UTC) orbiter warning: context deadline exceeded Duration: 30.001743485s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001624049s trace: https://jaeger.dev.storj.io/trace/14b36bd1dabf4249 FAIL (2026-01-09 11:29:44 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001671299s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.........................................X...X...X........X.] duration: 34.033498948s trace: https://jaeger.dev.storj.io/trace/1b132a26cea3ba6 FAIL (2026-01-09 11:29:26 UTC) orbiter warning: context deadline exceeded Duration: 34.033513306s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.385434352s trace: https://jaeger.dev.storj.io/trace/5637bf42dd3ae530 FAIL (2026-01-09 11:29:05 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== FACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355190787 (835h20m47.226273832s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355202760 (835h20m47.226285806s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355514103 (835h20m47.226597138s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355543229 (835h20m47.226626264s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355815477 (835h20m47.226898522s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355822010 (835h20m47.226905045s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356121189 (835h20m47.227204234s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356156556 (835h20m47.227239601s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356418776 (835h20m47.227501821s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356471616 (835h20m47.227554651s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356805663 (835h20m47.227888698s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356924218 (835h20m47.228007253s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357129028 (835h20m47.228212063s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357224250 (835h20m47.228307285s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357456683 (835h20m47.228539718s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.358609427 (835h20m47.229692463s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:48.775784669 (835h20m48.646867714s) [upload=730683]: Next returned nil segment Jan 9 10:49:48.775796972 (835h20m48.646880007s) [upload=730683]: Waiting for error group managing segments... Jan 9 10:49:49.176111669 (835h20m49.047194704s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.381724343 (835h20m49.252807388s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.406288056 (835h20m49.277371091s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.431670719 (835h20m49.302753774s) [noise=true , address=145.79.227.49:4341 , piece_id=SX2OPLTAX2274VYVWFACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.436116914 (835h20m49.307199949s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.447697075 (835h20m49.31878011s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.450386596 (835h20m49.321469632s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460009109 (835h20m49.331092144s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460651291 (835h20m49.331734326s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.467339557 (835h20m49.338422602s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.717024371 (835h20m49.588107406s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.968229030 (835h20m49.839312065s) [noise=true , address=45.91.116.9:4273 , piece_id=CIF6IAT4QKIEMIHSC54ZFIHKJOFHNNYVETKRCRGLRH2BITNLW54Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.067335843 (835h20m49.938418878s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084374528 (835h20m49.955457573s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084395047 (835h20m49.955478082s) [seg_pos={0 0}, upload=730683]: Segment reached optimal threshold of 14 pieces. Jan 9 10:49:50.084894708 (835h20m49.955977773s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.084913094 (835h20m49.955996129s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085306763 (835h20m49.956389808s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085316281 (835h20m49.956399326s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085450537 (835h20m49.956533582s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBvE64jDPhNfGqS1Zj9cB5DJH8NjBfCgPKbWRRzMRHFd1xxju): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085456017 (835h20m49.956539052s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085651860 (835h20m49.956734895s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: read tcp 188.166.225.170:43994->45.91.116.5:4321: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 9 10:49:50.085659655 (835h20m49.95674269s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085679282 (835h20m49.956762317s) [seg_pos={0 0}, upload=730683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 9 10:49:50.085747111 (835h20m49.956830146s) [upload=730683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 10:49:50.085752582 (835h20m49.956835617s) [upload=730683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 10:49:50.378436022 (835h20m50.249519067s) [upload=730683]: Done uploading segments... Jan 9 10:49:50.378458726 (835h20m50.249541781s) [upload=730683]: Upload finished. err: <nil> Duration: 5.385462755s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [.XXX......X..........X.........XX...X...X.XX..X.XXX.X....X..] duration: 20.425202608s trace: https://jaeger.dev.storj.io/trace/7b11e4a3757f1e54 FAIL (2026-01-09 11:28:57 UTC) orbiter warning: context deadline exceeded Duration: 20.425285788s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..........................................X...X...X........X] duration: 1m0.001625141s trace: https://jaeger.dev.storj.io/trace/1b132a26cea3ba6 FAIL (2026-01-09 11:28:52 UTC) orbiter warning: context deadline exceeded Duration: 1m0.001641182s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001402963s trace: https://jaeger.dev.storj.io/trace/3ac54a36c821f026 FAIL (2026-01-09 11:28:46 UTC) orbiter warning: context deadline exceeded Duration: 5.001426779s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [..XXX......X..........X.........XX...X...X.XX..X.XXX.X....X.] duration: 30.000892795s trace: https://jaeger.dev.storj.io/trace/7b11e4a3757f1e54 FAIL (2026-01-09 11:28:30 UTC) orbiter warning: context deadline exceeded Duration: 30.00090549s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.497020871s trace: https://jaeger.dev.storj.io/trace/5637bf42dd3ae530 FAIL (2026-01-09 11:28:01 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== FACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355190787 (835h20m47.226273832s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355202760 (835h20m47.226285806s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355514103 (835h20m47.226597138s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355543229 (835h20m47.226626264s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355815477 (835h20m47.226898522s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355822010 (835h20m47.226905045s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356121189 (835h20m47.227204234s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356156556 (835h20m47.227239601s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356418776 (835h20m47.227501821s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356471616 (835h20m47.227554651s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356805663 (835h20m47.227888698s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356924218 (835h20m47.228007253s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357129028 (835h20m47.228212063s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357224250 (835h20m47.228307285s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357456683 (835h20m47.228539718s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.358609427 (835h20m47.229692463s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:48.775784669 (835h20m48.646867714s) [upload=730683]: Next returned nil segment Jan 9 10:49:48.775796972 (835h20m48.646880007s) [upload=730683]: Waiting for error group managing segments... Jan 9 10:49:49.176111669 (835h20m49.047194704s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.381724343 (835h20m49.252807388s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.406288056 (835h20m49.277371091s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.431670719 (835h20m49.302753774s) [noise=true , address=145.79.227.49:4341 , piece_id=SX2OPLTAX2274VYVWFACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.436116914 (835h20m49.307199949s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.447697075 (835h20m49.31878011s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.450386596 (835h20m49.321469632s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460009109 (835h20m49.331092144s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460651291 (835h20m49.331734326s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.467339557 (835h20m49.338422602s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.717024371 (835h20m49.588107406s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.968229030 (835h20m49.839312065s) [noise=true , address=45.91.116.9:4273 , piece_id=CIF6IAT4QKIEMIHSC54ZFIHKJOFHNNYVETKRCRGLRH2BITNLW54Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.067335843 (835h20m49.938418878s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084374528 (835h20m49.955457573s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084395047 (835h20m49.955478082s) [seg_pos={0 0}, upload=730683]: Segment reached optimal threshold of 14 pieces. Jan 9 10:49:50.084894708 (835h20m49.955977773s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.084913094 (835h20m49.955996129s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085306763 (835h20m49.956389808s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085316281 (835h20m49.956399326s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085450537 (835h20m49.956533582s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBvE64jDPhNfGqS1Zj9cB5DJH8NjBfCgPKbWRRzMRHFd1xxju): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085456017 (835h20m49.956539052s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085651860 (835h20m49.956734895s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: read tcp 188.166.225.170:43994->45.91.116.5:4321: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 9 10:49:50.085659655 (835h20m49.95674269s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085679282 (835h20m49.956762317s) [seg_pos={0 0}, upload=730683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 9 10:49:50.085747111 (835h20m49.956830146s) [upload=730683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 10:49:50.085752582 (835h20m49.956835617s) [upload=730683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 10:49:50.378436022 (835h20m50.249519067s) [upload=730683]: Done uploading segments... Jan 9 10:49:50.378458726 (835h20m50.249541781s) [upload=730683]: Upload finished. err: <nil> Duration: 5.497048384s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [...XXX......X..........X.........XX...X...X.XX..X.XXX.X....X] duration: 30.001002758s trace: https://jaeger.dev.storj.io/trace/7b11e4a3757f1e54 FAIL (2026-01-09 11:28:00 UTC) orbiter warning: context deadline exceeded Duration: 30.001024438s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000988311s trace: https://jaeger.dev.storj.io/trace/5b81ec41dcf34ba3 FAIL (2026-01-09 11:27:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001008869s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.533423977s trace: https://jaeger.dev.storj.io/trace/5637bf42dd3ae530 FAIL (2026-01-09 11:27:45 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== FACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355190787 (835h20m47.226273832s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355202760 (835h20m47.226285806s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355514103 (835h20m47.226597138s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355543229 (835h20m47.226626264s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355815477 (835h20m47.226898522s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355822010 (835h20m47.226905045s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356121189 (835h20m47.227204234s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356156556 (835h20m47.227239601s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356418776 (835h20m47.227501821s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356471616 (835h20m47.227554651s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356805663 (835h20m47.227888698s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356924218 (835h20m47.228007253s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357129028 (835h20m47.228212063s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357224250 (835h20m47.228307285s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357456683 (835h20m47.228539718s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.358609427 (835h20m47.229692463s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:48.775784669 (835h20m48.646867714s) [upload=730683]: Next returned nil segment Jan 9 10:49:48.775796972 (835h20m48.646880007s) [upload=730683]: Waiting for error group managing segments... Jan 9 10:49:49.176111669 (835h20m49.047194704s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.381724343 (835h20m49.252807388s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.406288056 (835h20m49.277371091s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.431670719 (835h20m49.302753774s) [noise=true , address=145.79.227.49:4341 , piece_id=SX2OPLTAX2274VYVWFACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.436116914 (835h20m49.307199949s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.447697075 (835h20m49.31878011s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.450386596 (835h20m49.321469632s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460009109 (835h20m49.331092144s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460651291 (835h20m49.331734326s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.467339557 (835h20m49.338422602s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.717024371 (835h20m49.588107406s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.968229030 (835h20m49.839312065s) [noise=true , address=45.91.116.9:4273 , piece_id=CIF6IAT4QKIEMIHSC54ZFIHKJOFHNNYVETKRCRGLRH2BITNLW54Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.067335843 (835h20m49.938418878s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084374528 (835h20m49.955457573s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084395047 (835h20m49.955478082s) [seg_pos={0 0}, upload=730683]: Segment reached optimal threshold of 14 pieces. Jan 9 10:49:50.084894708 (835h20m49.955977773s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.084913094 (835h20m49.955996129s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085306763 (835h20m49.956389808s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085316281 (835h20m49.956399326s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085450537 (835h20m49.956533582s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBvE64jDPhNfGqS1Zj9cB5DJH8NjBfCgPKbWRRzMRHFd1xxju): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085456017 (835h20m49.956539052s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085651860 (835h20m49.956734895s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: read tcp 188.166.225.170:43994->45.91.116.5:4321: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 9 10:49:50.085659655 (835h20m49.95674269s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085679282 (835h20m49.956762317s) [seg_pos={0 0}, upload=730683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 9 10:49:50.085747111 (835h20m49.956830146s) [upload=730683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 10:49:50.085752582 (835h20m49.956835617s) [upload=730683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 10:49:50.378436022 (835h20m50.249519067s) [upload=730683]: Done uploading segments... Jan 9 10:49:50.378458726 (835h20m50.249541781s) [upload=730683]: Upload finished. err: <nil> Duration: 5.5334464s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...........................................X...X...X........] duration: 22.946459313s trace: https://jaeger.dev.storj.io/trace/53d05fbf980e0503 FAIL (2026-01-09 11:27:26 UTC) orbiter warning: context deadline exceeded Duration: 22.946488468s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [X...XXX......X..........X.........XX...X...X.XX..X.XXX.X....] duration: 28.850741131s trace: https://jaeger.dev.storj.io/trace/623c4962e2f288b0 FAIL (2026-01-09 11:27:13 UTC) orbiter warning: context deadline exceeded Duration: 28.850765397s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.005510878s trace: https://jaeger.dev.storj.io/trace/7a5d20aafaad76c FAIL (2026-01-09 11:27:10 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.00553762s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.600678829s trace: https://jaeger.dev.storj.io/trace/5637bf42dd3ae530 FAIL (2026-01-09 11:26:42 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== FACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355190787 (835h20m47.226273832s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355202760 (835h20m47.226285806s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355514103 (835h20m47.226597138s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355543229 (835h20m47.226626264s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355815477 (835h20m47.226898522s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355822010 (835h20m47.226905045s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356121189 (835h20m47.227204234s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356156556 (835h20m47.227239601s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356418776 (835h20m47.227501821s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356471616 (835h20m47.227554651s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356805663 (835h20m47.227888698s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356924218 (835h20m47.228007253s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357129028 (835h20m47.228212063s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357224250 (835h20m47.228307285s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357456683 (835h20m47.228539718s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.358609427 (835h20m47.229692463s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:48.775784669 (835h20m48.646867714s) [upload=730683]: Next returned nil segment Jan 9 10:49:48.775796972 (835h20m48.646880007s) [upload=730683]: Waiting for error group managing segments... Jan 9 10:49:49.176111669 (835h20m49.047194704s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.381724343 (835h20m49.252807388s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.406288056 (835h20m49.277371091s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.431670719 (835h20m49.302753774s) [noise=true , address=145.79.227.49:4341 , piece_id=SX2OPLTAX2274VYVWFACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.436116914 (835h20m49.307199949s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.447697075 (835h20m49.31878011s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.450386596 (835h20m49.321469632s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460009109 (835h20m49.331092144s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460651291 (835h20m49.331734326s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.467339557 (835h20m49.338422602s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.717024371 (835h20m49.588107406s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.968229030 (835h20m49.839312065s) [noise=true , address=45.91.116.9:4273 , piece_id=CIF6IAT4QKIEMIHSC54ZFIHKJOFHNNYVETKRCRGLRH2BITNLW54Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.067335843 (835h20m49.938418878s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084374528 (835h20m49.955457573s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084395047 (835h20m49.955478082s) [seg_pos={0 0}, upload=730683]: Segment reached optimal threshold of 14 pieces. Jan 9 10:49:50.084894708 (835h20m49.955977773s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.084913094 (835h20m49.955996129s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085306763 (835h20m49.956389808s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085316281 (835h20m49.956399326s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085450537 (835h20m49.956533582s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBvE64jDPhNfGqS1Zj9cB5DJH8NjBfCgPKbWRRzMRHFd1xxju): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085456017 (835h20m49.956539052s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085651860 (835h20m49.956734895s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: read tcp 188.166.225.170:43994->45.91.116.5:4321: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 9 10:49:50.085659655 (835h20m49.95674269s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085679282 (835h20m49.956762317s) [seg_pos={0 0}, upload=730683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 9 10:49:50.085747111 (835h20m49.956830146s) [upload=730683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 10:49:50.085752582 (835h20m49.956835617s) [upload=730683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 10:49:50.378436022 (835h20m50.249519067s) [upload=730683]: Done uploading segments... Jan 9 10:49:50.378458726 (835h20m50.249541781s) [upload=730683]: Upload finished. err: <nil> Duration: 5.600703264s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [.X...XXX......X..........X.........XX...X...X.XX..X.XXX.X...] duration: 22.279697355s trace: https://jaeger.dev.storj.io/trace/623c4962e2f288b0 FAIL (2026-01-09 11:26:35 UTC) orbiter warning: context deadline exceeded Duration: 22.279748063s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [............................................X...X...X.......] duration: 23.483214059s trace: https://jaeger.dev.storj.io/trace/53d05fbf980e0503 FAIL (2026-01-09 11:26:16 UTC) orbiter warning: context deadline exceeded Duration: 23.483232865s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 17 out of 60 is failed (threshold=3) [..X...XXX......X..........X.........XX...X...X.XX..X.XXX.X..] duration: 17.721459971s trace: https://jaeger.dev.storj.io/trace/623c4962e2f288b0 FAIL (2026-01-09 11:26:03 UTC) orbiter warning: context deadline exceeded Duration: 17.721484267s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.564760338s trace: https://jaeger.dev.storj.io/trace/5637bf42dd3ae530 FAIL (2026-01-09 11:26:01 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== FACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355190787 (835h20m47.226273832s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355202760 (835h20m47.226285806s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355514103 (835h20m47.226597138s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355543229 (835h20m47.226626264s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355815477 (835h20m47.226898522s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.355822010 (835h20m47.226905045s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356121189 (835h20m47.227204234s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356156556 (835h20m47.227239601s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356418776 (835h20m47.227501821s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356471616 (835h20m47.227554651s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356805663 (835h20m47.227888698s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.356924218 (835h20m47.228007253s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357129028 (835h20m47.228212063s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357224250 (835h20m47.228307285s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.357456683 (835h20m47.228539718s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:47.358609427 (835h20m47.229692463s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Uploading piece... Jan 9 10:49:48.775784669 (835h20m48.646867714s) [upload=730683]: Next returned nil segment Jan 9 10:49:48.775796972 (835h20m48.646880007s) [upload=730683]: Waiting for error group managing segments... Jan 9 10:49:49.176111669 (835h20m49.047194704s) [noise=true , address=64.49.13.169:4711 , piece_id=PAMZR4LAJ7UBOOJFOQSLKMEIFFBQW3WR6T6ZKF4RVT4ENZBGQSWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.381724343 (835h20m49.252807388s) [noise=true , address=145.79.227.12:4772 , piece_id=TOBDTPLX6KNS7KKYEN32BB3UP5LSTBBQI6DISKQSMZR6IMDY43BA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.406288056 (835h20m49.277371091s) [noise=true , address=77.90.31.19:4859 , piece_id=MCDKT4LRKT4SUK6XS7RSAKB5OY5XJBT4OMHJX4R7N23ZWNHB65PA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.431670719 (835h20m49.302753774s) [noise=true , address=145.79.227.49:4341 , piece_id=SX2OPLTAX2274VYVWFACYN5W76CJAPFJWPT2U4PHNHESAXZMWGAA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.436116914 (835h20m49.307199949s) [noise=true , address=145.79.227.29:4974 , piece_id=BGK4M4PJMATFMQXVCI6RAZXTBRMQO75XVLZTPUY464CIVMIINQ3Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.447697075 (835h20m49.31878011s) [noise=true , address=145.79.227.40:4079 , piece_id=ON6ZIKANQRHQ2RWLRH5FJKMK5Z7FOFVJSPZKA5H2UXMS7SDAKCLA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.450386596 (835h20m49.321469632s) [noise=true , address=77.90.31.13:4631 , piece_id=GA3QERGB3XRNEG2IPZ4IJEY4RSYJDNGIL4OTMP2WRXN4UL6YUBBQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460009109 (835h20m49.331092144s) [noise=true , address=145.79.227.34:4915 , piece_id=5BFWEY66KKDSYFLFGEWICJD5RGH7IG3LCQAFACDVHE2CSEFW5MZQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.460651291 (835h20m49.331734326s) [noise=true , address=145.79.227.3:4176 , piece_id=MQYGRJ5JHRP3YOUPU5UOMDOW5I7NTC6LHFODLSE7DD4HRR2QVVKA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.467339557 (835h20m49.338422602s) [noise=true , address=145.79.227.30:4788 , piece_id=LVXP447NSTWZRNWJWX3MAEHGGM6FEAXBXBPUNKLQMQKTCCBBASEQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.717024371 (835h20m49.588107406s) [noise=true , address=77.90.31.11:4563 , piece_id=22AAVEB2QRVXUPP3G7FVSRUSLFMBU5UXXWHMYXIJR5AFTX2WMOWQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:49.968229030 (835h20m49.839312065s) [noise=true , address=45.91.116.9:4273 , piece_id=CIF6IAT4QKIEMIHSC54ZFIHKJOFHNNYVETKRCRGLRH2BITNLW54Q, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.067335843 (835h20m49.938418878s) [noise=true , address=145.79.227.35:4497 , piece_id=IBQYN5AII4NW2VT3EAKG7N2T6W7JYYJRV4TGZ57EQYU3FGB62UFQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084374528 (835h20m49.955457573s) [noise=true , address=193.149.164.143:4695 , piece_id=RC27R5N6E657KXQE6T7YV4UHHZ6P3WX64WWCXVKMMCDCTP5BDLVA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: <nil> Jan 9 10:49:50.084395047 (835h20m49.955478082s) [seg_pos={0 0}, upload=730683]: Segment reached optimal threshold of 14 pieces. Jan 9 10:49:50.084894708 (835h20m49.955977773s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12mY4YcLLVbnVuXtKSHwyv4sgTycqzxUZHGVQha5WfXXTPjNGLq): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.084913094 (835h20m49.955996129s) [noise=true , address=145.79.227.33:4903 , piece_id=2OBP6YKWVNKH6KA4H4FLPNB4A2B32X6PPOBN2RSOJKGLG3J5KJHA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085306763 (835h20m49.956389808s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085316281 (835h20m49.956399326s) [noise=true , address=145.79.227.43:4177 , piece_id=WKT6UM7VC5K4VHCZDFALV64A6CMZSKQIHRJTJGEJ6KYI5THAZBAQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085450537 (835h20m49.956533582s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UBvE64jDPhNfGqS1Zj9cB5DJH8NjBfCgPKbWRRzMRHFd1xxju): protocol: expected piece hash; context canceled; EOF Jan 9 10:49:50.085456017 (835h20m49.956539052s) [noise=true , address=45.91.116.14:4203 , piece_id=7CHAHCEYNDYLK7W5RDDZFRO5L6DM6GALQMEEFDMK4U5ECBTR3OIA, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085651860 (835h20m49.956734895s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m3Lw8yL9wVq38nW514iaLooMVgikbQBGA9vrFsr66jx5w1xXj): protocol: read tcp 188.166.225.170:43994->45.91.116.5:4321: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 9 10:49:50.085659655 (835h20m49.95674269s) [noise=true , address=45.91.116.5:4321 , piece_id=O36WN7CMFDT2NOV3Q67P2I3WOGQU2E3CZERHBIHOZIXWLCHRDTRQ, seg_pos={0 0}, upload=730683]: Long tail cancellation due to optimal threshold Jan 9 10:49:50.085679282 (835h20m49.956762317s) [seg_pos={0 0}, upload=730683]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 9 10:49:50.085747111 (835h20m49.956830146s) [upload=730683]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 9 10:49:50.085752582 (835h20m49.956835617s) [upload=730683]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 9 10:49:50.378436022 (835h20m50.249519067s) [upload=730683]: Done uploading segments... Jan 9 10:49:50.378458726 (835h20m50.249541781s) [upload=730683]: Upload finished. err: <nil> Duration: 5.564789854s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 59 out of 60 is failed (threshold=6) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001988556s trace: https://jaeger.dev.storj.io/trace/27436d8845122942 FAIL (2026-01-09 11:25:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.002015327s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.............................................X...X...X......] duration: 19.182354601s trace: https://jaeger.dev.storj.io/trace/53d05fbf980e0503 FAIL (2026-01-09 11:25:41 UTC) orbiter warning: context deadline exceeded Duration: 19.182388706s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)