Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
51 out of 60 is failed (threshold=6) [X.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXXXXX.X..XXXXX] duration:
5.00061365s trace:
https://jaeger.dev.storj.io/trace/34aa99d89701dbeb
FAIL (2026-01-16 16:57:05 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000636062s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
28.945033214s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:57:00 UTC)
orbiter warning: context deadline exceeded
Duration: 28.945059355s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................................XX.] duration:
5.747917492s trace:
https://jaeger.dev.storj.io/trace/ff1eaafc0d95989
FAIL (2026-01-16 16:56:35 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 16 16:56:06.586316499 (25h0m3.480025108s) [upload=21929]: Starting upload
Jan 16 16:56:06.586371244 (25h0m3.480079853s) [upload=21929]: Done starting upload
Jan 16 16:56:06.586529134 (25h0m3.480237763s) [upload=21929]: Uploading segments...
Jan 16 16:56:06.586687636 (25h0m3.480396275s) [upload=21929]: Got next segment. Inline: false
Jan 16 16:56:06.586750094 (25h0m3.480458723s) [upload=21929]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 16 16:56:06.586757138 (25h0m3.480465767s) [upload=21929]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 16 16:56:08.120364931 (25h0m5.01407354s) [seg_pos={0 0}, upload=21929]: Begin upload segment...
Jan 16 16:56:08.120413474 (25h0m5.014122083s) [seg_pos={0 0}, upload=21929]: Done begin upload segment.
Jan 16 16:56:08.120440615 (25h0m5.014149224s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.120799800 (25h0m5.014508419s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.121695454 (25h0m5.015404084s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.122317739 (25h0m5.016026349s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.123161636 (25h0m5.016870245s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.123395732 (25h0m5.017104351s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.123848494 (25h0m5.017557113s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.123868092 (25h0m5.017576731s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.124249808 (25h0m5.017958417s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.124389284 (25h0m5.018097893s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.124619222 (25h0m5.018327831s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.124999566 (25h0m5.018708175s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.125202182 (25h0m5.018910801s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.125576805 (25h0m5.019285414s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.125952470 (25h0m5.019661079s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.126492900 (25h0m5.020201509s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:10.730578935 (25h0m7.624287544s) [upload=21929]: Next returned nil segment
Jan 16 16:56:10.730594134 (25h0m7.624302753s) [upload=21929]: Waiting for error group managing segments...
Jan 16 16:56:11.329683279 (25h0m8.223391888s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:11.338893335 (25h0m8.232601944s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:11.400223651 (25h0m8.29393226s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:11.400340974 (25h0m8.294049583s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:11.445450294 (25h0m8.339158904s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:11.964879212 (25h0m8.858587821s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:12.027795357 (25h0m8.921503966s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:12.267543450 (25h0m9.161252059s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:12.337643945 (25h0m9.231352554s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:12.380001967 (25h0m9.273710576s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:12.850164228 (25h0m9.743872837s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:13.183873887 (25h0m10.077582496s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:13.361354387 (25h0m10.255063026s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:13.361383082 (25h0m10.255091691s) [seg_pos={0 0}, upload=21929]: Satisfied cohort requirements after 13 pieces
Jan 16 16:56:13.361615564 (25h0m10.255324173s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF
Jan 16 16:56:13.361624061 (25h0m10.25533267s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold
Jan 16 16:56:13.361904004 (25h0m10.255612623s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: read tcp 188.166.225.170:42244->145.79.227.38:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 16:56:13.361925344 (25h0m10.255633963s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold
Jan 16 16:56:13.361971022 (25h0m10.255679631s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF
Jan 16 16:56:13.361978977 (25h0m10.255687596s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold
Jan 16 16:56:13.362041817 (25h0m10.255750426s) [seg_pos={0 0}, upload=21929]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jan 16 16:56:13.362197272 (25h0m10.255905881s) [upload=21929]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 16 16:56:13.362205868 (25h0m10.255914477s) [upload=21929]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 16 16:56:13.965177888 (25h0m10.858886497s) [upload=21929]: Done uploading segments...
Jan 16 16:56:13.965204158 (25h0m10.858912767s) [upload=21929]: Upload finished. err: <nil>
Duration: 5.747930136s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.00276258s trace:
https://jaeger.dev.storj.io/trace/ff1eaafc0d95989
FAIL (2026-01-16 16:56:29 UTC)
orbiter warning:
operation: DeleteObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 16 16:56:06.586316499 (25h0m3.480025108s) [upload=21929]: Starting upload
Jan 16 16:56:06.586371244 (25h0m3.480079853s) [upload=21929]: Done starting upload
Jan 16 16:56:06.586529134 (25h0m3.480237763s) [upload=21929]: Uploading segments...
Jan 16 16:56:06.586687636 (25h0m3.480396275s) [upload=21929]: Got next segment. Inline: false
Jan 16 16:56:06.586750094 (25h0m3.480458723s) [upload=21929]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 16 16:56:06.586757138 (25h0m3.480465767s) [upload=21929]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 16 16:56:08.120364931 (25h0m5.01407354s) [seg_pos={0 0}, upload=21929]: Begin upload segment...
Jan 16 16:56:08.120413474 (25h0m5.014122083s) [seg_pos={0 0}, upload=21929]: Done begin upload segment.
Jan 16 16:56:08.120440615 (25h0m5.014149224s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.120799800 (25h0m5.014508419s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.121695454 (25h0m5.015404084s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.122317739 (25h0m5.016026349s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.123161636 (25h0m5.016870245s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.123395732 (25h0m5.017104351s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.123848494 (25h0m5.017557113s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.123868092 (25h0m5.017576731s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.124249808 (25h0m5.017958417s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.124389284 (25h0m5.018097893s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.124619222 (25h0m5.018327831s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.124999566 (25h0m5.018708175s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.125202182 (25h0m5.018910801s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.125576805 (25h0m5.019285414s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.125952470 (25h0m5.019661079s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:08.126492900 (25h0m5.020201509s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Uploading piece...
Jan 16 16:56:10.730578935 (25h0m7.624287544s) [upload=21929]: Next returned nil segment
Jan 16 16:56:10.730594134 (25h0m7.624302753s) [upload=21929]: Waiting for error group managing segments...
Jan 16 16:56:11.329683279 (25h0m8.223391888s) [noise=true , address=145.79.227.15:4873 , piece_id=EVJGQ5JNJI37QIPQDJPFOPMT3JAHPBZXQG7DBRUZXJMKXAIADWSA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:11.338893335 (25h0m8.232601944s) [noise=true , address=45.91.116.14:4190 , piece_id=ZBC7C5E5V7B4VAGI2JHD7T4E6BGVV74YNNAROZYBITS2N23BJDWA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:11.400223651 (25h0m8.29393226s) [noise=true , address=145.79.227.33:4870 , piece_id=7I3KU7EKC2MHBJ6TOGO5ZBMJSPYU4E26D5373M2R53IZAZJLWVOA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:11.400340974 (25h0m8.294049583s) [noise=true , address=145.79.227.2:4115 , piece_id=YMME5WUV7XGQZOE2I5H7UWQ7TSTP2LGV7D4AZO4T62XOWBE4ZEKA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:11.445450294 (25h0m8.339158904s) [noise=true , address=145.79.227.30:4762 , piece_id=YLBYKHJNJ2J3YYVYHRWEZTFLXZVL5WCKCBWXM526XF4KKCYA4RAQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:11.964879212 (25h0m8.858587821s) [noise=true , address=145.79.227.3:4151 , piece_id=QVFK6RJITYJIW6ZJRUYFU3P2NEMMVANA36O6WXPS7Z7FNFSYQWUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:12.027795357 (25h0m8.921503966s) [noise=true , address=145.79.227.49:4339 , piece_id=NWDULUWHMV4PIMWMNO5XYXSAGVLNPLSIPYSDA32OZB2MBGBYPEUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:12.267543450 (25h0m9.161252059s) [noise=true , address=145.79.227.28:4727 , piece_id=U5CDDUXQZ2BB7SPFAIWQXRGALJQTOWFNWGJLU3CGXKBUHYIQBIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:12.337643945 (25h0m9.231352554s) [noise=true , address=145.79.227.10:4401 , piece_id=C2X52SPGSNM2CB6TFGBCT6HO3MXSEMX3CCZQASDNFGWIEW2EGIGQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:12.380001967 (25h0m9.273710576s) [noise=true , address=145.79.227.32:4835 , piece_id=6PP7J34OCTKYEDEFQJWDUHO5H4Z6VG7LNG3SL7WLITSKMX43HAYQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:12.850164228 (25h0m9.743872837s) [noise=true , address=77.90.31.13:4627 , piece_id=TJFFMEVYN7M52FH5UP3WNAGC7HWF5GSEUPQJZ5KJWTJZWKZNAWXQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:13.183873887 (25h0m10.077582496s) [noise=true , address=77.90.31.19:4842 , piece_id=3VJ3J4JQPSJEVFSNSYDVHRFZMMCBMNZRBYEGJOOU4Q4HFEDDOKHQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:13.361354387 (25h0m10.255063026s) [noise=true , address=45.91.116.4:4937 , piece_id=MJHRB2I4KWRJJ3MHGW657D53JFDARTHOBRUEHQZEUA4DRFVK7ZUA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: <nil>
Jan 16 16:56:13.361383082 (25h0m10.255091691s) [seg_pos={0 0}, upload=21929]: Satisfied cohort requirements after 13 pieces
Jan 16 16:56:13.361615564 (25h0m10.255324173s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12m9gfwSNSLJB2XyBAQUVtWUpc1jQtr5dvYWzHqXeaLQUzyW9cw): protocol: expected piece hash; context canceled; EOF
Jan 16 16:56:13.361624061 (25h0m10.25533267s) [noise=true , address=145.79.227.34:4906 , piece_id=G2GHF4S5NVJP5R43EN6NDEJ4FCPCLSL5K3TO4UADJ6ZANME54KOQ, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold
Jan 16 16:56:13.361904004 (25h0m10.255612623s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125dJwj1tvBkFrgDCoj3FhpH553yGgjxPuSTGxbrkGeDwdKk6M8): protocol: read tcp 188.166.225.170:42244->145.79.227.38:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 16 16:56:13.361925344 (25h0m10.255633963s) [noise=true , address=145.79.227.38:4977 , piece_id=JXV6MGOVSAA2URSIF2KFFQJJEGWQWFVT65PWVDW5MEH5ITSDYFAA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold
Jan 16 16:56:13.361971022 (25h0m10.255679631s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t8YAgwwGdjWLFyb9yNgLSFXV8QHbdyv2tnjtSZQAcBc8cZiHq): protocol: expected piece hash; context canceled; EOF
Jan 16 16:56:13.361978977 (25h0m10.255687596s) [noise=true , address=45.91.116.5:4300 , piece_id=M2F4W7IGAEKEXJXZRENON55A2E7DNSCZTPKWYJFY3NKNTBIWG2YA, seg_pos={0 0}, upload=21929]: Long tail cancellation due to optimal threshold
Jan 16 16:56:13.362041817 (25h0m10.255750426s) [seg_pos={0 0}, upload=21929]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jan 16 16:56:13.362197272 (25h0m10.255905881s) [upload=21929]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 16 16:56:13.362205868 (25h0m10.255914477s) [upload=21929]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 16 16:56:13.965177888 (25h0m10.858886497s) [upload=21929]: Done uploading segments...
Jan 16 16:56:13.965204158 (25h0m10.858912767s) [upload=21929]: Upload finished. err: <nil>
Duration: 30.002779481s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.....X....................X.................................] duration:
13.170688377s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:56:29 UTC)
orbiter warning: context deadline exceeded
Duration: 13.170727031s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [......X....................X................................] duration:
16.757627862s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:56:11 UTC)
orbiter warning: context deadline exceeded
Duration: 16.757657338s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.002457569s trace:
https://jaeger.dev.storj.io/trace/ad2ffbbe1987e4d
FAIL (2026-01-16 16:55:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 16 16:55:31.238239891 (24h59m28.131948501s) [upload=21920]: Starting upload
Jan 16 16:55:31.238320224 (24h59m28.132028833s) [upload=21920]: Done starting upload
Jan 16 16:55:31.238466584 (24h59m28.132175203s) [upload=21920]: Uploading segments...
Jan 16 16:55:31.238587684 (24h59m28.132296333s) [upload=21920]: Got next segment. Inline: false
Jan 16 16:55:31.238634843 (24h59m28.132343452s) [upload=21920]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 16 16:55:31.238640844 (24h59m28.132349465s) [upload=21920]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 16 16:55:33.642114375 (24h59m30.535823004s) [seg_pos={0 0}, upload=21920]: Begin upload segment...
Jan 16 16:55:33.642190750 (24h59m30.535899379s) [seg_pos={0 0}, upload=21920]: Done begin upload segment.
Jan 16 16:55:33.642260923 (24h59m30.535969562s) [noise=true , address=145.79.227.36:4517 , piece_id=HTIPRCH3WIOKBG7VWKM2DHAQUF5G52XGGGQB35HIR3H7ADSHTZEA, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.642270082 (24h59m30.535978701s) [noise=true , address=45.91.116.11:4117 , piece_id=LXO4SL3LQWVHC7UFL6DA72PJSCVTK3UWWSFGFX3BAD2QL22EFWLQ, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.643046570 (24h59m30.536755179s) [noise=true , address=145.79.227.6:4257 , piece_id=537IL4HWMQNIDXMDS67TW364RGJXXW4HUR6Q73AIFO27MVFJ2DRQ, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.643131561 (24h59m30.53684017s) [noise=true , address=145.79.227.44:4194 , piece_id=4BCH7BEZG32Q4AZ3PWJAS5BKYP2PAAB5SKCLVPMUOL4ETCT7YD6A, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.643520061 (24h59m30.53722868s) [noise=true , address=145.79.227.19:4078 , piece_id=SK2WEHKCSL7KFG5MROQ6KBX36X23CNCTWSUH4FY433WD4CNYJSXA, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.643810775 (24h59m30.537519384s) [noise=true , address=145.79.227.15:4875 , piece_id=SY3RLEN5YBT4HJJIZ3RN6FY7NNRUFLO3COTTNTYHQXZ3W4TIU3OA, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.644151623 (24h59m30.537860232s) [noise=true , address=145.79.227.17:4972 , piece_id=RITVU56QWJPNXPBGM2DNMGPEDYQG5XFL6Q5HOTT2L6HSKFVFJYQA, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.644200357 (24h59m30.537908996s) [noise=true , address=45.91.116.8:4046 , piece_id=GFDE3QAV6NJAZJWJARZTOB46WZXB63VMG43R26WTRF6LQPGW463Q, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.644435194 (24h59m30.538143803s) [noise=true , address=145.79.227.5:4223 , piece_id=2DR6L2U75VMWWXWI42KFJXQN3MBQQ6XLZ7TWI5YDFEQUPSRUEGXA, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.644741376 (24h59m30.538449985s) [noise=true , address=145.79.227.37:4567 , piece_id=LGK2EZW5KVD5Y377I6ZJJ3SQMDMK2MEPQICJZJKB6CQST6BACFJQ, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.645035327 (24h59m30.538743936s) [noise=true , address=45.91.116.9:4262 , piece_id=7XHE5QU2HMXJM54LM5WGGCQPUUEUO2HVMDWWPDHOFBHFL2SXRA2Q, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.645344566 (24h59m30.539053175s) [noise=true , address=145.79.227.31:4797 , piece_id=M5JIYFUEF5AC6QSEXNRW3MFUPUDXMQ6ZNGPOMMAGLLPXGVF4VSQA, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.645633215 (24h59m30.539341824s) [noise=true , address=145.79.227.12:4767 , piece_id=I35QIZIMAJVZP3BXZWWX2DIB6MBIWGK7B5D7RTP574MXXCKKRPPQ, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.645944979 (24h59m30.539653598s) [noise=true , address=145.79.227.7:4293 , piece_id=TD6R3CM5WFW3QSAJDLH63TPIC4EFU26RVVYW4ZLBWVN3X2R45EFQ, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.646319862 (24h59m30.540028481s) [noise=true , address=77.90.31.19:4844 , piece_id=ZY27INWPAQMNM5PBF3FWQCJ6PYNIFWP3EIFCVGLMV35L4Q3FLKFA, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:33.647021549 (24h59m30.540730188s) [noise=true , address=45.91.116.7:4011 , piece_id=WCWR2PFNB7GAC4GACH2B5CA3DFGJNGZS33ZQVTBR4C5V3GJXGHRQ, seg_pos={0 0}, upload=21920]: Uploading piece...
Jan 16 16:55:36.267254446 (24h59m33.160963065s) [upload=21920]: Next returned nil segment
Jan 16 16:55:36.267275917 (24h59m33.160984527s) [upload=21920]: Waiting for error group managing segments...
Jan 16 16:55:36.719359656 (24h59m33.613068265s) [noise=true , address=145.79.227.19:4078 , piece_id=SK2WEHKCSL7KFG5MROQ6KBX36X23CNCTWSUH4FY433WD4CNYJSXA, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:36.744494905 (24h59m33.638203514s) [noise=true , address=145.79.227.5:4223 , piece_id=2DR6L2U75VMWWXWI42KFJXQN3MBQQ6XLZ7TWI5YDFEQUPSRUEGXA, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:36.776003208 (24h59m33.669711817s) [noise=true , address=145.79.227.12:4767 , piece_id=I35QIZIMAJVZP3BXZWWX2DIB6MBIWGK7B5D7RTP574MXXCKKRPPQ, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:36.787154932 (24h59m33.680863541s) [noise=true , address=145.79.227.17:4972 , piece_id=RITVU56QWJPNXPBGM2DNMGPEDYQG5XFL6Q5HOTT2L6HSKFVFJYQA, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:36.788135138 (24h59m33.681843757s) [noise=true , address=145.79.227.44:4194 , piece_id=4BCH7BEZG32Q4AZ3PWJAS5BKYP2PAAB5SKCLVPMUOL4ETCT7YD6A, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:36.798431784 (24h59m33.692140393s) [noise=true , address=145.79.227.31:4797 , piece_id=M5JIYFUEF5AC6QSEXNRW3MFUPUDXMQ6ZNGPOMMAGLLPXGVF4VSQA, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:36.802466686 (24h59m33.696175295s) [noise=true , address=145.79.227.15:4875 , piece_id=SY3RLEN5YBT4HJJIZ3RN6FY7NNRUFLO3COTTNTYHQXZ3W4TIU3OA, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:36.836390188 (24h59m33.730098797s) [noise=true , address=45.91.116.11:4117 , piece_id=LXO4SL3LQWVHC7UFL6DA72PJSCVTK3UWWSFGFX3BAD2QL22EFWLQ, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:38.578370712 (24h59m35.472079331s) [noise=true , address=77.90.31.19:4844 , piece_id=ZY27INWPAQMNM5PBF3FWQCJ6PYNIFWP3EIFCVGLMV35L4Q3FLKFA, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:39.893138834 (24h59m36.786847443s) [noise=true , address=45.91.116.8:4046 , piece_id=GFDE3QAV6NJAZJWJARZTOB46WZXB63VMG43R26WTRF6LQPGW463Q, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:42.852199867 (24h59m39.745908487s) [noise=true , address=145.79.227.7:4293 , piece_id=TD6R3CM5WFW3QSAJDLH63TPIC4EFU26RVVYW4ZLBWVN3X2R45EFQ, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:44.383702764 (24h59m41.277411373s) [noise=true , address=145.79.227.6:4257 , piece_id=537IL4HWMQNIDXMDS67TW364RGJXXW4HUR6Q73AIFO27MVFJ2DRQ, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:46.783551600 (24h59m43.677260209s) [noise=true , address=45.91.116.9:4262 , piece_id=7XHE5QU2HMXJM54LM5WGGCQPUUEUO2HVMDWWPDHOFBHFL2SXRA2Q, seg_pos={0 0}, upload=21920]: Done uploading piece. err: <nil>
Jan 16 16:55:46.783573402 (24h59m43.677282011s) [seg_pos={0 0}, upload=21920]: Satisfied cohort requirements after 13 pieces
Jan 16 16:55:46.783761539 (24h59m43.677470149s) [noise=true , address=45.91.116.7:4011 , piece_id=WCWR2PFNB7GAC4GACH2B5CA3DFGJNGZS33ZQVTBR4C5V3GJXGHRQ, seg_pos={0 0}, upload=21920]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF
Jan 16 16:55:46.783768473 (24h59m43.677477083s) [noise=true , address=45.91.116.7:4011 , piece_id=WCWR2PFNB7GAC4GACH2B5CA3DFGJNGZS33ZQVTBR4C5V3GJXGHRQ, seg_pos={0 0}, upload=21920]: Long tail cancellation due to optimal threshold
Jan 16 16:55:46.783822786 (24h59m43.677531405s) [noise=true , address=145.79.227.37:4567 , piece_id=LGK2EZW5KVD5Y377I6ZJJ3SQMDMK2MEPQICJZJKB6CQST6BACFJQ, seg_pos={0 0}, upload=21920]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19uEj8XgtM7PdNP8KosTCF6H1dSrJ25x6fMshJHQbyrHzJ5sDS): protocol: expected piece hash; context canceled; EOF
Jan 16 16:55:46.783831022 (24h59m43.677539631s) [noise=true , address=145.79.227.37:4567 , piece_id=LGK2EZW5KVD5Y377I6ZJJ3SQMDMK2MEPQICJZJKB6CQST6BACFJQ, seg_pos={0 0}, upload=21920]: Long tail cancellation due to optimal threshold
Jan 16 16:55:46.784145270 (24h59m43.677853879s) [noise=true , address=145.79.227.36:4517 , piece_id=HTIPRCH3WIOKBG7VWKM2DHAQUF5G52XGGGQB35HIR3H7ADSHTZEA, seg_pos={0 0}, upload=21920]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HZjKTnjpeNU5B6muVHGrmWQS8GsyuYTW6cLxzNk5CGt3b8PJS): protocol: read tcp 188.166.225.170:42654->145.79.227.36:4517: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled
Jan 16 16:55:46.784151662 (24h59m43.677860271s) [noise=true , address=145.79.227.36:4517 , piece_id=HTIPRCH3WIOKBG7VWKM2DHAQUF5G52XGGGQB35HIR3H7ADSHTZEA, seg_pos={0 0}, upload=21920]: Long tail cancellation due to optimal threshold
Jan 16 16:55:46.784257414 (24h59m43.677966034s) [seg_pos={0 0}, upload=21920]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jan 16 16:55:46.784321946 (24h59m43.678030556s) [upload=21920]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 16 16:55:46.784326716 (24h59m43.678035325s) [upload=21920]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 16 16:55:48.828380853 (24h59m45.722089472s) [upload=21920]: Done uploading segments...
Jan 16 16:55:48.828462529 (24h59m45.722171148s) [upload=21920]: Upload finished. err: <nil>
Duration: 30.002477838s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
51 out of 60 is failed (threshold=6) [XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXXXXX.X..XXXX] duration:
5.000920713s trace:
https://jaeger.dev.storj.io/trace/7a28671f402cbfc6
FAIL (2026-01-16 16:55:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000941393s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
7.776020346s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:55:50 UTC)
orbiter warning: context deadline exceeded
Duration: 7.77604377s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
16.535779818s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:55:09 UTC)
orbiter warning: context deadline exceeded
Duration: 16.535835704s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.......X....................X...............................] duration:
21.897921674s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:55:03 UTC)
orbiter warning: context deadline exceeded
Duration: 21.897943855s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
50 out of 60 is failed (threshold=6) [.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXXXXX.X..XXX] duration:
5.001139853s trace:
https://jaeger.dev.storj.io/trace/72a3fd3112a3592f
FAIL (2026-01-16 16:54:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001152546s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
25.064368798s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:54:38 UTC)
orbiter warning: context deadline exceeded
Duration: 25.064397033s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [........X....................X..............................] duration:
30.096378999s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:54:38 UTC)
orbiter warning: context deadline exceeded
Duration: 30.096404598s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
50 out of 60 is failed (threshold=6) [X.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXXXXX.X..XX] duration:
5.00140144s trace:
https://jaeger.dev.storj.io/trace/609ae56ed06571e1
FAIL (2026-01-16 16:54:24 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001420156s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
18.971987189s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:54:01 UTC)
orbiter warning: context deadline exceeded
Duration: 18.972010134s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
50 out of 60 is failed (threshold=6) [XX.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXXXXX.X..X] duration:
5.001314776s trace:
https://jaeger.dev.storj.io/trace/2ff1c8ee11c2f113
FAIL (2026-01-16 16:53:43 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001374259s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
50 out of 60 is failed (threshold=6) [XXX.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXXXXX.X..] duration:
3.880900965s trace:
https://jaeger.dev.storj.io/trace/58677cdebc247ee3
FAIL (2026-01-16 16:53:24 UTC)
orbiter warning: context deadline exceeded
Duration: 3.880925122s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.........X....................X.............................] duration:
13.804737806s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:53:16 UTC)
orbiter warning: context deadline exceeded
Duration: 13.804764225s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
16.457806742s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:52:57 UTC)
orbiter warning: context deadline exceeded
Duration: 16.457833583s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..........X....................X............................] duration:
30.968776809s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:52:50 UTC)
orbiter warning: context deadline exceeded
Duration: 30.968802237s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
51 out of 60 is failed (threshold=6) [XXXX.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXXXXX.X.] duration:
4.467417558s trace:
https://jaeger.dev.storj.io/trace/58677cdebc247ee3
FAIL (2026-01-16 16:52:29 UTC)
orbiter warning: context deadline exceeded
Duration: 4.467442084s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
20.198231026s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:52:00 UTC)
orbiter warning: context deadline exceeded
Duration: 20.198258599s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [...........X....................X...........................] duration:
22.314793965s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:51:50 UTC)
orbiter warning: context deadline exceeded
Duration: 22.31484444s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
51 out of 60 is failed (threshold=6) [.XXXX.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXXXXX.X] duration:
5.001173515s trace:
https://jaeger.dev.storj.io/trace/58677cdebc247ee3
FAIL (2026-01-16 16:51:19 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001195707s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
17.000203625s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:50:50 UTC)
orbiter warning: context deadline exceeded
Duration: 17.000276705s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [............X....................X..........................] duration:
7.828138735s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:50:33 UTC)
orbiter warning: context deadline exceeded
Duration: 7.828166277s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
51 out of 60 is failed (threshold=6) [X.XXXX.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXXXXX.] duration:
3.776042638s trace:
https://jaeger.dev.storj.io/trace/3d0dbb7a1cce047a
FAIL (2026-01-16 16:50:12 UTC)
orbiter warning: context deadline exceeded
Duration: 3.776059842s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [.............X....................X.........................] duration:
11.494889966s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:50:12 UTC)
orbiter warning: context deadline exceeded
Duration: 11.494922699s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
16.793825325s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:49:56 UTC)
orbiter warning: context deadline exceeded
Duration: 16.793853087s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [..............X....................X........................] duration:
15.380397379s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:49:24 UTC)
orbiter warning: context deadline exceeded
Duration: 15.380422365s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
51 out of 60 is failed (threshold=6) [.X.XXXX.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXXXXX] duration:
5.001511711s trace:
https://jaeger.dev.storj.io/trace/3d0dbb7a1cce047a
FAIL (2026-01-16 16:49:09 UTC)
orbiter warning: context deadline exceeded
Duration: 5.001538924s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
16.245229603s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:48:57 UTC)
orbiter warning: context deadline exceeded
Duration: 16.24529139s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
20.152138262s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:48:37 UTC)
orbiter warning: context deadline exceeded
Duration: 20.15214851s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [X..............X....................X.......................] duration:
14.165859542s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:48:21 UTC)
orbiter warning: context deadline exceeded
Duration: 14.165895171s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
18.417602687s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:48:16 UTC)
orbiter warning: context deadline exceeded
Duration: 18.41763033s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
51 out of 60 is failed (threshold=6) [X.X.XXXX.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXXXX] duration:
5.000647616s trace:
https://jaeger.dev.storj.io/trace/181bf6a4f6c91cbe
FAIL (2026-01-16 16:48:09 UTC)
orbiter warning: context deadline exceeded
Duration: 5.000663607s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
15.04492227s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:47:43 UTC)
orbiter warning: context deadline exceeded
Duration: 15.044954271s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.X..............X....................X......................] duration:
19.538013494s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:47:42 UTC)
orbiter warning: context deadline exceeded
Duration: 19.538055204s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
50 out of 60 is failed (threshold=6) [.X.X.XXXX.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXXX] duration:
5.000535762s trace:
https://jaeger.dev.storj.io/trace/113536c6f8f4dbf9
FAIL (2026-01-16 16:47:32 UTC)
orbiter warning: context deadline exceeded
Duration: 5.000555169s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [..X..............X....................X.....................] duration:
14.317817714s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:47:21 UTC)
orbiter warning: context deadline exceeded
Duration: 14.317842471s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
15.295998195s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:47:06 UTC)
orbiter warning: context deadline exceeded
Duration: 15.296028642s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
50 out of 60 is failed (threshold=6) [X.X.X.XXXX.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XXX] duration:
5.000611836s trace:
https://jaeger.dev.storj.io/trace/31ec67597f2a7de4
FAIL (2026-01-16 16:47:05 UTC)
orbiter warning: context deadline exceeded
Duration: 5.000630101s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
14.375588933s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:46:49 UTC)
orbiter warning: context deadline exceeded
Duration: 14.375615895s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [...X..............X....................X....................] duration:
35.390014259s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:46:47 UTC)
orbiter warning: context deadline exceeded
Duration: 35.390039736s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
50 out of 60 is failed (threshold=6) [XX.X.X.XXXX.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.XX] duration:
5.000782038s trace:
https://jaeger.dev.storj.io/trace/1e3e4f1bd2d458de
FAIL (2026-01-16 16:46:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000806666s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
15.084084537s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:46:20 UTC)
orbiter warning: context deadline exceeded
Duration: 15.084111518s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
50 out of 60 is failed (threshold=6) [XXX.X.X.XXXX.XX.XXXX.XX.XXXXXXXX.XXXX.XXXXXXXXXXXXXXXXXXXX.X] duration:
5.001373708s trace:
https://jaeger.dev.storj.io/trace/ef30e1d328a8869
FAIL (2026-01-16 16:45:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001394529s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [....X..............X....................X...................] duration:
9.300374122s trace:
https://jaeger.dev.storj.io/trace/7c21759b617df8f1
FAIL (2026-01-16 16:45:25 UTC)
orbiter warning: context deadline exceeded
Duration: 9.300400623s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [X...................X.......................................] duration:
17.488238393s trace:
https://jaeger.dev.storj.io/trace/10b8cc1148adf877
FAIL (2026-01-16 16:45:14 UTC)
orbiter warning: context deadline exceeded
Duration: 17.488251228s
edge
gateway
us-select-1
|