Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................................................X...X...] duration:
1.96007121s trace:
https://jaeger.dev.storj.io/trace/6b68594ae31476df
FAIL (2026-05-13 08:26:29 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.960098791s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.884222018s trace:
https://jaeger.dev.storj.io/trace/3821857227b01f0d
FAIL (2026-05-13 08:26:20 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.884237507s
core
uplink
us1
|
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
427.768816ms target:
http://timesync.objectmount.io/health trace:
https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8
FAIL (2026-05-13 08:26:02 UTC)
orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout
Duration: 427.895037ms
object-mount
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.673768794s trace:
https://jaeger.dev.storj.io/trace/f253484fd40b3cf
FAIL (2026-05-13 08:25:46 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
52.886159919s) [upload=288931]: Starting upload
May 13 08:23:42.365411428 (301h35m52.886235173s) [upload=288931]: Done starting upload
May 13 08:23:42.365500037 (301h35m52.886323782s) [upload=288931]: Uploading segments...
May 13 08:23:42.365647579 (301h35m52.886471334s) [upload=288931]: Got next segment. Inline: false
May 13 08:23:42.365683176 (301h35m52.886506911s) [upload=288931]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 13 08:23:42.365687885 (301h35m52.88651163s) [upload=288931]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 13 08:23:42.598383896 (301h35m53.119207641s) [seg_pos={0 0}, upload=288931]: Begin upload segment...
May 13 08:23:42.598464609 (301h35m53.119288344s) [seg_pos={0 0}, upload=288931]: Done begin upload segment.
May 13 08:23:42.598489827 (301h35m53.119313562s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.598584227 (301h35m53.119407972s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.599099290 (301h35m53.119923035s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.599448427 (301h35m53.120272172s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.599785570 (301h35m53.120609315s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.600089149 (301h35m53.120912894s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.600393219 (301h35m53.121216964s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.600679686 (301h35m53.121503431s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.601010748 (301h35m53.121834493s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.601837916 (301h35m53.122661651s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.602900945 (301h35m53.12372469s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.603751337 (301h35m53.124575072s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.604687004 (301h35m53.125510749s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.605665119 (301h35m53.126488864s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.606795627 (301h35m53.127619372s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.607929281 (301h35m53.128753026s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:44.318577649 (301h35m54.839401394s) [upload=288931]: Next returned nil segment
May 13 08:23:44.318598147 (301h35m54.839421892s) [upload=288931]: Waiting for error group managing segments...
May 13 08:23:44.604157373 (301h35m55.124981108s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.616951337 (301h35m55.137775082s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.626138077 (301h35m55.146961822s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.627298322 (301h35m55.148122067s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.627592093 (301h35m55.148415838s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.627893708 (301h35m55.148717453s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.630105298 (301h35m55.150929043s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.635153522 (301h35m55.155977267s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.639359247 (301h35m55.160182992s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.642768653 (301h35m55.163592388s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.669518538 (301h35m55.190342283s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.673346913 (301h35m55.194170658s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.722674662 (301h35m55.243498407s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.722697015 (301h35m55.24352076s) [seg_pos={0 0}, upload=288931]: Satisfied cohort requirements after 13 pieces
May 13 08:23:44.722987831 (301h35m55.243811566s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
May 13 08:23:44.722997429 (301h35m55.243821174s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold
May 13 08:23:44.723038947 (301h35m55.243862692s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kwa9zxc9LDp78psKPNV55aP5RYvtcQi1NjphTkXBWRugwhg7s): protocol: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection
May 13 08:23:44.723054898 (301h35m55.243878643s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold
May 13 08:23:44.723109372 (301h35m55.243933117s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
May 13 08:23:44.723116526 (301h35m55.243940281s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold
May 13 08:23:44.723129540 (301h35m55.243953285s) [seg_pos={0 0}, upload=288931]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 13 08:23:44.723189946 (301h35m55.244013691s) [upload=288931]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 13 08:23:44.723193784 (301h35m55.244017519s) [upload=288931]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 13 08:24:49.413522848 (301h36m59.934346603s) [upload=288931]: Done uploading segments...
May 13 08:24:49.413641645 (301h36m59.93446539s) [upload=288931]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.673831964s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.911580833s trace:
https://jaeger.dev.storj.io/trace/3821857227b01f0d
FAIL (2026-05-13 08:25:42 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.911605059s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................................................X...X..] duration:
1.877277717s trace:
https://jaeger.dev.storj.io/trace/6b68594ae31476df
FAIL (2026-05-13 08:25:27 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 1.87730011s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.919316458s trace:
https://jaeger.dev.storj.io/trace/3821857227b01f0d
FAIL (2026-05-13 08:25:10 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.919350131s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.661963235s trace:
https://jaeger.dev.storj.io/trace/f253484fd40b3cf
FAIL (2026-05-13 08:24:55 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
52.886159919s) [upload=288931]: Starting upload
May 13 08:23:42.365411428 (301h35m52.886235173s) [upload=288931]: Done starting upload
May 13 08:23:42.365500037 (301h35m52.886323782s) [upload=288931]: Uploading segments...
May 13 08:23:42.365647579 (301h35m52.886471334s) [upload=288931]: Got next segment. Inline: false
May 13 08:23:42.365683176 (301h35m52.886506911s) [upload=288931]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 13 08:23:42.365687885 (301h35m52.88651163s) [upload=288931]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 13 08:23:42.598383896 (301h35m53.119207641s) [seg_pos={0 0}, upload=288931]: Begin upload segment...
May 13 08:23:42.598464609 (301h35m53.119288344s) [seg_pos={0 0}, upload=288931]: Done begin upload segment.
May 13 08:23:42.598489827 (301h35m53.119313562s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.598584227 (301h35m53.119407972s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.599099290 (301h35m53.119923035s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.599448427 (301h35m53.120272172s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.599785570 (301h35m53.120609315s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.600089149 (301h35m53.120912894s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.600393219 (301h35m53.121216964s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.600679686 (301h35m53.121503431s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.601010748 (301h35m53.121834493s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.601837916 (301h35m53.122661651s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.602900945 (301h35m53.12372469s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.603751337 (301h35m53.124575072s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.604687004 (301h35m53.125510749s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.605665119 (301h35m53.126488864s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.606795627 (301h35m53.127619372s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.607929281 (301h35m53.128753026s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:44.318577649 (301h35m54.839401394s) [upload=288931]: Next returned nil segment
May 13 08:23:44.318598147 (301h35m54.839421892s) [upload=288931]: Waiting for error group managing segments...
May 13 08:23:44.604157373 (301h35m55.124981108s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.616951337 (301h35m55.137775082s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.626138077 (301h35m55.146961822s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.627298322 (301h35m55.148122067s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.627592093 (301h35m55.148415838s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.627893708 (301h35m55.148717453s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.630105298 (301h35m55.150929043s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.635153522 (301h35m55.155977267s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.639359247 (301h35m55.160182992s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.642768653 (301h35m55.163592388s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.669518538 (301h35m55.190342283s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.673346913 (301h35m55.194170658s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.722674662 (301h35m55.243498407s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.722697015 (301h35m55.24352076s) [seg_pos={0 0}, upload=288931]: Satisfied cohort requirements after 13 pieces
May 13 08:23:44.722987831 (301h35m55.243811566s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
May 13 08:23:44.722997429 (301h35m55.243821174s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold
May 13 08:23:44.723038947 (301h35m55.243862692s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kwa9zxc9LDp78psKPNV55aP5RYvtcQi1NjphTkXBWRugwhg7s): protocol: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection
May 13 08:23:44.723054898 (301h35m55.243878643s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold
May 13 08:23:44.723109372 (301h35m55.243933117s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
May 13 08:23:44.723116526 (301h35m55.243940281s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold
May 13 08:23:44.723129540 (301h35m55.243953285s) [seg_pos={0 0}, upload=288931]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 13 08:23:44.723189946 (301h35m55.244013691s) [upload=288931]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 13 08:23:44.723193784 (301h35m55.244017519s) [upload=288931]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 13 08:24:49.413522848 (301h36m59.934346603s) [upload=288931]: Done uploading segments...
May 13 08:24:49.413641645 (301h36m59.93446539s) [upload=288931]: Upload finished. err: metaclient: context deadline exceeded
Duration: 5.66198229s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
423.115364ms target:
http://timesync.objectmount.io/health trace:
https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8
FAIL (2026-05-13 08:24:50 UTC)
orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout
Duration: 423.127117ms
object-mount
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m7.716915128s trace:
https://jaeger.dev.storj.io/trace/f253484fd40b3cf
FAIL (2026-05-13 08:24:49 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
52.886159919s) [upload=288931]: Starting upload
May 13 08:23:42.365411428 (301h35m52.886235173s) [upload=288931]: Done starting upload
May 13 08:23:42.365500037 (301h35m52.886323782s) [upload=288931]: Uploading segments...
May 13 08:23:42.365647579 (301h35m52.886471334s) [upload=288931]: Got next segment. Inline: false
May 13 08:23:42.365683176 (301h35m52.886506911s) [upload=288931]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
May 13 08:23:42.365687885 (301h35m52.88651163s) [upload=288931]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
May 13 08:23:42.598383896 (301h35m53.119207641s) [seg_pos={0 0}, upload=288931]: Begin upload segment...
May 13 08:23:42.598464609 (301h35m53.119288344s) [seg_pos={0 0}, upload=288931]: Done begin upload segment.
May 13 08:23:42.598489827 (301h35m53.119313562s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.598584227 (301h35m53.119407972s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.599099290 (301h35m53.119923035s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.599448427 (301h35m53.120272172s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.599785570 (301h35m53.120609315s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.600089149 (301h35m53.120912894s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.600393219 (301h35m53.121216964s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.600679686 (301h35m53.121503431s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.601010748 (301h35m53.121834493s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.601837916 (301h35m53.122661651s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.602900945 (301h35m53.12372469s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.603751337 (301h35m53.124575072s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.604687004 (301h35m53.125510749s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.605665119 (301h35m53.126488864s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.606795627 (301h35m53.127619372s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:42.607929281 (301h35m53.128753026s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Uploading piece...
May 13 08:23:44.318577649 (301h35m54.839401394s) [upload=288931]: Next returned nil segment
May 13 08:23:44.318598147 (301h35m54.839421892s) [upload=288931]: Waiting for error group managing segments...
May 13 08:23:44.604157373 (301h35m55.124981108s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.616951337 (301h35m55.137775082s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.626138077 (301h35m55.146961822s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.627298322 (301h35m55.148122067s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.627592093 (301h35m55.148415838s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.627893708 (301h35m55.148717453s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.630105298 (301h35m55.150929043s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.635153522 (301h35m55.155977267s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.639359247 (301h35m55.160182992s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.642768653 (301h35m55.163592388s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.669518538 (301h35m55.190342283s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.673346913 (301h35m55.194170658s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.722674662 (301h35m55.243498407s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil>
May 13 08:23:44.722697015 (301h35m55.24352076s) [seg_pos={0 0}, upload=288931]: Satisfied cohort requirements after 13 pieces
May 13 08:23:44.722987831 (301h35m55.243811566s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
May 13 08:23:44.722997429 (301h35m55.243821174s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold
May 13 08:23:44.723038947 (301h35m55.243862692s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kwa9zxc9LDp78psKPNV55aP5RYvtcQi1NjphTkXBWRugwhg7s): protocol: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection
May 13 08:23:44.723054898 (301h35m55.243878643s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold
May 13 08:23:44.723109372 (301h35m55.243933117s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF
May 13 08:23:44.723116526 (301h35m55.243940281s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold
May 13 08:23:44.723129540 (301h35m55.243953285s) [seg_pos={0 0}, upload=288931]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
May 13 08:23:44.723189946 (301h35m55.244013691s) [upload=288931]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 13 08:23:44.723193784 (301h35m55.244017519s) [upload=288931]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 13 08:24:49.413522848 (301h36m59.934346603s) [upload=288931]: Done uploading segments...
May 13 08:24:49.413641645 (301h36m59.93446539s) [upload=288931]: Upload finished. err: metaclient: context deadline exceeded
Duration: 1m7.716930098s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.8834822s trace:
https://jaeger.dev.storj.io/trace/3821857227b01f0d
FAIL (2026-05-13 08:24:47 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.883511945s
core
uplink
us1
|
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
19.522345397s target:
http://timesync.objectmount.io/health trace:
https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8
FAIL (2026-05-13 08:24:45 UTC)
orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout
Duration: 19.522374923s
object-mount
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................................................X...X.] duration:
5.202463456s trace:
https://jaeger.dev.storj.io/trace/6b68594ae31476df
FAIL (2026-05-13 08:24:44 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 5.202490429s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X...X] duration:
30.001648915s trace:
https://jaeger.dev.storj.io/trace/6b68594ae31476df
FAIL (2026-05-13 08:24:26 UTC)
orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS======
Duration: 30.001671959s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
7.36107062s trace:
https://jaeger.dev.storj.io/trace/3821857227b01f0d
FAIL (2026-05-13 08:24:18 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 7.361097191s
core
uplink
us1
|
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000559359s target:
http://timesync.objectmount.io/health trace:
https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8
FAIL (2026-05-13 08:24:14 UTC)
orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout
Duration: 30.000582544s
object-mount
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
3.161329794s trace:
https://jaeger.dev.storj.io/trace/3821857227b01f0d
FAIL (2026-05-13 08:23:55 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 3.161357577s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.891772065s trace:
https://jaeger.dev.storj.io/trace/23b99517182410b2
FAIL (2026-05-13 08:23:21 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== May 13 08:21:42.219985544 (301h33m52.74080929s) [upload=288896]: Starting upload May 13 08:21:42.220071909 (301h33m52.740895654s) [upload=288896]: Done starting upload May 13 08:21:42.220149767 (301h33m52.740973512s) [upload=288896]: Uploading segments... May 13 08:21:42.220206536 (301h33m52.741030281s) [upload=288896]: Got next segment. Inline: true May 13 08:21:42.220210734 (301h33m52.741034479s) [upload=288896]: Waiting for error group managing segments... May 13 08:21:42.220252825 (301h33m52.74107657s) [upload=288896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 13 08:21:42.220258515 (301h33m52.74108226s) [upload=288896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline May 13 08:21:42.220262332 (301h33m52.741086088s) [upload=288896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit May 13 08:21:45.406843074 (301h33m55.927666819s) [upload=288896]: Done uploading segments... May 13 08:21:45.406865937 (301h33m55.927689722s) [upload=288896]: Upload finished. err: <nil>
Duration: 1.891789258s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.907331347s trace:
https://jaeger.dev.storj.io/trace/3821857227b01f0d
FAIL (2026-05-13 08:23:12 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.907360703s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.926301425s trace:
https://jaeger.dev.storj.io/trace/3821857227b01f0d
FAIL (2026-05-13 08:22:51 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.926339118s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.926870221s trace:
https://jaeger.dev.storj.io/trace/23b99517182410b2
FAIL (2026-05-13 08:22:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== May 13 08:21:42.219985544 (301h33m52.74080929s) [upload=288896]: Starting upload May 13 08:21:42.220071909 (301h33m52.740895654s) [upload=288896]: Done starting upload May 13 08:21:42.220149767 (301h33m52.740973512s) [upload=288896]: Uploading segments... May 13 08:21:42.220206536 (301h33m52.741030281s) [upload=288896]: Got next segment. Inline: true May 13 08:21:42.220210734 (301h33m52.741034479s) [upload=288896]: Waiting for error group managing segments... May 13 08:21:42.220252825 (301h33m52.74107657s) [upload=288896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 13 08:21:42.220258515 (301h33m52.74108226s) [upload=288896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline May 13 08:21:42.220262332 (301h33m52.741086088s) [upload=288896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit May 13 08:21:45.406843074 (301h33m55.927666819s) [upload=288896]: Done uploading segments... May 13 08:21:45.406865937 (301h33m55.927689722s) [upload=288896]: Upload finished. err: <nil>
Duration: 1.926896982s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.913833465s trace:
https://jaeger.dev.storj.io/trace/3821857227b01f0d
FAIL (2026-05-13 08:22:20 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 1.913859645s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
23.282213571s trace:
https://jaeger.dev.storj.io/trace/3821857227b01f0d
FAIL (2026-05-13 08:22:16 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 23.282243186s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.973645971s trace:
https://jaeger.dev.storj.io/trace/23b99517182410b2
FAIL (2026-05-13 08:22:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== May 13 08:21:42.219985544 (301h33m52.74080929s) [upload=288896]: Starting upload May 13 08:21:42.220071909 (301h33m52.740895654s) [upload=288896]: Done starting upload May 13 08:21:42.220149767 (301h33m52.740973512s) [upload=288896]: Uploading segments... May 13 08:21:42.220206536 (301h33m52.741030281s) [upload=288896]: Got next segment. Inline: true May 13 08:21:42.220210734 (301h33m52.741034479s) [upload=288896]: Waiting for error group managing segments... May 13 08:21:42.220252825 (301h33m52.74107657s) [upload=288896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 13 08:21:42.220258515 (301h33m52.74108226s) [upload=288896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline May 13 08:21:42.220262332 (301h33m52.741086088s) [upload=288896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit May 13 08:21:45.406843074 (301h33m55.927666819s) [upload=288896]: Done uploading segments... May 13 08:21:45.406865937 (301h33m55.927689722s) [upload=288896]: Upload finished. err: <nil>
Duration: 1.973670367s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001098117s trace:
https://jaeger.dev.storj.io/trace/23b99517182410b2
FAIL (2026-05-13 08:21:57 UTC)
orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== May 13 08:21:42.219985544 (301h33m52.74080929s) [upload=288896]: Starting upload May 13 08:21:42.220071909 (301h33m52.740895654s) [upload=288896]: Done starting upload May 13 08:21:42.220149767 (301h33m52.740973512s) [upload=288896]: Uploading segments... May 13 08:21:42.220206536 (301h33m52.741030281s) [upload=288896]: Got next segment. Inline: true May 13 08:21:42.220210734 (301h33m52.741034479s) [upload=288896]: Waiting for error group managing segments... May 13 08:21:42.220252825 (301h33m52.74107657s) [upload=288896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin May 13 08:21:42.220258515 (301h33m52.74108226s) [upload=288896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline May 13 08:21:42.220262332 (301h33m52.741086088s) [upload=288896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit May 13 08:21:45.406843074 (301h33m55.927666819s) [upload=288896]: Done uploading segments... May 13 08:21:45.406865937 (301h33m55.927689722s) [upload=288896]: Upload finished. err: <nil>
Duration: 30.001118074s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001396609s trace:
https://jaeger.dev.storj.io/trace/3821857227b01f0d
FAIL (2026-05-13 08:21:45 UTC)
orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded
Duration: 30.001408813s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
3.778761348s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:30:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.778785803s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [XX..........................................................] duration:
3.96431407s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:29:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.964332717s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.XX.........................................................] duration:
3.8023822s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:28:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.802409351s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [..XX........................................................] duration:
3.834654403s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:27:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.834682897s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [...XX.......................................................] duration:
3.850142085s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:26:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.850168276s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [....XX......................................................] duration:
3.652862026s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:25:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.652892272s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.....XX.....................................................] duration:
3.426677241s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:24:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.426702619s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [......XX....................................................] duration:
3.393485101s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:23:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.393508666s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.659522136s trace:
https://jaeger.dev.storj.io/trace/7882d34a9fbf589a
FAIL (2026-05-13 07:23:45 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.659544869s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.873960829s trace:
https://jaeger.dev.storj.io/trace/7882d34a9fbf589a
FAIL (2026-05-13 07:23:05 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.873987961s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.......XX...................................................] duration:
4.340704116s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:22:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.340726278s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.168137233s trace:
https://jaeger.dev.storj.io/trace/7882d34a9fbf589a
FAIL (2026-05-13 07:22:31 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 6.168162612s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [........XX..................................................] duration:
3.341166491s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:22:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.341196648s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.892528605s trace:
https://jaeger.dev.storj.io/trace/7882d34a9fbf589a
FAIL (2026-05-13 07:22:01 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.892558341s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
6.451531239s trace:
https://jaeger.dev.storj.io/trace/7882d34a9fbf589a
FAIL (2026-05-13 07:21:24 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 6.451553082s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.........XX.................................................] duration:
3.444297551s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:21:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.444408653s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [..........XX................................................] duration:
3.418271738s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:20:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.41829379s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.557837842s trace:
https://jaeger.dev.storj.io/trace/7882d34a9fbf589a
FAIL (2026-05-13 07:20:40 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.557864304s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [...........XX...............................................] duration:
3.719474514s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:20:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.719497629s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.549839428s trace:
https://jaeger.dev.storj.io/trace/7882d34a9fbf589a
FAIL (2026-05-13 07:20:23 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.549865368s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [............XX..............................................] duration:
3.74346516s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:19:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.743488275s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.670021418s trace:
https://jaeger.dev.storj.io/trace/7882d34a9fbf589a
FAIL (2026-05-13 07:19:18 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.670044983s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.............XX.............................................] duration:
3.761145261s trace:
https://jaeger.dev.storj.io/trace/23c0cb01da439545
FAIL (2026-05-13 07:18:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.761172804s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.860663344s trace:
https://jaeger.dev.storj.io/trace/7882d34a9fbf589a
FAIL (2026-05-13 07:18:08 UTC)
orbiter warning: operation: ListObjects uplink: metainfo: metaclient: context deadline exceeded
Duration: 5.860691027s
core
uplink
us1
|