Orbiter History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 651.594755ms remote: "tcp:34.4.32.59:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/68a242383b75c35d FAIL (2026-05-13 08:58:59 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 651.627086ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.921419275s trace: https://jaeger.dev.storj.io/trace/3821857227b01f0d FAIL (2026-05-13 08:58:58 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.921438984s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X...X.............................................] duration: 1.906516728s trace: https://jaeger.dev.storj.io/trace/6b68594ae31476df FAIL (2026-05-13 08:58:31 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.906542746s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.620097977s trace: https://jaeger.dev.storj.io/trace/f253484fd40b3cf FAIL (2026-05-13 08:58:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 52.886159919s) [upload=288931]: Starting upload May 13 08:23:42.365411428 (301h35m52.886235173s) [upload=288931]: Done starting upload May 13 08:23:42.365500037 (301h35m52.886323782s) [upload=288931]: Uploading segments... May 13 08:23:42.365647579 (301h35m52.886471334s) [upload=288931]: Got next segment. Inline: false May 13 08:23:42.365683176 (301h35m52.886506911s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 08:23:42.365687885 (301h35m52.88651163s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 08:23:42.598383896 (301h35m53.119207641s) [seg_pos={0 0}, upload=288931]: Begin upload segment... May 13 08:23:42.598464609 (301h35m53.119288344s) [seg_pos={0 0}, upload=288931]: Done begin upload segment. May 13 08:23:42.598489827 (301h35m53.119313562s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.598584227 (301h35m53.119407972s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599099290 (301h35m53.119923035s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599448427 (301h35m53.120272172s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599785570 (301h35m53.120609315s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600089149 (301h35m53.120912894s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600393219 (301h35m53.121216964s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600679686 (301h35m53.121503431s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601010748 (301h35m53.121834493s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601837916 (301h35m53.122661651s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.602900945 (301h35m53.12372469s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.603751337 (301h35m53.124575072s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.604687004 (301h35m53.125510749s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.605665119 (301h35m53.126488864s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.606795627 (301h35m53.127619372s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.607929281 (301h35m53.128753026s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:44.318577649 (301h35m54.839401394s) [upload=288931]: Next returned nil segment May 13 08:23:44.318598147 (301h35m54.839421892s) [upload=288931]: Waiting for error group managing segments... May 13 08:23:44.604157373 (301h35m55.124981108s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.616951337 (301h35m55.137775082s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.626138077 (301h35m55.146961822s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627298322 (301h35m55.148122067s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627592093 (301h35m55.148415838s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627893708 (301h35m55.148717453s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.630105298 (301h35m55.150929043s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.635153522 (301h35m55.155977267s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.639359247 (301h35m55.160182992s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.642768653 (301h35m55.163592388s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.669518538 (301h35m55.190342283s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.673346913 (301h35m55.194170658s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722674662 (301h35m55.243498407s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722697015 (301h35m55.24352076s) [seg_pos={0 0}, upload=288931]: Satisfied cohort requirements after 13 pieces May 13 08:23:44.722987831 (301h35m55.243811566s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.722997429 (301h35m55.243821174s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723038947 (301h35m55.243862692s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kwa9zxc9LDp78psKPNV55aP5RYvtcQi1NjphTkXBWRugwhg7s): protocol: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection May 13 08:23:44.723054898 (301h35m55.243878643s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723109372 (301h35m55.243933117s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.723116526 (301h35m55.243940281s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723129540 (301h35m55.243953285s) [seg_pos={0 0}, upload=288931]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 08:23:44.723189946 (301h35m55.244013691s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 08:23:44.723193784 (301h35m55.244017519s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 08:24:49.413522848 (301h36m59.934346603s) [upload=288931]: Done uploading segments... May 13 08:24:49.413641645 (301h36m59.93446539s) [upload=288931]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.620122052s core uplink us-select-1
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 431.021256ms target: http://timesync.objectmount.io/health trace: https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8 FAIL (2026-05-13 08:58:08 UTC) orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout Duration: 431.045192ms object-mount
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 663.07901ms remote: "tcp:34.4.32.59:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/68a242383b75c35d FAIL (2026-05-13 08:58:03 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 663.103807ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X...X............................................] duration: 1.912124119s trace: https://jaeger.dev.storj.io/trace/6b68594ae31476df FAIL (2026-05-13 08:57:57 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.912151741s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 1.939367546s trace: https://jaeger.dev.storj.io/trace/3821857227b01f0d FAIL (2026-05-13 08:57:52 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.939403464s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.713992624s trace: https://jaeger.dev.storj.io/trace/f253484fd40b3cf FAIL (2026-05-13 08:57:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 52.886159919s) [upload=288931]: Starting upload May 13 08:23:42.365411428 (301h35m52.886235173s) [upload=288931]: Done starting upload May 13 08:23:42.365500037 (301h35m52.886323782s) [upload=288931]: Uploading segments... May 13 08:23:42.365647579 (301h35m52.886471334s) [upload=288931]: Got next segment. Inline: false May 13 08:23:42.365683176 (301h35m52.886506911s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 08:23:42.365687885 (301h35m52.88651163s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 08:23:42.598383896 (301h35m53.119207641s) [seg_pos={0 0}, upload=288931]: Begin upload segment... May 13 08:23:42.598464609 (301h35m53.119288344s) [seg_pos={0 0}, upload=288931]: Done begin upload segment. May 13 08:23:42.598489827 (301h35m53.119313562s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.598584227 (301h35m53.119407972s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599099290 (301h35m53.119923035s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599448427 (301h35m53.120272172s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599785570 (301h35m53.120609315s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600089149 (301h35m53.120912894s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600393219 (301h35m53.121216964s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600679686 (301h35m53.121503431s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601010748 (301h35m53.121834493s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601837916 (301h35m53.122661651s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.602900945 (301h35m53.12372469s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.603751337 (301h35m53.124575072s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.604687004 (301h35m53.125510749s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.605665119 (301h35m53.126488864s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.606795627 (301h35m53.127619372s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.607929281 (301h35m53.128753026s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:44.318577649 (301h35m54.839401394s) [upload=288931]: Next returned nil segment May 13 08:23:44.318598147 (301h35m54.839421892s) [upload=288931]: Waiting for error group managing segments... May 13 08:23:44.604157373 (301h35m55.124981108s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.616951337 (301h35m55.137775082s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.626138077 (301h35m55.146961822s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627298322 (301h35m55.148122067s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627592093 (301h35m55.148415838s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627893708 (301h35m55.148717453s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.630105298 (301h35m55.150929043s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.635153522 (301h35m55.155977267s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.639359247 (301h35m55.160182992s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.642768653 (301h35m55.163592388s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.669518538 (301h35m55.190342283s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.673346913 (301h35m55.194170658s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722674662 (301h35m55.243498407s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722697015 (301h35m55.24352076s) [seg_pos={0 0}, upload=288931]: Satisfied cohort requirements after 13 pieces May 13 08:23:44.722987831 (301h35m55.243811566s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.722997429 (301h35m55.243821174s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723038947 (301h35m55.243862692s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kwa9zxc9LDp78psKPNV55aP5RYvtcQi1NjphTkXBWRugwhg7s): protocol: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection May 13 08:23:44.723054898 (301h35m55.243878643s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723109372 (301h35m55.243933117s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.723116526 (301h35m55.243940281s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723129540 (301h35m55.243953285s) [seg_pos={0 0}, upload=288931]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 08:23:44.723189946 (301h35m55.244013691s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 08:23:44.723193784 (301h35m55.244017519s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 08:24:49.413522848 (301h36m59.934346603s) [upload=288931]: Done uploading segments... May 13 08:24:49.413641645 (301h36m59.93446539s) [upload=288931]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.714009566s core uplink us-select-1
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 425.058587ms target: http://timesync.objectmount.io/health trace: https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8 FAIL (2026-05-13 08:57:19 UTC) orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout Duration: 425.077174ms object-mount
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 658.931135ms remote: "tcp:34.4.32.59:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/68a242383b75c35d FAIL (2026-05-13 08:57:02 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 658.962595ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X...X...........................................] duration: 1.879104059s trace: https://jaeger.dev.storj.io/trace/6b68594ae31476df FAIL (2026-05-13 08:56:50 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.879131851s core uplink us-select-1
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 423.535561ms target: http://timesync.objectmount.io/health trace: https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8 FAIL (2026-05-13 08:56:44 UTC) orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout Duration: 423.560611ms object-mount
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.877274899s trace: https://jaeger.dev.storj.io/trace/3821857227b01f0d FAIL (2026-05-13 08:56:38 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.877290478s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 662.616859ms remote: "tcp:34.4.32.59:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/68a242383b75c35d FAIL (2026-05-13 08:56:37 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 662.671052ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.645093635s trace: https://jaeger.dev.storj.io/trace/f253484fd40b3cf FAIL (2026-05-13 08:56:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 52.886159919s) [upload=288931]: Starting upload May 13 08:23:42.365411428 (301h35m52.886235173s) [upload=288931]: Done starting upload May 13 08:23:42.365500037 (301h35m52.886323782s) [upload=288931]: Uploading segments... May 13 08:23:42.365647579 (301h35m52.886471334s) [upload=288931]: Got next segment. Inline: false May 13 08:23:42.365683176 (301h35m52.886506911s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 08:23:42.365687885 (301h35m52.88651163s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 08:23:42.598383896 (301h35m53.119207641s) [seg_pos={0 0}, upload=288931]: Begin upload segment... May 13 08:23:42.598464609 (301h35m53.119288344s) [seg_pos={0 0}, upload=288931]: Done begin upload segment. May 13 08:23:42.598489827 (301h35m53.119313562s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.598584227 (301h35m53.119407972s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599099290 (301h35m53.119923035s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599448427 (301h35m53.120272172s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599785570 (301h35m53.120609315s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600089149 (301h35m53.120912894s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600393219 (301h35m53.121216964s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600679686 (301h35m53.121503431s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601010748 (301h35m53.121834493s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601837916 (301h35m53.122661651s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.602900945 (301h35m53.12372469s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.603751337 (301h35m53.124575072s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.604687004 (301h35m53.125510749s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.605665119 (301h35m53.126488864s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.606795627 (301h35m53.127619372s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.607929281 (301h35m53.128753026s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:44.318577649 (301h35m54.839401394s) [upload=288931]: Next returned nil segment May 13 08:23:44.318598147 (301h35m54.839421892s) [upload=288931]: Waiting for error group managing segments... May 13 08:23:44.604157373 (301h35m55.124981108s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.616951337 (301h35m55.137775082s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.626138077 (301h35m55.146961822s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627298322 (301h35m55.148122067s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627592093 (301h35m55.148415838s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627893708 (301h35m55.148717453s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.630105298 (301h35m55.150929043s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.635153522 (301h35m55.155977267s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.639359247 (301h35m55.160182992s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.642768653 (301h35m55.163592388s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.669518538 (301h35m55.190342283s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.673346913 (301h35m55.194170658s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722674662 (301h35m55.243498407s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722697015 (301h35m55.24352076s) [seg_pos={0 0}, upload=288931]: Satisfied cohort requirements after 13 pieces May 13 08:23:44.722987831 (301h35m55.243811566s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.722997429 (301h35m55.243821174s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723038947 (301h35m55.243862692s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kwa9zxc9LDp78psKPNV55aP5RYvtcQi1NjphTkXBWRugwhg7s): protocol: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection May 13 08:23:44.723054898 (301h35m55.243878643s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723109372 (301h35m55.243933117s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.723116526 (301h35m55.243940281s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723129540 (301h35m55.243953285s) [seg_pos={0 0}, upload=288931]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 08:23:44.723189946 (301h35m55.244013691s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 08:23:44.723193784 (301h35m55.244017519s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 08:24:49.413522848 (301h36m59.934346603s) [upload=288931]: Done uploading segments... May 13 08:24:49.413641645 (301h36m59.93446539s) [upload=288931]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.645118664s core uplink us-select-1
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 421.741457ms target: http://timesync.objectmount.io/health trace: https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8 FAIL (2026-05-13 08:55:47 UTC) orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout Duration: 421.803696ms object-mount
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.616857664s trace: https://jaeger.dev.storj.io/trace/f253484fd40b3cf FAIL (2026-05-13 08:55:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 52.886159919s) [upload=288931]: Starting upload May 13 08:23:42.365411428 (301h35m52.886235173s) [upload=288931]: Done starting upload May 13 08:23:42.365500037 (301h35m52.886323782s) [upload=288931]: Uploading segments... May 13 08:23:42.365647579 (301h35m52.886471334s) [upload=288931]: Got next segment. Inline: false May 13 08:23:42.365683176 (301h35m52.886506911s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 08:23:42.365687885 (301h35m52.88651163s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 08:23:42.598383896 (301h35m53.119207641s) [seg_pos={0 0}, upload=288931]: Begin upload segment... May 13 08:23:42.598464609 (301h35m53.119288344s) [seg_pos={0 0}, upload=288931]: Done begin upload segment. May 13 08:23:42.598489827 (301h35m53.119313562s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.598584227 (301h35m53.119407972s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599099290 (301h35m53.119923035s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599448427 (301h35m53.120272172s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599785570 (301h35m53.120609315s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600089149 (301h35m53.120912894s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600393219 (301h35m53.121216964s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600679686 (301h35m53.121503431s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601010748 (301h35m53.121834493s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601837916 (301h35m53.122661651s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.602900945 (301h35m53.12372469s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.603751337 (301h35m53.124575072s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.604687004 (301h35m53.125510749s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.605665119 (301h35m53.126488864s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.606795627 (301h35m53.127619372s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.607929281 (301h35m53.128753026s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:44.318577649 (301h35m54.839401394s) [upload=288931]: Next returned nil segment May 13 08:23:44.318598147 (301h35m54.839421892s) [upload=288931]: Waiting for error group managing segments... May 13 08:23:44.604157373 (301h35m55.124981108s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.616951337 (301h35m55.137775082s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.626138077 (301h35m55.146961822s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627298322 (301h35m55.148122067s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627592093 (301h35m55.148415838s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627893708 (301h35m55.148717453s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.630105298 (301h35m55.150929043s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.635153522 (301h35m55.155977267s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.639359247 (301h35m55.160182992s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.642768653 (301h35m55.163592388s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.669518538 (301h35m55.190342283s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.673346913 (301h35m55.194170658s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722674662 (301h35m55.243498407s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722697015 (301h35m55.24352076s) [seg_pos={0 0}, upload=288931]: Satisfied cohort requirements after 13 pieces May 13 08:23:44.722987831 (301h35m55.243811566s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.722997429 (301h35m55.243821174s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723038947 (301h35m55.243862692s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kwa9zxc9LDp78psKPNV55aP5RYvtcQi1NjphTkXBWRugwhg7s): protocol: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection May 13 08:23:44.723054898 (301h35m55.243878643s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723109372 (301h35m55.243933117s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.723116526 (301h35m55.243940281s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723129540 (301h35m55.243953285s) [seg_pos={0 0}, upload=288931]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 08:23:44.723189946 (301h35m55.244013691s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 08:23:44.723193784 (301h35m55.244017519s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 08:24:49.413522848 (301h36m59.934346603s) [upload=288931]: Done uploading segments... May 13 08:24:49.413641645 (301h36m59.93446539s) [upload=288931]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.616875217s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.879351522s trace: https://jaeger.dev.storj.io/trace/3821857227b01f0d FAIL (2026-05-13 08:55:43 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.879388813s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X...X..........................................] duration: 1.890247954s trace: https://jaeger.dev.storj.io/trace/6b68594ae31476df FAIL (2026-05-13 08:55:40 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.890276188s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 652.326692ms remote: "tcp:34.4.32.59:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/68a242383b75c35d FAIL (2026-05-13 08:55:29 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 652.350366ms core satellite us1
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 423.245218ms target: http://timesync.objectmount.io/health trace: https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8 FAIL (2026-05-13 08:55:25 UTC) orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout Duration: 423.278672ms object-mount
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.902854341s trace: https://jaeger.dev.storj.io/trace/3821857227b01f0d FAIL (2026-05-13 08:55:20 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.902902743s core uplink us1
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 422.451224ms target: http://timesync.objectmount.io/health trace: https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8 FAIL (2026-05-13 08:55:09 UTC) orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout Duration: 422.479356ms object-mount
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.894203121s trace: https://jaeger.dev.storj.io/trace/3821857227b01f0d FAIL (2026-05-13 08:54:36 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.894233379s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X...X.........................................] duration: 1.872793171s trace: https://jaeger.dev.storj.io/trace/6b68594ae31476df FAIL (2026-05-13 08:54:32 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.872818438s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.70322046s trace: https://jaeger.dev.storj.io/trace/f253484fd40b3cf FAIL (2026-05-13 08:54:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 52.886159919s) [upload=288931]: Starting upload May 13 08:23:42.365411428 (301h35m52.886235173s) [upload=288931]: Done starting upload May 13 08:23:42.365500037 (301h35m52.886323782s) [upload=288931]: Uploading segments... May 13 08:23:42.365647579 (301h35m52.886471334s) [upload=288931]: Got next segment. Inline: false May 13 08:23:42.365683176 (301h35m52.886506911s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 08:23:42.365687885 (301h35m52.88651163s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 08:23:42.598383896 (301h35m53.119207641s) [seg_pos={0 0}, upload=288931]: Begin upload segment... May 13 08:23:42.598464609 (301h35m53.119288344s) [seg_pos={0 0}, upload=288931]: Done begin upload segment. May 13 08:23:42.598489827 (301h35m53.119313562s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.598584227 (301h35m53.119407972s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599099290 (301h35m53.119923035s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599448427 (301h35m53.120272172s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599785570 (301h35m53.120609315s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600089149 (301h35m53.120912894s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600393219 (301h35m53.121216964s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600679686 (301h35m53.121503431s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601010748 (301h35m53.121834493s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601837916 (301h35m53.122661651s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.602900945 (301h35m53.12372469s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.603751337 (301h35m53.124575072s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.604687004 (301h35m53.125510749s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.605665119 (301h35m53.126488864s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.606795627 (301h35m53.127619372s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.607929281 (301h35m53.128753026s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:44.318577649 (301h35m54.839401394s) [upload=288931]: Next returned nil segment May 13 08:23:44.318598147 (301h35m54.839421892s) [upload=288931]: Waiting for error group managing segments... May 13 08:23:44.604157373 (301h35m55.124981108s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.616951337 (301h35m55.137775082s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.626138077 (301h35m55.146961822s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627298322 (301h35m55.148122067s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627592093 (301h35m55.148415838s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627893708 (301h35m55.148717453s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.630105298 (301h35m55.150929043s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.635153522 (301h35m55.155977267s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.639359247 (301h35m55.160182992s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.642768653 (301h35m55.163592388s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.669518538 (301h35m55.190342283s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.673346913 (301h35m55.194170658s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722674662 (301h35m55.243498407s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722697015 (301h35m55.24352076s) [seg_pos={0 0}, upload=288931]: Satisfied cohort requirements after 13 pieces May 13 08:23:44.722987831 (301h35m55.243811566s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.722997429 (301h35m55.243821174s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723038947 (301h35m55.243862692s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kwa9zxc9LDp78psKPNV55aP5RYvtcQi1NjphTkXBWRugwhg7s): protocol: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection May 13 08:23:44.723054898 (301h35m55.243878643s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723109372 (301h35m55.243933117s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.723116526 (301h35m55.243940281s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723129540 (301h35m55.243953285s) [seg_pos={0 0}, upload=288931]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 08:23:44.723189946 (301h35m55.244013691s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 08:23:44.723193784 (301h35m55.244017519s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 08:24:49.413522848 (301h36m59.934346603s) [upload=288931]: Done uploading segments... May 13 08:24:49.413641645 (301h36m59.93446539s) [upload=288931]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.703242713s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 652.328915ms remote: "tcp:34.4.32.59:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/68a242383b75c35d FAIL (2026-05-13 08:54:28 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 652.346279ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X...X........................................] duration: 1.927942947s trace: https://jaeger.dev.storj.io/trace/6b68594ae31476df FAIL (2026-05-13 08:54:14 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.927964068s core uplink us-select-1
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 425.263839ms target: http://timesync.objectmount.io/health trace: https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8 FAIL (2026-05-13 08:54:10 UTC) orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout Duration: 425.29059ms object-mount
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.61452824s trace: https://jaeger.dev.storj.io/trace/f253484fd40b3cf FAIL (2026-05-13 08:54:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 52.886159919s) [upload=288931]: Starting upload May 13 08:23:42.365411428 (301h35m52.886235173s) [upload=288931]: Done starting upload May 13 08:23:42.365500037 (301h35m52.886323782s) [upload=288931]: Uploading segments... May 13 08:23:42.365647579 (301h35m52.886471334s) [upload=288931]: Got next segment. Inline: false May 13 08:23:42.365683176 (301h35m52.886506911s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 08:23:42.365687885 (301h35m52.88651163s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 08:23:42.598383896 (301h35m53.119207641s) [seg_pos={0 0}, upload=288931]: Begin upload segment... May 13 08:23:42.598464609 (301h35m53.119288344s) [seg_pos={0 0}, upload=288931]: Done begin upload segment. May 13 08:23:42.598489827 (301h35m53.119313562s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.598584227 (301h35m53.119407972s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599099290 (301h35m53.119923035s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599448427 (301h35m53.120272172s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599785570 (301h35m53.120609315s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600089149 (301h35m53.120912894s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600393219 (301h35m53.121216964s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600679686 (301h35m53.121503431s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601010748 (301h35m53.121834493s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601837916 (301h35m53.122661651s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.602900945 (301h35m53.12372469s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.603751337 (301h35m53.124575072s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.604687004 (301h35m53.125510749s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.605665119 (301h35m53.126488864s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.606795627 (301h35m53.127619372s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.607929281 (301h35m53.128753026s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:44.318577649 (301h35m54.839401394s) [upload=288931]: Next returned nil segment May 13 08:23:44.318598147 (301h35m54.839421892s) [upload=288931]: Waiting for error group managing segments... May 13 08:23:44.604157373 (301h35m55.124981108s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.616951337 (301h35m55.137775082s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.626138077 (301h35m55.146961822s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627298322 (301h35m55.148122067s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627592093 (301h35m55.148415838s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627893708 (301h35m55.148717453s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.630105298 (301h35m55.150929043s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.635153522 (301h35m55.155977267s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.639359247 (301h35m55.160182992s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.642768653 (301h35m55.163592388s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.669518538 (301h35m55.190342283s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.673346913 (301h35m55.194170658s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722674662 (301h35m55.243498407s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722697015 (301h35m55.24352076s) [seg_pos={0 0}, upload=288931]: Satisfied cohort requirements after 13 pieces May 13 08:23:44.722987831 (301h35m55.243811566s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.722997429 (301h35m55.243821174s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723038947 (301h35m55.243862692s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kwa9zxc9LDp78psKPNV55aP5RYvtcQi1NjphTkXBWRugwhg7s): protocol: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection May 13 08:23:44.723054898 (301h35m55.243878643s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723109372 (301h35m55.243933117s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.723116526 (301h35m55.243940281s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723129540 (301h35m55.243953285s) [seg_pos={0 0}, upload=288931]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 08:23:44.723189946 (301h35m55.244013691s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 08:23:44.723193784 (301h35m55.244017519s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 08:24:49.413522848 (301h36m59.934346603s) [upload=288931]: Done uploading segments... May 13 08:24:49.413641645 (301h36m59.93446539s) [upload=288931]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.614559269s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 1.884931079s trace: https://jaeger.dev.storj.io/trace/3821857227b01f0d FAIL (2026-05-13 08:54:06 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.884965604s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.625400527s trace: https://jaeger.dev.storj.io/trace/f253484fd40b3cf FAIL (2026-05-13 08:53:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 52.886159919s) [upload=288931]: Starting upload May 13 08:23:42.365411428 (301h35m52.886235173s) [upload=288931]: Done starting upload May 13 08:23:42.365500037 (301h35m52.886323782s) [upload=288931]: Uploading segments... May 13 08:23:42.365647579 (301h35m52.886471334s) [upload=288931]: Got next segment. Inline: false May 13 08:23:42.365683176 (301h35m52.886506911s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 08:23:42.365687885 (301h35m52.88651163s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 08:23:42.598383896 (301h35m53.119207641s) [seg_pos={0 0}, upload=288931]: Begin upload segment... May 13 08:23:42.598464609 (301h35m53.119288344s) [seg_pos={0 0}, upload=288931]: Done begin upload segment. May 13 08:23:42.598489827 (301h35m53.119313562s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.598584227 (301h35m53.119407972s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599099290 (301h35m53.119923035s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599448427 (301h35m53.120272172s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599785570 (301h35m53.120609315s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600089149 (301h35m53.120912894s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600393219 (301h35m53.121216964s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600679686 (301h35m53.121503431s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601010748 (301h35m53.121834493s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601837916 (301h35m53.122661651s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.602900945 (301h35m53.12372469s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.603751337 (301h35m53.124575072s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.604687004 (301h35m53.125510749s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.605665119 (301h35m53.126488864s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.606795627 (301h35m53.127619372s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.607929281 (301h35m53.128753026s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:44.318577649 (301h35m54.839401394s) [upload=288931]: Next returned nil segment May 13 08:23:44.318598147 (301h35m54.839421892s) [upload=288931]: Waiting for error group managing segments... May 13 08:23:44.604157373 (301h35m55.124981108s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.616951337 (301h35m55.137775082s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.626138077 (301h35m55.146961822s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627298322 (301h35m55.148122067s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627592093 (301h35m55.148415838s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627893708 (301h35m55.148717453s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.630105298 (301h35m55.150929043s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.635153522 (301h35m55.155977267s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.639359247 (301h35m55.160182992s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.642768653 (301h35m55.163592388s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.669518538 (301h35m55.190342283s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.673346913 (301h35m55.194170658s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722674662 (301h35m55.243498407s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722697015 (301h35m55.24352076s) [seg_pos={0 0}, upload=288931]: Satisfied cohort requirements after 13 pieces May 13 08:23:44.722987831 (301h35m55.243811566s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.722997429 (301h35m55.243821174s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723038947 (301h35m55.243862692s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kwa9zxc9LDp78psKPNV55aP5RYvtcQi1NjphTkXBWRugwhg7s): protocol: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection May 13 08:23:44.723054898 (301h35m55.243878643s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723109372 (301h35m55.243933117s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.723116526 (301h35m55.243940281s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723129540 (301h35m55.243953285s) [seg_pos={0 0}, upload=288931]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 08:23:44.723189946 (301h35m55.244013691s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 08:23:44.723193784 (301h35m55.244017519s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 08:24:49.413522848 (301h36m59.934346603s) [upload=288931]: Done uploading segments... May 13 08:24:49.413641645 (301h36m59.93446539s) [upload=288931]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.625424232s core uplink us-select-1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 659.393829ms remote: "tcp:34.4.32.59:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/68a242383b75c35d FAIL (2026-05-13 08:53:38 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 659.424988ms core satellite us1
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 421.874978ms target: http://timesync.objectmount.io/health trace: https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8 FAIL (2026-05-13 08:53:34 UTC) orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout Duration: 421.903743ms object-mount
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X...X.......................................] duration: 1.929638834s trace: https://jaeger.dev.storj.io/trace/6b68594ae31476df FAIL (2026-05-13 08:53:18 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.929658091s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 1.897623825s trace: https://jaeger.dev.storj.io/trace/3821857227b01f0d FAIL (2026-05-13 08:53:18 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.897648673s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 654.630845ms remote: "tcp:34.4.32.59:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/68a242383b75c35d FAIL (2026-05-13 08:53:02 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 654.657235ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.697210413s trace: https://jaeger.dev.storj.io/trace/f253484fd40b3cf FAIL (2026-05-13 08:52:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 52.886159919s) [upload=288931]: Starting upload May 13 08:23:42.365411428 (301h35m52.886235173s) [upload=288931]: Done starting upload May 13 08:23:42.365500037 (301h35m52.886323782s) [upload=288931]: Uploading segments... May 13 08:23:42.365647579 (301h35m52.886471334s) [upload=288931]: Got next segment. Inline: false May 13 08:23:42.365683176 (301h35m52.886506911s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 08:23:42.365687885 (301h35m52.88651163s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 08:23:42.598383896 (301h35m53.119207641s) [seg_pos={0 0}, upload=288931]: Begin upload segment... May 13 08:23:42.598464609 (301h35m53.119288344s) [seg_pos={0 0}, upload=288931]: Done begin upload segment. May 13 08:23:42.598489827 (301h35m53.119313562s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.598584227 (301h35m53.119407972s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599099290 (301h35m53.119923035s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599448427 (301h35m53.120272172s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599785570 (301h35m53.120609315s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600089149 (301h35m53.120912894s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600393219 (301h35m53.121216964s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600679686 (301h35m53.121503431s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601010748 (301h35m53.121834493s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601837916 (301h35m53.122661651s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.602900945 (301h35m53.12372469s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.603751337 (301h35m53.124575072s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.604687004 (301h35m53.125510749s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.605665119 (301h35m53.126488864s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.606795627 (301h35m53.127619372s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.607929281 (301h35m53.128753026s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:44.318577649 (301h35m54.839401394s) [upload=288931]: Next returned nil segment May 13 08:23:44.318598147 (301h35m54.839421892s) [upload=288931]: Waiting for error group managing segments... May 13 08:23:44.604157373 (301h35m55.124981108s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.616951337 (301h35m55.137775082s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.626138077 (301h35m55.146961822s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627298322 (301h35m55.148122067s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627592093 (301h35m55.148415838s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627893708 (301h35m55.148717453s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.630105298 (301h35m55.150929043s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.635153522 (301h35m55.155977267s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.639359247 (301h35m55.160182992s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.642768653 (301h35m55.163592388s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.669518538 (301h35m55.190342283s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.673346913 (301h35m55.194170658s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722674662 (301h35m55.243498407s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722697015 (301h35m55.24352076s) [seg_pos={0 0}, upload=288931]: Satisfied cohort requirements after 13 pieces May 13 08:23:44.722987831 (301h35m55.243811566s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.722997429 (301h35m55.243821174s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723038947 (301h35m55.243862692s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kwa9zxc9LDp78psKPNV55aP5RYvtcQi1NjphTkXBWRugwhg7s): protocol: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection May 13 08:23:44.723054898 (301h35m55.243878643s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723109372 (301h35m55.243933117s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.723116526 (301h35m55.243940281s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723129540 (301h35m55.243953285s) [seg_pos={0 0}, upload=288931]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 08:23:44.723189946 (301h35m55.244013691s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 08:23:44.723193784 (301h35m55.244017519s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 08:24:49.413522848 (301h36m59.934346603s) [upload=288931]: Done uploading segments... May 13 08:24:49.413641645 (301h36m59.93446539s) [upload=288931]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.697234168s core uplink us-select-1
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 423.026846ms target: http://timesync.objectmount.io/health trace: https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8 FAIL (2026-05-13 08:52:27 UTC) orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout Duration: 423.058225ms object-mount
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.901517997s trace: https://jaeger.dev.storj.io/trace/3821857227b01f0d FAIL (2026-05-13 08:52:23 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.901542482s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 661.911319ms remote: "tcp:34.4.32.59:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/68a242383b75c35d FAIL (2026-05-13 08:52:21 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 661.936627ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X...X......................................] duration: 1.876810584s trace: https://jaeger.dev.storj.io/trace/6b68594ae31476df FAIL (2026-05-13 08:52:06 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.87683s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 1.899723783s trace: https://jaeger.dev.storj.io/trace/3821857227b01f0d FAIL (2026-05-13 08:52:05 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.899740384s core uplink us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 659.61138ms remote: "tcp:34.4.32.59:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/68a242383b75c35d FAIL (2026-05-13 08:51:47 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 659.626249ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.888607069s trace: https://jaeger.dev.storj.io/trace/3821857227b01f0d FAIL (2026-05-13 08:51:42 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.888632238s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.791190318s trace: https://jaeger.dev.storj.io/trace/f253484fd40b3cf FAIL (2026-05-13 08:51:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 52.886159919s) [upload=288931]: Starting upload May 13 08:23:42.365411428 (301h35m52.886235173s) [upload=288931]: Done starting upload May 13 08:23:42.365500037 (301h35m52.886323782s) [upload=288931]: Uploading segments... May 13 08:23:42.365647579 (301h35m52.886471334s) [upload=288931]: Got next segment. Inline: false May 13 08:23:42.365683176 (301h35m52.886506911s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectBegin May 13 08:23:42.365687885 (301h35m52.88651163s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 13 08:23:42.598383896 (301h35m53.119207641s) [seg_pos={0 0}, upload=288931]: Begin upload segment... May 13 08:23:42.598464609 (301h35m53.119288344s) [seg_pos={0 0}, upload=288931]: Done begin upload segment. May 13 08:23:42.598489827 (301h35m53.119313562s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.598584227 (301h35m53.119407972s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599099290 (301h35m53.119923035s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599448427 (301h35m53.120272172s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.599785570 (301h35m53.120609315s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600089149 (301h35m53.120912894s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600393219 (301h35m53.121216964s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.600679686 (301h35m53.121503431s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601010748 (301h35m53.121834493s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.601837916 (301h35m53.122661651s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.602900945 (301h35m53.12372469s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.603751337 (301h35m53.124575072s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.604687004 (301h35m53.125510749s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.605665119 (301h35m53.126488864s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.606795627 (301h35m53.127619372s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:42.607929281 (301h35m53.128753026s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Uploading piece... May 13 08:23:44.318577649 (301h35m54.839401394s) [upload=288931]: Next returned nil segment May 13 08:23:44.318598147 (301h35m54.839421892s) [upload=288931]: Waiting for error group managing segments... May 13 08:23:44.604157373 (301h35m55.124981108s) [noise=true , address=145.79.227.50:4374 , piece_id=VU7FGWLJIQ6BJWLWR4V3FZ2OOKWZ4XUXXIK6UTIOXG4JQRS5QAVQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.616951337 (301h35m55.137775082s) [noise=true , address=145.79.227.45:4233 , piece_id=25YQOKEQLNYGD2DZBPWQD5HMUKBXEA2YMYVLRZWQVHCPXWKFOA3Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.626138077 (301h35m55.146961822s) [noise=true , address=145.79.227.7:4297 , piece_id=W2ZWVO5KC5ZJMC5LZKQ3ZBGEOBGE2Z7DN6BLRZCGPJ2LWDFEIAGA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627298322 (301h35m55.148122067s) [noise=true , address=145.79.227.3:4152 , piece_id=BZGI2SX3KLTQ5L74GQTXWJ3MXN5KLLFZKMPES5FRGGCLUD7XXV3A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627592093 (301h35m55.148415838s) [noise=true , address=145.79.227.52:4447 , piece_id=XTJJIUVCL2WH5TJ4CZRJAUETVQIYYB55KALFX46YG2FPOMLLOPUA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.627893708 (301h35m55.148717453s) [noise=true , address=145.79.227.6:4263 , piece_id=MPF6TBBYJ3IQVVBMS36BIV6PAITZ25AYM3TJAI2KO7XBZB2FN7WQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.630105298 (301h35m55.150929043s) [noise=true , address=145.79.227.39:4017 , piece_id=H2XFKXRSXEAG4WM7XDSYFLSHUOECVFXR47PBYVHW4DZLKJXWLU5A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.635153522 (301h35m55.155977267s) [noise=true , address=145.79.227.25:4619 , piece_id=3EFGZMPN4XP4F4U5OKK5VIYD44FT3WXQB73NZQL4LFYVQMTSUIVA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.639359247 (301h35m55.160182992s) [noise=true , address=145.79.227.4:4185 , piece_id=73P5QCJDK5IESMP53DQNMZHRSOHFDVYXEM6AWW7CWR7PDDKH4EXQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.642768653 (301h35m55.163592388s) [noise=true , address=145.79.227.31:4798 , piece_id=2ZEX5FUWBC2NYJJCGZ5UMPBGKKXNGXFH27CMWB7I55BWAQ4X33XQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.669518538 (301h35m55.190342283s) [noise=true , address=145.79.227.13:4804 , piece_id=GAB5UUUHLI3P6YSFVQ6HHBTPCTLQOPE6THKSHKZPSAHLI7G2QFHA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.673346913 (301h35m55.194170658s) [noise=true , address=145.79.227.26:4654 , piece_id=OYHDYSBP5LMUP6ZQONZNELXVOY53ZSJMG33ONRQLLFGYPFKR3P5Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722674662 (301h35m55.243498407s) [noise=true , address=77.90.31.15:4701 , piece_id=XQI7GRPTXPE35WKWKEQX72RSEQ74NMF7645CXJA2E5FKWWKHEI2A, seg_pos={0 0}, upload=288931]: Done uploading piece. err: <nil> May 13 08:23:44.722697015 (301h35m55.24352076s) [seg_pos={0 0}, upload=288931]: Satisfied cohort requirements after 13 pieces May 13 08:23:44.722987831 (301h35m55.243811566s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.722997429 (301h35m55.243821174s) [noise=true , address=77.90.31.13:4626 , piece_id=YS5MLLTJQBYQ6VCEKMYUNBVEIKVQAC7L22PRY2BRMLPA25IR3D7Q, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723038947 (301h35m55.243862692s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kwa9zxc9LDp78psKPNV55aP5RYvtcQi1NjphTkXBWRugwhg7s): protocol: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37572->45.91.116.4:4972: use of closed network connection May 13 08:23:44.723054898 (301h35m55.243878643s) [noise=true , address=45.91.116.4:4972 , piece_id=GHKQU3ZRVRBRIQ3SYS42DGTC2K3VQ3UHAGLBKST7QZYAH5LSEXLA, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723109372 (301h35m55.243933117s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF May 13 08:23:44.723116526 (301h35m55.243940281s) [noise=true , address=145.79.227.49:4340 , piece_id=VH6N2FJ76D6UQS3DBHRDBXVMMMHVL73MS5MMLF4X6ITFGIRZYMZQ, seg_pos={0 0}, upload=288931]: Long tail cancellation due to optimal threshold May 13 08:23:44.723129540 (301h35m55.243953285s) [seg_pos={0 0}, upload=288931]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 13 08:23:44.723189946 (301h35m55.244013691s) [upload=288931]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 13 08:23:44.723193784 (301h35m55.244017519s) [upload=288931]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 13 08:24:49.413522848 (301h36m59.934346603s) [upload=288931]: Done uploading segments... May 13 08:24:49.413641645 (301h36m59.93446539s) [upload=288931]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.791211568s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.920449215s trace: https://jaeger.dev.storj.io/trace/3821857227b01f0d FAIL (2026-05-13 08:51:26 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 1.920477579s core uplink us1
checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 431.907353ms target: http://timesync.objectmount.io/health trace: https://jaeger.dev.storj.io/trace/498a8e7089f2c4a8 FAIL (2026-05-13 08:51:25 UTC) orbiter warning: Get "http://timesync.objectmount.io/health": dial tcp 35.209.219.1:80: i/o timeout Duration: 431.934505ms object-mount
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 663.979176ms remote: "tcp:34.4.32.59:443" target: https://us1.storj.io/login trace: https://jaeger.dev.storj.io/trace/68a242383b75c35d FAIL (2026-05-13 08:51:08 UTC) orbiter warning: Get "https://us1.storj.io/login": EOF Duration: 664.001768ms core satellite us1

Orbiter Check History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "http://timesync.objectmount.io/health", ExpectedStatus: 200} failure (antiblip window 3/60): (http.timesync_objectmount_io_health)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)