Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.699021611s trace: https://jaeger.dev.storj.io/trace/26edf54e939e970 FAIL (2026-01-13 10:57:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== an 13 10:27:58.408186422 (930h58m58.279269457s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 10:27:58.646330692 (930h58m58.517413727s) [seg_pos={0 0}, upload=814840]: Begin upload segment... Jan 13 10:27:58.646391258 (930h58m58.517474303s) [seg_pos={0 0}, upload=814840]: Done begin upload segment. Jan 13 10:27:58.646454538 (930h58m58.517537573s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.646473925 (930h58m58.51755696s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647050132 (930h58m58.518133167s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647393596 (930h58m58.518476641s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648088799 (930h58m58.519171834s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648541381 (930h58m58.519624426s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.649132316 (930h58m58.520215351s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650817144 (930h58m58.521900179s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650935891 (930h58m58.522018926s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652370643 (930h58m58.523453678s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652656386 (930h58m58.523739431s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.653934761 (930h58m58.525017796s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.654305877 (930h58m58.525388912s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.655277527 (930h58m58.526360572s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.658532194 (930h58m58.529615229s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.661697051 (930h58m58.532780086s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:28:00.490393026 (930h59m0.361476071s) [upload=814840]: Next returned nil segment Jan 13 10:28:00.490410380 (930h59m0.361493425s) [upload=814840]: Waiting for error group managing segments... Jan 13 10:28:00.787228480 (930h59m0.658311515s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.792526608 (930h59m0.663609654s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.801640662 (930h59m0.672723697s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.805972771 (930h59m0.677055806s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.816426246 (930h59m0.687509291s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.819742430 (930h59m0.690825475s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.826633591 (930h59m0.697716626s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.831071451 (930h59m0.702154496s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.883814340 (930h59m0.754897375s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.898714861 (930h59m0.769797896s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.912698137 (930h59m0.783781182s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.011874529 (930h59m0.882957574s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545340891 (930h59m1.416423946s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545362893 (930h59m1.416445928s) [seg_pos={0 0}, upload=814840]: Segment reached optimal threshold of 13 pieces. Jan 13 10:28:01.545551462 (930h59m1.416634497s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection Jan 13 10:28:01.545560739 (930h59m1.416643784s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545573574 (930h59m1.416656619s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection Jan 13 10:28:01.545579155 (930h59m1.41666219s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545669947 (930h59m1.416752992s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection Jan 13 10:28:01.545676480 (930h59m1.416759525s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545768705 (930h59m1.41685175s) [seg_pos={0 0}, upload=814840]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 10:28:01.545932858 (930h59m1.417015903s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 10:28:01.545941504 (930h59m1.41702455s) [upload=814840]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 10:28:01.830463272 (930h59m1.701546327s) [upload=814840]: Done uploading segments... Jan 13 10:28:01.830492568 (930h59m1.701575623s) [upload=814840]: Upload finished. err: <nil> Duration:* 5.69904193s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.097149572s trace: https://jaeger.dev.storj.io/trace/47e2785e526cc2e9 FAIL (2026-01-13 10:57:00 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.09727983s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.738501061s trace: https://jaeger.dev.storj.io/trace/47e2785e526cc2e9 FAIL (2026-01-13 10:56:41 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 5.738529906s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 17.46264456s trace: https://jaeger.dev.storj.io/trace/4043e5ecf3cbdbeb FAIL (2026-01-13 10:56:32 UTC) orbiter warning: context deadline exceeded Duration: 17.462713843s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.000782015s trace: https://jaeger.dev.storj.io/trace/64ab9b78bbcb3b6e FAIL (2026-01-13 10:56:30 UTC) orbiter warning: context deadline exceeded Duration: 5.000800021s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [X.........X.X..X.X........X.X..........X..........X.X.......] duration: 23.317272974s trace: https://jaeger.dev.storj.io/trace/59fc3b41d9254eb6 FAIL (2026-01-13 10:56:14 UTC) orbiter warning: context deadline exceeded Duration: 23.317291188s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.749368455s trace: https://jaeger.dev.storj.io/trace/26edf54e939e970 FAIL (2026-01-13 10:56:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== an 13 10:27:58.408186422 (930h58m58.279269457s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 10:27:58.646330692 (930h58m58.517413727s) [seg_pos={0 0}, upload=814840]: Begin upload segment... Jan 13 10:27:58.646391258 (930h58m58.517474303s) [seg_pos={0 0}, upload=814840]: Done begin upload segment. Jan 13 10:27:58.646454538 (930h58m58.517537573s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.646473925 (930h58m58.51755696s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647050132 (930h58m58.518133167s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647393596 (930h58m58.518476641s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648088799 (930h58m58.519171834s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648541381 (930h58m58.519624426s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.649132316 (930h58m58.520215351s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650817144 (930h58m58.521900179s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650935891 (930h58m58.522018926s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652370643 (930h58m58.523453678s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652656386 (930h58m58.523739431s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.653934761 (930h58m58.525017796s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.654305877 (930h58m58.525388912s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.655277527 (930h58m58.526360572s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.658532194 (930h58m58.529615229s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.661697051 (930h58m58.532780086s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:28:00.490393026 (930h59m0.361476071s) [upload=814840]: Next returned nil segment Jan 13 10:28:00.490410380 (930h59m0.361493425s) [upload=814840]: Waiting for error group managing segments... Jan 13 10:28:00.787228480 (930h59m0.658311515s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.792526608 (930h59m0.663609654s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.801640662 (930h59m0.672723697s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.805972771 (930h59m0.677055806s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.816426246 (930h59m0.687509291s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.819742430 (930h59m0.690825475s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.826633591 (930h59m0.697716626s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.831071451 (930h59m0.702154496s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.883814340 (930h59m0.754897375s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.898714861 (930h59m0.769797896s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.912698137 (930h59m0.783781182s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.011874529 (930h59m0.882957574s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545340891 (930h59m1.416423946s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545362893 (930h59m1.416445928s) [seg_pos={0 0}, upload=814840]: Segment reached optimal threshold of 13 pieces. Jan 13 10:28:01.545551462 (930h59m1.416634497s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection Jan 13 10:28:01.545560739 (930h59m1.416643784s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545573574 (930h59m1.416656619s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection Jan 13 10:28:01.545579155 (930h59m1.41666219s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545669947 (930h59m1.416752992s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection Jan 13 10:28:01.545676480 (930h59m1.416759525s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545768705 (930h59m1.41685175s) [seg_pos={0 0}, upload=814840]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 10:28:01.545932858 (930h59m1.417015903s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 10:28:01.545941504 (930h59m1.41702455s) [upload=814840]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 10:28:01.830463272 (930h59m1.701546327s) [upload=814840]: Done uploading segments... Jan 13 10:28:01.830492568 (930h59m1.701575623s) [upload=814840]: Upload finished. err: <nil> Duration:* 5.749393612s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.004131673s trace: https://jaeger.dev.storj.io/trace/3f837de338563fb8 FAIL (2026-01-13 10:55:40 UTC) orbiter warning: context deadline exceeded Duration: 5.004155628s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [X.....................................X.....................] duration: 29.449920172s trace: https://jaeger.dev.storj.io/trace/4043e5ecf3cbdbeb FAIL (2026-01-13 10:55:35 UTC) orbiter warning: context deadline exceeded Duration: 29.44994022s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 8.602951668s trace: https://jaeger.dev.storj.io/trace/47e2785e526cc2e9 FAIL (2026-01-13 10:55:35 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 8.602975593s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.665476878s trace: https://jaeger.dev.storj.io/trace/26edf54e939e970 FAIL (2026-01-13 10:55:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== an 13 10:27:58.408186422 (930h58m58.279269457s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 10:27:58.646330692 (930h58m58.517413727s) [seg_pos={0 0}, upload=814840]: Begin upload segment... Jan 13 10:27:58.646391258 (930h58m58.517474303s) [seg_pos={0 0}, upload=814840]: Done begin upload segment. Jan 13 10:27:58.646454538 (930h58m58.517537573s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.646473925 (930h58m58.51755696s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647050132 (930h58m58.518133167s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647393596 (930h58m58.518476641s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648088799 (930h58m58.519171834s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648541381 (930h58m58.519624426s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.649132316 (930h58m58.520215351s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650817144 (930h58m58.521900179s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650935891 (930h58m58.522018926s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652370643 (930h58m58.523453678s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652656386 (930h58m58.523739431s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.653934761 (930h58m58.525017796s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.654305877 (930h58m58.525388912s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.655277527 (930h58m58.526360572s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.658532194 (930h58m58.529615229s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.661697051 (930h58m58.532780086s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:28:00.490393026 (930h59m0.361476071s) [upload=814840]: Next returned nil segment Jan 13 10:28:00.490410380 (930h59m0.361493425s) [upload=814840]: Waiting for error group managing segments... Jan 13 10:28:00.787228480 (930h59m0.658311515s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.792526608 (930h59m0.663609654s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.801640662 (930h59m0.672723697s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.805972771 (930h59m0.677055806s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.816426246 (930h59m0.687509291s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.819742430 (930h59m0.690825475s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.826633591 (930h59m0.697716626s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.831071451 (930h59m0.702154496s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.883814340 (930h59m0.754897375s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.898714861 (930h59m0.769797896s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.912698137 (930h59m0.783781182s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.011874529 (930h59m0.882957574s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545340891 (930h59m1.416423946s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545362893 (930h59m1.416445928s) [seg_pos={0 0}, upload=814840]: Segment reached optimal threshold of 13 pieces. Jan 13 10:28:01.545551462 (930h59m1.416634497s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection Jan 13 10:28:01.545560739 (930h59m1.416643784s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545573574 (930h59m1.416656619s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection Jan 13 10:28:01.545579155 (930h59m1.41666219s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545669947 (930h59m1.416752992s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection Jan 13 10:28:01.545676480 (930h59m1.416759525s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545768705 (930h59m1.41685175s) [seg_pos={0 0}, upload=814840]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 10:28:01.545932858 (930h59m1.417015903s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 10:28:01.545941504 (930h59m1.41702455s) [upload=814840]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 10:28:01.830463272 (930h59m1.701546327s) [upload=814840]: Done uploading segments... Jan 13 10:28:01.830492568 (930h59m1.701575623s) [upload=814840]: Upload finished. err: <nil> Duration:* 5.665516824s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.X.....................................X....................] duration: 14.743075373s trace: https://jaeger.dev.storj.io/trace/4043e5ecf3cbdbeb FAIL (2026-01-13 10:54:59 UTC) orbiter warning: context deadline exceeded Duration: 14.743102594s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [.X.........X.X..X.X........X.X..........X..........X.X......] duration: 18.197929095s trace: https://jaeger.dev.storj.io/trace/59fc3b41d9254eb6 FAIL (2026-01-13 10:54:58 UTC) orbiter warning: context deadline exceeded Duration: 18.197956379s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001162541s trace: https://jaeger.dev.storj.io/trace/5b5ac233e4184614 FAIL (2026-01-13 10:54:46 UTC) orbiter warning: context deadline exceeded Duration: 5.001190092s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.736757392s trace: https://jaeger.dev.storj.io/trace/26edf54e939e970 FAIL (2026-01-13 10:54:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== an 13 10:27:58.408186422 (930h58m58.279269457s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 10:27:58.646330692 (930h58m58.517413727s) [seg_pos={0 0}, upload=814840]: Begin upload segment... Jan 13 10:27:58.646391258 (930h58m58.517474303s) [seg_pos={0 0}, upload=814840]: Done begin upload segment. Jan 13 10:27:58.646454538 (930h58m58.517537573s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.646473925 (930h58m58.51755696s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647050132 (930h58m58.518133167s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647393596 (930h58m58.518476641s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648088799 (930h58m58.519171834s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648541381 (930h58m58.519624426s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.649132316 (930h58m58.520215351s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650817144 (930h58m58.521900179s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650935891 (930h58m58.522018926s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652370643 (930h58m58.523453678s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652656386 (930h58m58.523739431s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.653934761 (930h58m58.525017796s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.654305877 (930h58m58.525388912s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.655277527 (930h58m58.526360572s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.658532194 (930h58m58.529615229s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.661697051 (930h58m58.532780086s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:28:00.490393026 (930h59m0.361476071s) [upload=814840]: Next returned nil segment Jan 13 10:28:00.490410380 (930h59m0.361493425s) [upload=814840]: Waiting for error group managing segments... Jan 13 10:28:00.787228480 (930h59m0.658311515s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.792526608 (930h59m0.663609654s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.801640662 (930h59m0.672723697s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.805972771 (930h59m0.677055806s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.816426246 (930h59m0.687509291s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.819742430 (930h59m0.690825475s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.826633591 (930h59m0.697716626s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.831071451 (930h59m0.702154496s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.883814340 (930h59m0.754897375s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.898714861 (930h59m0.769797896s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.912698137 (930h59m0.783781182s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.011874529 (930h59m0.882957574s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545340891 (930h59m1.416423946s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545362893 (930h59m1.416445928s) [seg_pos={0 0}, upload=814840]: Segment reached optimal threshold of 13 pieces. Jan 13 10:28:01.545551462 (930h59m1.416634497s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection Jan 13 10:28:01.545560739 (930h59m1.416643784s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545573574 (930h59m1.416656619s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection Jan 13 10:28:01.545579155 (930h59m1.41666219s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545669947 (930h59m1.416752992s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection Jan 13 10:28:01.545676480 (930h59m1.416759525s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545768705 (930h59m1.41685175s) [seg_pos={0 0}, upload=814840]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 10:28:01.545932858 (930h59m1.417015903s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 10:28:01.545941504 (930h59m1.41702455s) [upload=814840]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 10:28:01.830463272 (930h59m1.701546327s) [upload=814840]: Done uploading segments... Jan 13 10:28:01.830492568 (930h59m1.701575623s) [upload=814840]: Upload finished. err: <nil> Duration:* 5.736783823s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.977614324s trace: https://jaeger.dev.storj.io/trace/47e2785e526cc2e9 FAIL (2026-01-13 10:54:20 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 5.977642767s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.756068374s trace: https://jaeger.dev.storj.io/trace/26edf54e939e970 FAIL (2026-01-13 10:54:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== an 13 10:27:58.408186422 (930h58m58.279269457s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 10:27:58.646330692 (930h58m58.517413727s) [seg_pos={0 0}, upload=814840]: Begin upload segment... Jan 13 10:27:58.646391258 (930h58m58.517474303s) [seg_pos={0 0}, upload=814840]: Done begin upload segment. Jan 13 10:27:58.646454538 (930h58m58.517537573s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.646473925 (930h58m58.51755696s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647050132 (930h58m58.518133167s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647393596 (930h58m58.518476641s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648088799 (930h58m58.519171834s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648541381 (930h58m58.519624426s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.649132316 (930h58m58.520215351s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650817144 (930h58m58.521900179s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650935891 (930h58m58.522018926s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652370643 (930h58m58.523453678s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652656386 (930h58m58.523739431s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.653934761 (930h58m58.525017796s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.654305877 (930h58m58.525388912s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.655277527 (930h58m58.526360572s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.658532194 (930h58m58.529615229s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.661697051 (930h58m58.532780086s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:28:00.490393026 (930h59m0.361476071s) [upload=814840]: Next returned nil segment Jan 13 10:28:00.490410380 (930h59m0.361493425s) [upload=814840]: Waiting for error group managing segments... Jan 13 10:28:00.787228480 (930h59m0.658311515s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.792526608 (930h59m0.663609654s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.801640662 (930h59m0.672723697s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.805972771 (930h59m0.677055806s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.816426246 (930h59m0.687509291s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.819742430 (930h59m0.690825475s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.826633591 (930h59m0.697716626s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.831071451 (930h59m0.702154496s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.883814340 (930h59m0.754897375s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.898714861 (930h59m0.769797896s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.912698137 (930h59m0.783781182s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.011874529 (930h59m0.882957574s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545340891 (930h59m1.416423946s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545362893 (930h59m1.416445928s) [seg_pos={0 0}, upload=814840]: Segment reached optimal threshold of 13 pieces. Jan 13 10:28:01.545551462 (930h59m1.416634497s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection Jan 13 10:28:01.545560739 (930h59m1.416643784s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545573574 (930h59m1.416656619s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection Jan 13 10:28:01.545579155 (930h59m1.41666219s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545669947 (930h59m1.416752992s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection Jan 13 10:28:01.545676480 (930h59m1.416759525s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545768705 (930h59m1.41685175s) [seg_pos={0 0}, upload=814840]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 10:28:01.545932858 (930h59m1.417015903s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 10:28:01.545941504 (930h59m1.41702455s) [upload=814840]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 10:28:01.830463272 (930h59m1.701546327s) [upload=814840]: Done uploading segments... Jan 13 10:28:01.830492568 (930h59m1.701575623s) [upload=814840]: Upload finished. err: <nil> Duration:* 5.756099563s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [..X.........X.X..X.X........X.X..........X..........X.X.....] duration: 26.26586499s trace: https://jaeger.dev.storj.io/trace/59fc3b41d9254eb6 FAIL (2026-01-13 10:54:10 UTC) orbiter warning: context deadline exceeded Duration: 26.265878096s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..X.....................................X...................] duration: 22.6631598s trace: https://jaeger.dev.storj.io/trace/4043e5ecf3cbdbeb FAIL (2026-01-13 10:54:09 UTC) orbiter warning: context deadline exceeded Duration: 22.663184796s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.748029968s trace: https://jaeger.dev.storj.io/trace/26edf54e939e970 FAIL (2026-01-13 10:53:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== an 13 10:27:58.408186422 (930h58m58.279269457s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 10:27:58.646330692 (930h58m58.517413727s) [seg_pos={0 0}, upload=814840]: Begin upload segment... Jan 13 10:27:58.646391258 (930h58m58.517474303s) [seg_pos={0 0}, upload=814840]: Done begin upload segment. Jan 13 10:27:58.646454538 (930h58m58.517537573s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.646473925 (930h58m58.51755696s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647050132 (930h58m58.518133167s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647393596 (930h58m58.518476641s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648088799 (930h58m58.519171834s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648541381 (930h58m58.519624426s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.649132316 (930h58m58.520215351s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650817144 (930h58m58.521900179s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650935891 (930h58m58.522018926s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652370643 (930h58m58.523453678s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652656386 (930h58m58.523739431s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.653934761 (930h58m58.525017796s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.654305877 (930h58m58.525388912s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.655277527 (930h58m58.526360572s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.658532194 (930h58m58.529615229s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.661697051 (930h58m58.532780086s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:28:00.490393026 (930h59m0.361476071s) [upload=814840]: Next returned nil segment Jan 13 10:28:00.490410380 (930h59m0.361493425s) [upload=814840]: Waiting for error group managing segments... Jan 13 10:28:00.787228480 (930h59m0.658311515s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.792526608 (930h59m0.663609654s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.801640662 (930h59m0.672723697s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.805972771 (930h59m0.677055806s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.816426246 (930h59m0.687509291s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.819742430 (930h59m0.690825475s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.826633591 (930h59m0.697716626s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.831071451 (930h59m0.702154496s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.883814340 (930h59m0.754897375s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.898714861 (930h59m0.769797896s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.912698137 (930h59m0.783781182s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.011874529 (930h59m0.882957574s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545340891 (930h59m1.416423946s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545362893 (930h59m1.416445928s) [seg_pos={0 0}, upload=814840]: Segment reached optimal threshold of 13 pieces. Jan 13 10:28:01.545551462 (930h59m1.416634497s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection Jan 13 10:28:01.545560739 (930h59m1.416643784s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545573574 (930h59m1.416656619s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection Jan 13 10:28:01.545579155 (930h59m1.41666219s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545669947 (930h59m1.416752992s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection Jan 13 10:28:01.545676480 (930h59m1.416759525s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545768705 (930h59m1.41685175s) [seg_pos={0 0}, upload=814840]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 10:28:01.545932858 (930h59m1.417015903s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 10:28:01.545941504 (930h59m1.41702455s) [upload=814840]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 10:28:01.830463272 (930h59m1.701546327s) [upload=814840]: Done uploading segments... Jan 13 10:28:01.830492568 (930h59m1.701575623s) [upload=814840]: Upload finished. err: <nil> Duration:* 5.748057952s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXX] duration: 5.001002321s trace: https://jaeger.dev.storj.io/trace/60db768b50bf3b6f FAIL (2026-01-13 10:53:47 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001027319s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [...X.........X.X..X.X........X.X..........X..........X.X....] duration: 18.476334002s trace: https://jaeger.dev.storj.io/trace/59fc3b41d9254eb6 FAIL (2026-01-13 10:53:43 UTC) orbiter warning: context deadline exceeded Duration: 18.476360491s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [....X.........X.X..X.X........X.X..........X..........X.X...] duration: 24.130330855s trace: https://jaeger.dev.storj.io/trace/59fc3b41d9254eb6 FAIL (2026-01-13 10:53:25 UTC) orbiter warning: context deadline exceeded Duration: 24.130359139s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [...X.....................................X..................] duration: 21.002292663s trace: https://jaeger.dev.storj.io/trace/4043e5ecf3cbdbeb FAIL (2026-01-13 10:53:19 UTC) orbiter warning: context deadline exceeded Duration: 21.002320557s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 9.881764924s trace: https://jaeger.dev.storj.io/trace/47e2785e526cc2e9 FAIL (2026-01-13 10:53:19 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 9.881789922s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.795424462s trace: https://jaeger.dev.storj.io/trace/26edf54e939e970 FAIL (2026-01-13 10:52:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== an 13 10:27:58.408186422 (930h58m58.279269457s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 10:27:58.646330692 (930h58m58.517413727s) [seg_pos={0 0}, upload=814840]: Begin upload segment... Jan 13 10:27:58.646391258 (930h58m58.517474303s) [seg_pos={0 0}, upload=814840]: Done begin upload segment. Jan 13 10:27:58.646454538 (930h58m58.517537573s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.646473925 (930h58m58.51755696s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647050132 (930h58m58.518133167s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647393596 (930h58m58.518476641s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648088799 (930h58m58.519171834s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648541381 (930h58m58.519624426s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.649132316 (930h58m58.520215351s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650817144 (930h58m58.521900179s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650935891 (930h58m58.522018926s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652370643 (930h58m58.523453678s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652656386 (930h58m58.523739431s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.653934761 (930h58m58.525017796s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.654305877 (930h58m58.525388912s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.655277527 (930h58m58.526360572s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.658532194 (930h58m58.529615229s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.661697051 (930h58m58.532780086s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:28:00.490393026 (930h59m0.361476071s) [upload=814840]: Next returned nil segment Jan 13 10:28:00.490410380 (930h59m0.361493425s) [upload=814840]: Waiting for error group managing segments... Jan 13 10:28:00.787228480 (930h59m0.658311515s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.792526608 (930h59m0.663609654s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.801640662 (930h59m0.672723697s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.805972771 (930h59m0.677055806s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.816426246 (930h59m0.687509291s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.819742430 (930h59m0.690825475s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.826633591 (930h59m0.697716626s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.831071451 (930h59m0.702154496s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.883814340 (930h59m0.754897375s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.898714861 (930h59m0.769797896s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.912698137 (930h59m0.783781182s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.011874529 (930h59m0.882957574s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545340891 (930h59m1.416423946s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545362893 (930h59m1.416445928s) [seg_pos={0 0}, upload=814840]: Segment reached optimal threshold of 13 pieces. Jan 13 10:28:01.545551462 (930h59m1.416634497s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection Jan 13 10:28:01.545560739 (930h59m1.416643784s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545573574 (930h59m1.416656619s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection Jan 13 10:28:01.545579155 (930h59m1.41666219s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545669947 (930h59m1.416752992s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection Jan 13 10:28:01.545676480 (930h59m1.416759525s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545768705 (930h59m1.41685175s) [seg_pos={0 0}, upload=814840]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 10:28:01.545932858 (930h59m1.417015903s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 10:28:01.545941504 (930h59m1.41702455s) [upload=814840]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 10:28:01.830463272 (930h59m1.701546327s) [upload=814840]: Done uploading segments... Jan 13 10:28:01.830492568 (930h59m1.701575623s) [upload=814840]: Upload finished. err: <nil> Duration:* 5.795454127s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXX] duration: 5.001264515s trace: https://jaeger.dev.storj.io/trace/7818cbc4679ef758 FAIL (2026-01-13 10:52:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001295303s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [.....X.........X.X..X.X........X.X..........X..........X.X..] duration: 18.662028823s trace: https://jaeger.dev.storj.io/trace/59fc3b41d9254eb6 FAIL (2026-01-13 10:52:40 UTC) orbiter warning: context deadline exceeded Duration: 18.662051316s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [....X.....................................X.................] duration: 26.713907222s trace: https://jaeger.dev.storj.io/trace/4043e5ecf3cbdbeb FAIL (2026-01-13 10:52:29 UTC) orbiter warning: context deadline exceeded Duration: 26.713935517s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.463252503s trace: https://jaeger.dev.storj.io/trace/47e2785e526cc2e9 FAIL (2026-01-13 10:52:24 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.46328195s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXX] duration: 5.00084022s trace: https://jaeger.dev.storj.io/trace/4298f8445ddc1c9d FAIL (2026-01-13 10:52:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000863434s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXX] duration: 5.001271841s trace: https://jaeger.dev.storj.io/trace/b8e4c08cbc4e429 FAIL (2026-01-13 10:51:58 UTC) orbiter warning: context deadline exceeded Duration: 5.00128787s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.739932471s trace: https://jaeger.dev.storj.io/trace/26edf54e939e970 FAIL (2026-01-13 10:51:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== an 13 10:27:58.408186422 (930h58m58.279269457s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 10:27:58.646330692 (930h58m58.517413727s) [seg_pos={0 0}, upload=814840]: Begin upload segment... Jan 13 10:27:58.646391258 (930h58m58.517474303s) [seg_pos={0 0}, upload=814840]: Done begin upload segment. Jan 13 10:27:58.646454538 (930h58m58.517537573s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.646473925 (930h58m58.51755696s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647050132 (930h58m58.518133167s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647393596 (930h58m58.518476641s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648088799 (930h58m58.519171834s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648541381 (930h58m58.519624426s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.649132316 (930h58m58.520215351s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650817144 (930h58m58.521900179s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650935891 (930h58m58.522018926s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652370643 (930h58m58.523453678s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652656386 (930h58m58.523739431s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.653934761 (930h58m58.525017796s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.654305877 (930h58m58.525388912s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.655277527 (930h58m58.526360572s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.658532194 (930h58m58.529615229s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.661697051 (930h58m58.532780086s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:28:00.490393026 (930h59m0.361476071s) [upload=814840]: Next returned nil segment Jan 13 10:28:00.490410380 (930h59m0.361493425s) [upload=814840]: Waiting for error group managing segments... Jan 13 10:28:00.787228480 (930h59m0.658311515s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.792526608 (930h59m0.663609654s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.801640662 (930h59m0.672723697s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.805972771 (930h59m0.677055806s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.816426246 (930h59m0.687509291s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.819742430 (930h59m0.690825475s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.826633591 (930h59m0.697716626s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.831071451 (930h59m0.702154496s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.883814340 (930h59m0.754897375s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.898714861 (930h59m0.769797896s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.912698137 (930h59m0.783781182s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.011874529 (930h59m0.882957574s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545340891 (930h59m1.416423946s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545362893 (930h59m1.416445928s) [seg_pos={0 0}, upload=814840]: Segment reached optimal threshold of 13 pieces. Jan 13 10:28:01.545551462 (930h59m1.416634497s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection Jan 13 10:28:01.545560739 (930h59m1.416643784s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545573574 (930h59m1.416656619s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection Jan 13 10:28:01.545579155 (930h59m1.41666219s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545669947 (930h59m1.416752992s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection Jan 13 10:28:01.545676480 (930h59m1.416759525s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545768705 (930h59m1.41685175s) [seg_pos={0 0}, upload=814840]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 10:28:01.545932858 (930h59m1.417015903s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 10:28:01.545941504 (930h59m1.41702455s) [upload=814840]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 10:28:01.830463272 (930h59m1.701546327s) [upload=814840]: Done uploading segments... Jan 13 10:28:01.830492568 (930h59m1.701575623s) [upload=814840]: Upload finished. err: <nil> Duration:* 5.739948211s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [X.....X.........X.X..X.X........X.X..........X..........X.X.] duration: 27.112101088s trace: https://jaeger.dev.storj.io/trace/59fc3b41d9254eb6 FAIL (2026-01-13 10:51:38 UTC) orbiter warning: context deadline exceeded Duration: 27.112127569s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 8.538361146s trace: https://jaeger.dev.storj.io/trace/47e2785e526cc2e9 FAIL (2026-01-13 10:51:38 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 8.538430587s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.....X.....................................X................] duration: 14.956299031s trace: https://jaeger.dev.storj.io/trace/4043e5ecf3cbdbeb FAIL (2026-01-13 10:51:31 UTC) orbiter warning: context deadline exceeded Duration: 14.956377521s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.759041112s trace: https://jaeger.dev.storj.io/trace/26edf54e939e970 FAIL (2026-01-13 10:50:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== an 13 10:27:58.408186422 (930h58m58.279269457s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 10:27:58.646330692 (930h58m58.517413727s) [seg_pos={0 0}, upload=814840]: Begin upload segment... Jan 13 10:27:58.646391258 (930h58m58.517474303s) [seg_pos={0 0}, upload=814840]: Done begin upload segment. Jan 13 10:27:58.646454538 (930h58m58.517537573s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.646473925 (930h58m58.51755696s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647050132 (930h58m58.518133167s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647393596 (930h58m58.518476641s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648088799 (930h58m58.519171834s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648541381 (930h58m58.519624426s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.649132316 (930h58m58.520215351s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650817144 (930h58m58.521900179s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650935891 (930h58m58.522018926s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652370643 (930h58m58.523453678s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652656386 (930h58m58.523739431s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.653934761 (930h58m58.525017796s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.654305877 (930h58m58.525388912s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.655277527 (930h58m58.526360572s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.658532194 (930h58m58.529615229s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.661697051 (930h58m58.532780086s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:28:00.490393026 (930h59m0.361476071s) [upload=814840]: Next returned nil segment Jan 13 10:28:00.490410380 (930h59m0.361493425s) [upload=814840]: Waiting for error group managing segments... Jan 13 10:28:00.787228480 (930h59m0.658311515s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.792526608 (930h59m0.663609654s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.801640662 (930h59m0.672723697s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.805972771 (930h59m0.677055806s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.816426246 (930h59m0.687509291s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.819742430 (930h59m0.690825475s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.826633591 (930h59m0.697716626s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.831071451 (930h59m0.702154496s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.883814340 (930h59m0.754897375s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.898714861 (930h59m0.769797896s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.912698137 (930h59m0.783781182s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.011874529 (930h59m0.882957574s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545340891 (930h59m1.416423946s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545362893 (930h59m1.416445928s) [seg_pos={0 0}, upload=814840]: Segment reached optimal threshold of 13 pieces. Jan 13 10:28:01.545551462 (930h59m1.416634497s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection Jan 13 10:28:01.545560739 (930h59m1.416643784s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545573574 (930h59m1.416656619s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection Jan 13 10:28:01.545579155 (930h59m1.41666219s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545669947 (930h59m1.416752992s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection Jan 13 10:28:01.545676480 (930h59m1.416759525s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545768705 (930h59m1.41685175s) [seg_pos={0 0}, upload=814840]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 10:28:01.545932858 (930h59m1.417015903s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 10:28:01.545941504 (930h59m1.41702455s) [upload=814840]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 10:28:01.830463272 (930h59m1.701546327s) [upload=814840]: Done uploading segments... Jan 13 10:28:01.830492568 (930h59m1.701575623s) [upload=814840]: Upload finished. err: <nil> Duration:* 5.759070599s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 11 out of 60 is failed (threshold=3) [.X.....X.........X.X..X.X........X.X..........X..........X.X] duration: 30.000862453s trace: https://jaeger.dev.storj.io/trace/59fc3b41d9254eb6 FAIL (2026-01-13 10:50:50 UTC) orbiter warning: context deadline exceeded Duration: 30.000884296s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXX] duration: 5.001315652s trace: https://jaeger.dev.storj.io/trace/86757ea4c4ee215 FAIL (2026-01-13 10:50:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.001338386s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.436886516s trace: https://jaeger.dev.storj.io/trace/47e2785e526cc2e9 FAIL (2026-01-13 10:50:39 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.436929889s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [......X.....................................X...............] duration: 16.608157763s trace: https://jaeger.dev.storj.io/trace/4043e5ecf3cbdbeb FAIL (2026-01-13 10:50:34 UTC) orbiter warning: context deadline exceeded Duration: 16.608193071s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.50814984s trace: https://jaeger.dev.storj.io/trace/47e2785e526cc2e9 FAIL (2026-01-13 10:50:15 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.508161632s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.684720961s trace: https://jaeger.dev.storj.io/trace/26edf54e939e970 FAIL (2026-01-13 10:50:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== an 13 10:27:58.408186422 (930h58m58.279269457s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 10:27:58.646330692 (930h58m58.517413727s) [seg_pos={0 0}, upload=814840]: Begin upload segment... Jan 13 10:27:58.646391258 (930h58m58.517474303s) [seg_pos={0 0}, upload=814840]: Done begin upload segment. Jan 13 10:27:58.646454538 (930h58m58.517537573s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.646473925 (930h58m58.51755696s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647050132 (930h58m58.518133167s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647393596 (930h58m58.518476641s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648088799 (930h58m58.519171834s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648541381 (930h58m58.519624426s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.649132316 (930h58m58.520215351s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650817144 (930h58m58.521900179s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650935891 (930h58m58.522018926s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652370643 (930h58m58.523453678s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652656386 (930h58m58.523739431s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.653934761 (930h58m58.525017796s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.654305877 (930h58m58.525388912s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.655277527 (930h58m58.526360572s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.658532194 (930h58m58.529615229s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.661697051 (930h58m58.532780086s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:28:00.490393026 (930h59m0.361476071s) [upload=814840]: Next returned nil segment Jan 13 10:28:00.490410380 (930h59m0.361493425s) [upload=814840]: Waiting for error group managing segments... Jan 13 10:28:00.787228480 (930h59m0.658311515s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.792526608 (930h59m0.663609654s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.801640662 (930h59m0.672723697s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.805972771 (930h59m0.677055806s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.816426246 (930h59m0.687509291s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.819742430 (930h59m0.690825475s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.826633591 (930h59m0.697716626s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.831071451 (930h59m0.702154496s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.883814340 (930h59m0.754897375s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.898714861 (930h59m0.769797896s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.912698137 (930h59m0.783781182s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.011874529 (930h59m0.882957574s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545340891 (930h59m1.416423946s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545362893 (930h59m1.416445928s) [seg_pos={0 0}, upload=814840]: Segment reached optimal threshold of 13 pieces. Jan 13 10:28:01.545551462 (930h59m1.416634497s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection Jan 13 10:28:01.545560739 (930h59m1.416643784s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545573574 (930h59m1.416656619s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection Jan 13 10:28:01.545579155 (930h59m1.41666219s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545669947 (930h59m1.416752992s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection Jan 13 10:28:01.545676480 (930h59m1.416759525s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545768705 (930h59m1.41685175s) [seg_pos={0 0}, upload=814840]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 10:28:01.545932858 (930h59m1.417015903s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 10:28:01.545941504 (930h59m1.41702455s) [upload=814840]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 10:28:01.830463272 (930h59m1.701546327s) [upload=814840]: Done uploading segments... Jan 13 10:28:01.830492568 (930h59m1.701575623s) [upload=814840]: Upload finished. err: <nil> Duration:* 5.684811806s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXX] duration: 5.000509278s trace: https://jaeger.dev.storj.io/trace/13e864183ad78d0c FAIL (2026-01-13 10:49:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.000532223s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 10 out of 60 is failed (threshold=3) [..X.....X.........X.X..X.X........X.X..........X..........X.] duration: 25.423119974s trace: https://jaeger.dev.storj.io/trace/67b119e4507576c5 FAIL (2026-01-13 10:49:48 UTC) orbiter warning: context deadline exceeded Duration: 25.423145924s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.560980746s trace: https://jaeger.dev.storj.io/trace/47e2785e526cc2e9 FAIL (2026-01-13 10:49:45 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.561006996s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.......X.....................................X..............] duration: 9.814956634s trace: https://jaeger.dev.storj.io/trace/4043e5ecf3cbdbeb FAIL (2026-01-13 10:49:36 UTC) orbiter warning: context deadline exceeded Duration: 9.814984999s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.740777594s trace: https://jaeger.dev.storj.io/trace/26edf54e939e970 FAIL (2026-01-13 10:49:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== an 13 10:27:58.408186422 (930h58m58.279269457s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 13 10:27:58.646330692 (930h58m58.517413727s) [seg_pos={0 0}, upload=814840]: Begin upload segment... Jan 13 10:27:58.646391258 (930h58m58.517474303s) [seg_pos={0 0}, upload=814840]: Done begin upload segment. Jan 13 10:27:58.646454538 (930h58m58.517537573s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.646473925 (930h58m58.51755696s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647050132 (930h58m58.518133167s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.647393596 (930h58m58.518476641s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648088799 (930h58m58.519171834s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.648541381 (930h58m58.519624426s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.649132316 (930h58m58.520215351s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650817144 (930h58m58.521900179s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.650935891 (930h58m58.522018926s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652370643 (930h58m58.523453678s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.652656386 (930h58m58.523739431s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.653934761 (930h58m58.525017796s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.654305877 (930h58m58.525388912s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.655277527 (930h58m58.526360572s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.658532194 (930h58m58.529615229s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:27:58.661697051 (930h58m58.532780086s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Uploading piece... Jan 13 10:28:00.490393026 (930h59m0.361476071s) [upload=814840]: Next returned nil segment Jan 13 10:28:00.490410380 (930h59m0.361493425s) [upload=814840]: Waiting for error group managing segments... Jan 13 10:28:00.787228480 (930h59m0.658311515s) [noise=true , address=77.90.31.16:4735 , piece_id=NJAJCJVIY3AQW6343NUPRDQO5PC3AUQ6SK5HUYEQVXQW2MBDZ5SA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.792526608 (930h59m0.663609654s) [noise=true , address=145.79.227.19:4077 , piece_id=37PG6IGDB23X35D3BU4AHTZAFOVWNC25EKMU5U5K3M2X2OFXPRPQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.801640662 (930h59m0.672723697s) [noise=true , address=145.79.227.5:4221 , piece_id=KS7FJTYX67KZDH2J2RBP7BKY6YZDNSGBO3D7EFINRJKLPPCKKZ5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.805972771 (930h59m0.677055806s) [noise=true , address=145.79.227.4:4185 , piece_id=WNPO7CX5KPS6RVMTLLWL6BLD2QQDY6KVMDHORD4JA4ZHZJQULFCQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.816426246 (930h59m0.687509291s) [noise=true , address=145.79.227.51:4411 , piece_id=TH6EIG5APQSOAMN3ARGL74IU6YZFFNVUSVVSWM525HZIC6TAJ6VA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.819742430 (930h59m0.690825475s) [noise=true , address=145.79.227.48:4302 , piece_id=SKZR6QJ6YPPGVPDXURZMEOX4BIF4O3AGVD5ZEVYP7Z7Y5Q35AM5A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.826633591 (930h59m0.697716626s) [noise=true , address=145.79.227.21:4473 , piece_id=26L46PQ3JAEYDBMXPOGUSJLSCONN6Z3HX6TOYDMRMTAI2O2DVBIQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.831071451 (930h59m0.702154496s) [noise=true , address=145.79.227.44:4193 , piece_id=CVU7DBSS4VVSLYWGAESJ7R3DSYNTO3XOQKTGVZPFETF3MG4DBWWQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.883814340 (930h59m0.754897375s) [noise=true , address=145.79.227.35:4483 , piece_id=QAFNOD6VAC35OSVQ6Y2NPA4SZL432UYCJDVSFP3DNAGHD6UMWZUQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.898714861 (930h59m0.769797896s) [noise=true , address=145.79.227.38:4979 , piece_id=EDQMWT2QOHOAETJQIORDKXVORXF7LBHCVERA7NGU2N4I7TBQIFFA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:00.912698137 (930h59m0.783781182s) [noise=true , address=145.79.227.14:4839 , piece_id=O3FNWQVLUGIBHPSAXY34W3SMK5DS2T2PWKAHG4RUJAWDJXJOSDYQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.011874529 (930h59m0.882957574s) [noise=true , address=145.79.227.52:4446 , piece_id=LOZMZHIB72OFW4FCAAZ3ICJ4DVUNFZNT26BZZ244VJA53FTUFUZA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545340891 (930h59m1.416423946s) [noise=true , address=77.90.31.21:4880 , piece_id=R7COZDY42N3ET2MA7TBNH6STQX4HNKLPIYUJ5KSZBNEVSMAHZ56A, seg_pos={0 0}, upload=814840]: Done uploading piece. err: <nil> Jan 13 10:28:01.545362893 (930h59m1.416445928s) [seg_pos={0 0}, upload=814840]: Segment reached optimal threshold of 13 pieces. Jan 13 10:28:01.545551462 (930h59m1.416634497s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37832->45.91.116.14:4190: use of closed network connection Jan 13 10:28:01.545560739 (930h59m1.416643784s) [noise=true , address=45.91.116.14:4190 , piece_id=7PV5GC24U6MPJYOF5G3HUZROKC2ZFQDE2TE7EPCQLNXLRHESI6IQ, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545573574 (930h59m1.416656619s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KhBWMerZe9tUmzdVEYkBb6NmJ25dGP26Ea7CLjNJT5gdAeiah): protocol: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34902->145.79.227.26:4654: use of closed network connection Jan 13 10:28:01.545579155 (930h59m1.41666219s) [noise=true , address=145.79.227.26:4654 , piece_id=3ZDKMFRF6WBKNABL74723UNCR4UWPO3MHJ6GK6ILVFKSIPBS2EMA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545669947 (930h59m1.416752992s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37788->145.79.227.11:4730: use of closed network connection Jan 13 10:28:01.545676480 (930h59m1.416759525s) [noise=true , address=145.79.227.11:4730 , piece_id=CH4OVACXUIFE3HC5SWJLCSAVC6CE5LD2XJBYWCIGAY6MRSYFAWXA, seg_pos={0 0}, upload=814840]: Long tail cancellation due to optimal threshold Jan 13 10:28:01.545768705 (930h59m1.41685175s) [seg_pos={0 0}, upload=814840]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jan 13 10:28:01.545932858 (930h59m1.417015903s) [upload=814840]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 13 10:28:01.545941504 (930h59m1.41702455s) [upload=814840]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 13 10:28:01.830463272 (930h59m1.701546327s) [upload=814840]: Done uploading segments... Jan 13 10:28:01.830492568 (930h59m1.701575623s) [upload=814840]: Upload finished. err: <nil> Duration:* 5.740808584s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 58 out of 60 is failed (threshold=6) [XXXXXXXXXXXXX.XXXXXXXXXXXXXXXXXXXXXXXXXXXX.XXXXXXXXXXXXXXXXX] duration: 5.001309153s trace: https://jaeger.dev.storj.io/trace/1658844bd1dc120f FAIL (2026-01-13 10:49:22 UTC) orbiter warning: context deadline exceeded Duration: 5.001334333s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [........X.....................................X.............] duration: 13.949780631s trace: https://jaeger.dev.storj.io/trace/4043e5ecf3cbdbeb FAIL (2026-01-13 10:49:12 UTC) orbiter warning: context deadline exceeded Duration: 13.949807372s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)