Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.870915141s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:15:14 UTC) orbiter warning: context deadline exceeded Duration: 5.870942763s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.684311677s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:14:44 UTC) orbiter warning: context deadline exceeded Duration: 5.684334581s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X..X................................................] duration: 5.760152033s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:14:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 5.760182783s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 636.119995ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:14:41 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 636.146736ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 10.912454487s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:14:09 UTC) orbiter warning: context deadline exceeded Duration: 10.912486478s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........X..X...............................................] duration: 5.723705394s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:13:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 5.723731765s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 649.840398ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:13:33 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 649.876156ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.946735931s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:12:51 UTC) orbiter warning: context deadline exceeded Duration: 6.946773743s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........X..X..............................................] duration: 5.716833501s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:12:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 5.716862437s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.672992205s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:12:29 UTC) orbiter warning: context deadline exceeded Duration: 6.673019526s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........X..X.............................................] duration: 6.008945418s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:12:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 6.008974122s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 650.243437ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:12:21 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 650.265911ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............X..X............................................] duration: 5.813937445s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:12:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 5.813963164s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.694438339s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:11:57 UTC) orbiter warning: context deadline exceeded Duration: 6.694461443s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 632.991536ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:11:43 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 633.015351ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.710414222s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:11:15 UTC) orbiter warning: context deadline exceeded Duration: 6.710442134s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X..X...........................................] duration: 5.768068745s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:11:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 5.768093481s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 650.448377ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:11:10 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 650.461875ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 7.85295679s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:10:48 UTC) orbiter warning: context deadline exceeded Duration: 7.85298318s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 7.222844201s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:10:32 UTC) orbiter warning: context deadline exceeded Duration: 7.222874889s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X..X..........................................] duration: 5.725286393s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:10:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 5.725314797s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 649.561816ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:10:04 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 649.591973ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X..X.........................................] duration: 5.981337718s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:09:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 5.981361393s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.68591088s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:09:29 UTC) orbiter warning: context deadline exceeded Duration: 6.685930297s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 638.418742ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:09:06 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 638.442186ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X..X........................................] duration: 5.810651211s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:08:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 5.810670079s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 650.854083ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:08:30 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 650.88389ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.727679902s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:08:30 UTC) orbiter warning: context deadline exceeded Duration: 6.727704109s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X..X.......................................] duration: 6.880064235s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:08:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 6.880093392s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 637.471756ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:08:09 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 637.496642ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.83770118s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:07:58 UTC) orbiter warning: context deadline exceeded Duration: 6.837717543s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X..X......................................] duration: 5.726490431s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:07:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 5.726503957s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 645.497902ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:07:05 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 645.530012ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.584719748s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:06:46 UTC) orbiter warning: context deadline exceeded Duration: 6.584743995s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X..X.....................................] duration: 5.751509961s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:06:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 5.751535621s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 637.072741ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:06:20 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 637.100215ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 6.945466445s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:06:15 UTC) orbiter warning: context deadline exceeded Duration: 6.945491153s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 639.595277ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:05:40 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 639.628129ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X..X....................................] duration: 6.215489126s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:05:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 6.215519846s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [X.........................................................X.] duration: 7.066134026s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:05:16 UTC) orbiter warning: context deadline exceeded Duration: 7.066146479s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.X.........................................................X] duration: 1m0.000622424s trace: https://jaeger.dev.storj.io/trace/7e52f6d56fea8ea9 FAIL (2026-05-14 05:05:09 UTC) orbiter warning: context deadline exceeded Duration: 1m0.000638485s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 635.096421ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:05:08 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 635.12728ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 635.619959ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:04:41 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 635.640118ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X..X...................................] duration: 6.143736551s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:04:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 6.143761328s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 636.527222ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:04:22 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 636.548682ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 3.709102204s trace: https://jaeger.dev.storj.io/trace/7f202defd7407eb4 FAIL (2026-05-14 05:04:20 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.709124858s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 635.296266ms remote: "tcp:35.209.24.65:443" target: https://version.storj.io/ trace: https://jaeger.dev.storj.io/trace/61406304dd190e9e FAIL (2026-05-14 05:03:53 UTC) orbiter warning: Get "https://version.storj.io/": read tcp 188.166.225.170:46460->35.209.24.65:443: read: connection reset by peer Duration: 635.337745ms core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 3.906588065s trace: https://jaeger.dev.storj.io/trace/7f202defd7407eb4 FAIL (2026-05-14 05:03:41 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.90664875s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X..X..................................] duration: 6.376872042s trace: https://jaeger.dev.storj.io/trace/793bc7a1d93181c2 FAIL (2026-05-14 05:03:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== in May 14 04:37:54.692610915 (321h50m5.21343466s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentBegin May 14 04:37:54.930969401 (321h50m5.451793147s) [seg_pos={0 0}, upload=308354]: Begin upload segment... May 14 04:37:54.931049184 (321h50m5.451872979s) [seg_pos={0 0}, upload=308354]: Done begin upload segment. May 14 04:37:54.931156629 (321h50m5.451980374s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931187608 (321h50m5.452011383s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931318638 (321h50m5.452142383s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.931998635 (321h50m5.45282238s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932196884 (321h50m5.453020669s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932509510 (321h50m5.453333255s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.932689223 (321h50m5.453512968s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933251857 (321h50m5.454075612s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.933832485 (321h50m5.45465623s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934174568 (321h50m5.454998313s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934314514 (321h50m5.455138259s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934671185 (321h50m5.45549494s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.934686375 (321h50m5.45551013s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935183793 (321h50m5.456007538s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.935759361 (321h50m5.456583136s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:54.936232875 (321h50m5.45705662s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Uploading piece... May 14 04:37:56.659124982 (321h50m7.179948717s) [upload=308354]: Next returned nil segment May 14 04:37:56.659141724 (321h50m7.179965459s) [upload=308354]: Waiting for error group managing segments... May 14 04:37:56.945082708 (321h50m7.465906453s) [noise=true , address=145.79.227.25:4618 , piece_id=E2QGMZATAZ6GS7DPQMPAJC7TUADR7CDCCJIYY234WGW52USXV5SA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960510078 (321h50m7.481333823s) [noise=true , address=145.79.227.37:4566 , piece_id=RSMGGNYFY5VIWNS6FLHFCVKVOPTQP5QUL7E5LRG6AKWDVF2I3XAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.960815721 (321h50m7.481639466s) [noise=true , address=145.79.227.45:4230 , piece_id=L3UN5CZ4ZGTUOAPG6CQY4BNYHI2EEE65LRGARQXYIOOIABW4D2FQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.963554487 (321h50m7.484378232s) [noise=true , address=145.79.227.4:4190 , piece_id=Z2KPHHRAEFXQ54GO735E7RUJ64MERQY2NTHTWMXL6TYC4YG2W2IQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964875267 (321h50m7.485699012s) [noise=true , address=145.79.227.10:4405 , piece_id=3EBKQQDFUNITALD5I4QMTOL66EEMKNON5PQE3IRZZFTSJF5NWZ5Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.964957885 (321h50m7.48578163s) [noise=true , address=145.79.227.8:4332 , piece_id=QDDEHIDSKQQX7N4LVSCWGE4TUVCTYTH5T5KMMI547PJCZ7WMLBFA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.973697743 (321h50m7.494521478s) [noise=true , address=145.79.227.23:4546 , piece_id=3RJL2JPERMTZ5AGIEHJ2M5FXBDTSC6I4BNWLAWJSZQ5LUW7IY5HA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.976134162 (321h50m7.496957907s) [noise=true , address=145.79.227.21:4477 , piece_id=5MNJ3FKZH45LM6NJEWOMUVCAYXD44G4DMPBN53M5SY7KDO6FKZYQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:56.978984722 (321h50m7.499808457s) [noise=true , address=145.79.227.39:4013 , piece_id=O6XTGBJWAOB2537CRM3EQQSQUOAIJDP6ARCXEVIGHD7GI6ROOSAA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.017257796 (321h50m7.538081541s) [noise=true , address=145.79.227.48:4306 , piece_id=PXQCVJDKUWZTAYPON6DXBOEMV2GLQOD76HXZWZHWZEABFIMFAM7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.024480008 (321h50m7.545303753s) [noise=true , address=145.79.227.12:4771 , piece_id=6QYCXP4TRPQ3Q2UXFHOL5HA22ZAJWHLZYN33ILMHO4GHWTVHAQLA, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.027084668 (321h50m7.547908413s) [noise=true , address=145.79.227.51:4412 , piece_id=3AWOXCPOPTF6C3W4IVZTF6SAP44UUBESVOJHP457FJ66EJII7QZQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044769395 (321h50m7.56559314s) [noise=true , address=145.79.227.40:4054 , piece_id=K6JH7YWWHNRUR67J4JABEKROHEM56PM2VEXQWGKVPXBIHA3VBG4A, seg_pos={0 0}, upload=308354]: Done uploading piece. err: <nil> May 14 04:37:57.044787289 (321h50m7.565611024s) [seg_pos={0 0}, upload=308354]: Satisfied cohort requirements after 13 pieces May 14 04:37:57.044949048 (321h50m7.565772793s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1tdXgFPYY7uaVB2rqi5pTctyZpmXQcCpyMTkHy9q1r3H2T1BZN): protocol: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57844->45.91.116.8:4080: use of closed network connection May 14 04:37:57.044953506 (321h50m7.565777251s) [noise=true , address=45.91.116.8:4080 , piece_id=5THBVBHXGFAC4PR6EH2RKERCO4U7JA2IKAMGWGFICDQLE372XSVQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045112039 (321h50m7.565935774s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW): protocol: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37446->45.91.116.5:4297: use of closed network connection May 14 04:37:57.045119323 (321h50m7.565943068s) [noise=true , address=45.91.116.5:4297 , piece_id=SART3ZNQLIYXFX2Y5IZVAQMEVMHK4MXBXPXZT2X7D7TBWMA4OXOQ, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045126506 (321h50m7.565950251s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GwbsftFSLkxmX9qTjKAQvQ16WYTjn66q8sxCtoq7H8mvoG6Fj): protocol: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:41754->45.91.116.10:4082: use of closed network connection May 14 04:37:57.045133800 (321h50m7.565957545s) [noise=true , address=45.91.116.10:4082 , piece_id=HSVVFNYPI52SM3QRPBKTKRTQY6W3PGK2IMA46FUSQETPXWP4XH7Q, seg_pos={0 0}, upload=308354]: Long tail cancellation due to optimal threshold May 14 04:37:57.045209124 (321h50m7.566032869s) [seg_pos={0 0}, upload=308354]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> May 14 04:37:57.045309666 (321h50m7.566133411s) [upload=308354]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 14 04:37:57.045314124 (321h50m7.566137869s) [upload=308354]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 14 04:38:01.690068805 (321h50m12.21089255s) [upload=308354]: Done uploading segments... May 14 04:38:01.690154709 (321h50m12.210978454s) [upload=308354]: Upload finished. err: metaclient: context deadline exceeded Duration:* 6.37689704s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 16.669971135s trace: https://jaeger.dev.storj.io/trace/6cb443d3928d2110 FAIL (2026-05-14 05:03:25 UTC) orbiter warning: context deadline exceeded Duration: 16.670025087s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)