Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
4.623257228s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:57:03 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.623281363s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [..X................X........X....XX.........X.XX....X..X....] duration:
20.804207097s trace:
https://jaeger.dev.storj.io/trace/49ea3f4f4fc659ba
FAIL (2026-05-17 22:56:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 20.804243826s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
5.030081518s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:56:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 5.030105895s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [...X................X........X....XX.........X.XX....X..X...] duration:
6.86559889s trace:
https://jaeger.dev.storj.io/trace/49ea3f4f4fc659ba
FAIL (2026-05-17 22:55:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.865627753s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.019743513s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:55:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 5.019770404s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [....X................X........X....XX.........X.XX....X..X..] duration:
6.704491925s trace:
https://jaeger.dev.storj.io/trace/49ea3f4f4fc659ba
FAIL (2026-05-17 22:54:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.704517905s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
4.636252363s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:54:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.636279684s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
4.624565892s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:54:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.624589917s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [.....X................X........X....XX.........X.XX....X..X.] duration:
6.762794708s trace:
https://jaeger.dev.storj.io/trace/49ea3f4f4fc659ba
FAIL (2026-05-17 22:54:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.762805788s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [......X................X........X....XX.........X.XX....X..X] duration:
1m0.000653514s trace:
https://jaeger.dev.storj.io/trace/49ea3f4f4fc659ba
FAIL (2026-05-17 22:54:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.00066681s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
4.301023277s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:53:54 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.301049836s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
4.24446902s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:53:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.244494879s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.081163111s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:53:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 5.081188289s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
4.997678525s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:52:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.997702801s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [.......X................X........X....XX.........X.XX....X..] duration:
7.413579048s trace:
https://jaeger.dev.storj.io/trace/387183e1c95b8935
FAIL (2026-05-17 22:52:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.413598074s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
4.631355949s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:52:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.631400915s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [........X................X........X....XX.........X.XX....X.] duration:
6.645839637s trace:
https://jaeger.dev.storj.io/trace/387183e1c95b8935
FAIL (2026-05-17 22:52:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.645852211s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [.........X................X........X....XX.........X.XX....X] duration:
1m0.0014545s trace:
https://jaeger.dev.storj.io/trace/387183e1c95b8935
FAIL (2026-05-17 22:52:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.001479438s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
4.989203354s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:51:56 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.989226389s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
8 out of 60 is failed (threshold=3) [..........X................X........X....XX.........X.XX....] duration:
6.852594214s trace:
https://jaeger.dev.storj.io/trace/7438259d340e55f3
FAIL (2026-05-17 22:50:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.852606246s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.073349251s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:50:49 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 5.073373278s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
4.254764756s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:50:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.254789173s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [X..........X................X........X....XX.........X.XX...] duration:
50.160036575s trace:
https://jaeger.dev.storj.io/trace/7438259d340e55f3
FAIL (2026-05-17 22:50:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 50.160063807s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
4.636027652s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:49:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.636117363s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
3.801923183s trace:
https://jaeger.dev.storj.io/trace/65756aa66f3634b4
FAIL (2026-05-17 22:49:21 UTC)
orbiter warning: context deadline exceeded
Duration: 3.801949805s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.122580687s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:48:52 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 5.122627166s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [.X..........X................X........X....XX.........X.XX..] duration:
6.930888776s trace:
https://jaeger.dev.storj.io/trace/7438259d340e55f3
FAIL (2026-05-17 22:48:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.930913653s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
3.855413706s trace:
https://jaeger.dev.storj.io/trace/65756aa66f3634b4
FAIL (2026-05-17 22:48:10 UTC)
orbiter warning: context deadline exceeded
Duration: 3.855438722s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
4.568588162s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:47:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.568603052s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.06081277s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:47:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 5.060840451s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [X.X..........X................X........X....XX.........X.XX.] duration:
6.762054544s trace:
https://jaeger.dev.storj.io/trace/7438259d340e55f3
FAIL (2026-05-17 22:47:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.762067487s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
10 out of 60 is failed (threshold=3) [.X.X..........X................X........X....XX.........X.XX] duration:
1m0.000550868s trace:
https://jaeger.dev.storj.io/trace/7438259d340e55f3
FAIL (2026-05-17 22:47:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000562871s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
3.788263546s trace:
https://jaeger.dev.storj.io/trace/65756aa66f3634b4
FAIL (2026-05-17 22:47:21 UTC)
orbiter warning: context deadline exceeded
Duration: 3.788278855s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
3.686422042s trace:
https://jaeger.dev.storj.io/trace/65756aa66f3634b4
FAIL (2026-05-17 22:47:05 UTC)
orbiter warning: context deadline exceeded
Duration: 3.686508617s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
4.588616783s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:46:47 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.588644376s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
4.71639014s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:46:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.71641609s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
9 out of 60 is failed (threshold=3) [..X.X..........X................X........X....XX.........X.X] duration:
1m0.000519302s trace:
https://jaeger.dev.storj.io/trace/155d90e3cdd65b60
FAIL (2026-05-17 22:46:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000543087s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [X...X.......................................................] duration:
3.89228913s trace:
https://jaeger.dev.storj.io/trace/65756aa66f3634b4
FAIL (2026-05-17 22:46:10 UTC)
orbiter warning: context deadline exceeded
Duration: 3.892306723s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
4.592884998s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:45:37 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.592910218s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [.X...X......................................................] duration:
3.792565414s trace:
https://jaeger.dev.storj.io/trace/65756aa66f3634b4
FAIL (2026-05-17 22:45:34 UTC)
orbiter warning: context deadline exceeded
Duration: 3.79258963s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [..X...X.....................................................] duration:
3.659537511s trace:
https://jaeger.dev.storj.io/trace/65756aa66f3634b4
FAIL (2026-05-17 22:45:07 UTC)
orbiter warning: context deadline exceeded
Duration: 3.659564533s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
4.708378813s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:45:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.708400875s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.00715531s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:44:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 5.00718199s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
8 out of 60 is failed (threshold=3) [...X.X..........X................X........X....XX.........X.] duration:
6.63861071s trace:
https://jaeger.dev.storj.io/trace/69973142caecfc29
FAIL (2026-05-17 22:44:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.638627471s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
8 out of 60 is failed (threshold=3) [....X.X..........X................X........X....XX.........X] duration:
1m0.000952892s trace:
https://jaeger.dev.storj.io/trace/69973142caecfc29
FAIL (2026-05-17 22:44:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.000989892s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
4.570375377s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:44:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.570403149s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [...X...X....................................................] duration:
3.579383782s trace:
https://jaeger.dev.storj.io/trace/65756aa66f3634b4
FAIL (2026-05-17 22:44:00 UTC)
orbiter warning: context deadline exceeded
Duration: 3.579406615s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
4.291152871s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:43:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.291181125s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [....X...X...................................................] duration:
3.721002579s trace:
https://jaeger.dev.storj.io/trace/65756aa66f3634b4
FAIL (2026-05-17 22:43:12 UTC)
orbiter warning: context deadline exceeded
Duration: 3.721023288s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
4.697282729s trace:
https://jaeger.dev.storj.io/trace/76f682843bbf000c
FAIL (2026-05-17 22:42:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context canceled
======LOGS======
, upload=394782]: Uploading piece...
May 17 22:34:27.036102035 (411h46m37.55692578s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.036587391 (411h46m37.557411136s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037078427 (411h46m37.557902172s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.037484623 (411h46m37.558308368s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.038060963 (411h46m37.558884708s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.039286852 (411h46m37.560110597s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.040726409 (411h46m37.561550154s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.041849241 (411h46m37.562672986s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.043210408 (411h46m37.564034153s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.044433683 (411h46m37.565257428s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Uploading piece...
May 17 22:34:27.854914283 (411h46m38.375738028s) [upload=394782]: Next returned nil segment
May 17 22:34:27.854924823 (411h46m38.375748568s) [upload=394782]: Waiting for error group managing segments...
May 17 22:34:28.239545317 (411h46m38.760369062s) [noise=true , address=185.167.204.205:4009 , piece_id=LO7H4S3JKJKRSOGJ6ZODPFJ6YBTUU2LDUY3CTLPY23X6S57HZN3Q, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.245786637 (411h46m38.766610382s) [noise=true , address=185.167.204.206:4068 , piece_id=IZTG3A67SWKZX5C526KTTEAOISUMKCHIFLWL3MTPDSI6QI7CP65A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.255840251 (411h46m38.776663996s) [noise=true , address=185.167.204.206:4059 , piece_id=IM5N2WKCNHD6M57X5VR6TIJE4F6IZEDEP4AM4FQ3KWYG4STVEOGQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.258630967 (411h46m38.779454712s) [noise=true , address=185.167.204.206:4060 , piece_id=AH64NEU2RFVYZAICJSRWBU3OASGCKX2OZLNBPGYR3AJKUG4K7JWA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260445739 (411h46m38.781269484s) [noise=true , address=185.167.204.206:4057 , piece_id=GNJGLIDMRVKVPTBPAL5YDCM37ZA6SQBMRWFLZLRIEWRXAI7GRKFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.260820615 (411h46m38.78164436s) [noise=true , address=185.167.204.205:4034 , piece_id=ALXLNAFX7EQQEKS3XIVXKLDONO64CYM6GUFGNGY5OS7SSYECKHZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.261604741 (411h46m38.782428486s) [noise=true , address=185.167.204.205:4032 , piece_id=VWRM2HTEQY6HZ2XG3267SEFYFTNWABAJIBVULFUWJBQA4AEPGRFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.266260546 (411h46m38.787084281s) [noise=true , address=185.167.204.205:4029 , piece_id=SVSUZ27ZU3FNO4L4WSLHIUXNW6JOPINOKXNAI2IWDYTMAZKEZZMA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.287363153 (411h46m38.808186898s) [noise=true , address=81.171.14.70:4041 , piece_id=SNOP2G7CBJBICB56L43KJJ52JHNJHFDNHAHVCDDHHFPX7NPZ6SFQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.301235895 (411h46m38.82205965s) [noise=true , address=81.171.14.70:4043 , piece_id=LEVZBMTS27YEYUY3GWP5C6EFKXJ4BP6XF6YR6VRYHNFGIJGRQADQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.307957311 (411h46m38.828781056s) [noise=true , address=81.171.14.70:4033 , piece_id=DDKWWNUZS2RWWRH2KDLVCBWAPSQ5EALFEWGGDYPSQM74TF7MYA5A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.308575370 (411h46m38.829399135s) [noise=true , address=81.171.14.70:4045 , piece_id=UNQMYVTTY2GZ3QOZOYF3AEGUS2KSAZNTXVYM2RNXMZ74E6CVULRQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.312344021 (411h46m38.833167766s) [noise=true , address=81.171.14.70:4044 , piece_id=CUABE6O2PEW7L6ZAL5HGPBMTRZAZJ4XR67MH2KKAKAFAW6X2ERHA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323450836 (411h46m38.844274571s) [noise=true , address=81.171.14.70:4035 , piece_id=V6P5EVDK3GAKZ6KFPAPUJC6UVCBW2XNYZSTLXOF7P3WFSKKQP4FQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.323838546 (411h46m38.844662291s) [noise=true , address=81.171.14.70:4025 , piece_id=Z4ETZSWLMFIV4LHTKVKJSAJI5OBUTUZRCDZWDEQXZ4YJRHDNH5PA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.330862219 (411h46m38.851685964s) [noise=true , address=81.171.14.70:4029 , piece_id=JKORZSUDHGDR6IKR6HEWFUMWESJ7C5F7WPOSAHPDSNMTFN6P4OZQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331259857 (411h46m38.852083602s) [noise=true , address=81.171.14.70:4034 , piece_id=PUSHGLRUZN2GIIIRSIZBZC6EJXIP2PXA5XZXBAVVTD4CZXXCW5CA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.331595307 (411h46m38.852419072s) [noise=true , address=81.171.14.70:4038 , piece_id=AEAARROU4DSXBAQWBJYWPYGR6T7K6SXESNVPNQPBK4PTPZ6FCXBQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.338839270 (411h46m38.859663015s) [noise=true , address=81.171.14.70:4046 , piece_id=3KFORIUT4DE5I7DN3NOHNSMLKIMSVDZQPTUY6MOSENHILE2NZS7A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.794664577 (411h46m39.315488322s) [noise=true , address=89.149.201.147:4020 , piece_id=F7FUUHN7QF4YYJXB6U3IFARFXAITRUGW3BOBKPBJXOXFG77KQM4A, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.855136180 (411h46m39.375959925s) [noise=true , address=89.149.201.147:4008 , piece_id=3LRTQX5GV6PK27NGLOGX3E6EP5WEABOJS3NZMRUG6ZAYFGDPCJAA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.881838443 (411h46m39.402662188s) [noise=true , address=89.149.201.147:4021 , piece_id=DUSL2NLVZOBEXT56ELQCRQXZZHU4TA3AJOD5MEPDFVDXXMDEDNXA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.883663846 (411h46m39.404487591s) [noise=true , address=89.149.201.147:4009 , piece_id=JPNCTOQ3PTXFR4OFZ636GN72XJC3GFBMZ3KKNIZRPRXYCXGV36AA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:28.926714846 (411h46m39.447538591s) [noise=true , address=89.149.201.147:4024 , piece_id=27QK7WKX4UZVNOYVAHSIDZLKEBL3KWAPOFS6MRXBFF3LNNMS3UYA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.213587658 (411h46m39.734411403s) [noise=true , address=89.149.201.147:4003 , piece_id=GQSH37SWTS64URW6DWSJMHMPX3P64Q7ZBQSAQRYPWX5BLBZYFCTA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380200989 (411h46m39.901024734s) [noise=true , address=89.149.201.147:4019 , piece_id=SH4DF4Q5WQCOJXML2EUKM5WN64PGXRW6VJ4QBQUZI2CTMMBY5FWQ, seg_pos={0 0}, upload=394782]: Done uploading piece. err: <nil>
May 17 22:34:29.380217460 (411h46m39.901041205s) [seg_pos={0 0}, upload=394782]: Satisfied cohort requirements after 26 pieces
May 17 22:34:29.380365422 (411h46m39.901189168s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122Vj8XxpS6RnhVweQV3cZWFhj8nrzy3hZ9P7JsuTzEaZcD6iFE): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380370573 (411h46m39.901194318s) [noise=true , address=89.149.201.147:4022 , piece_id=6KXNVI4Q5MYRWQUJIUVYNG5LOGEVYMG3YHGEWCO5HVFRLSHBLTDA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380539254 (411h46m39.901362999s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1foiaFSv2TTCkBBCnVYJ6xRbAJ2YYkhnKKmtZJY31ZAzFMTWQQ): protocol: expected piece hash; context canceled; EOF
May 17 22:34:29.380544274 (411h46m39.901368019s) [noise=true , address=89.149.201.147:4017 , piece_id=YE6BAX56XMAPCR52U5TSHT5Y3GD4DYNSB3JR6GNF4GZAK62VF6YA, seg_pos={0 0}, upload=394782]: Long tail cancellation due to optimal threshold
May 17 22:34:29.380559463 (411h46m39.901383208s) [seg_pos={0 0}, upload=394782]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
May 17 22:34:29.380617765 (411h46m39.90144151s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
May 17 22:34:29.380621762 (411h46m39.901445497s) [upload=394782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
May 17 22:34:29.628639019 (411h46m40.149462754s) [upload=394782]: Done uploading segments...
May 17 22:34:29.628653306 (411h46m40.149477051s) [upload=394782]: Upload finished. err: <nil>
Duration: 4.697308239s
core
uplink
eu-select-1
eu1-placement-15
|