Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...XX............X............X....X..............X...X.....] duration:
5.87761719s
FAIL (2025-08-23 00:56:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1616dff85fdc1e79799be9d4711f65b71949ade4bf2f50b441ba788aaa363870 != before 2eaf06ea70f0db11df6b5f2e7ec58774a26884c2a506482a72174eae93bdc2cc
======LOGS======
Aug 23 00:50:36.188315609 (343h24m30.61939574s) [upload=357226]: Starting upload
Aug 23 00:50:36.188364953 (343h24m30.619445084s) [upload=357226]: Done starting upload
Aug 23 00:50:36.188429106 (343h24m30.619509227s) [upload=357226]: Uploading segments...
Aug 23 00:50:36.188695556 (343h24m30.619775687s) [upload=357226]: Got next segment. Inline: false
Aug 23 00:50:36.188730232 (343h24m30.619810363s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:50:36.188734721 (343h24m30.619814852s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:50:36.638155086 (343h24m31.069235217s) [seg_pos={0 0}, upload=357226]: Begin upload segment...
Aug 23 00:50:36.638206273 (343h24m31.069286404s) [seg_pos={0 0}, upload=357226]: Done begin upload segment.
Aug 23 00:50:36.638235158 (343h24m31.069315329s) [noise=true , address=104.36.82.7:4935 , piece_id=WVB7HLXMUR4HVESI3WOT6DSKDQAHIB24SWZYIWYSC6J7EGL5BC7A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.638929327 (343h24m31.070009448s) [noise=true , address=104.36.82.8:4978 , piece_id=C6IOJAGBUHDJVZRFA5YEDOE42MQEHBTZZFAEGCHNLC777XSKXMIQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639211426 (343h24m31.070291557s) [noise=true , address=77.90.31.21:4905 , piece_id=4CLTQ6Q2KZMJZVEXZOYCXMMC2EMCKZQCRCS7GVJHSMWH6JPI6CMQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639470011 (343h24m31.070550132s) [noise=true , address=77.90.31.11:4565 , piece_id=VP7SQ2AWRMRZAXYZNUKYU2OXIXXI4CV2F4R5NEJ5NFUVXVXTEBRQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639754947 (343h24m31.070835088s) [noise=true , address=104.36.82.35:4595 , piece_id=7XAWWIANL4EFIROIP4N7QEJTE66B6Y4AVYC5MCOUQ62Z7PCI7LOA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639987451 (343h24m31.071067582s) [noise=true , address=77.90.31.10:4548 , piece_id=YV27ZUT5OR7ZM6L2A2XWAUQ6WEEQTP3SF4NSG2WHJS45VJUMF4VQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640207953 (343h24m31.071288084s) [noise=true , address=104.36.82.45:4933 , piece_id=TTASJWLGPYULP2QNSI52OJ6U4SHTJTT45P7JGJPIMMTBIIKTNCYA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640500613 (343h24m31.071580744s) [noise=true , address=104.36.82.18:4367 , piece_id=LC7INYDUM6WPJHIOXM4EIYRNMHVNWK5AQUF4S4H7RS7PXL6A3XFA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640737016 (343h24m31.071817147s) [noise=true , address=104.36.82.19:4416 , piece_id=W3H4MM4MRNPQ5XBLOHVZEWQHVGIHQFPJ5ZFSPO7454SI4WECRYCA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640948941 (343h24m31.072029072s) [noise=true , address=79.127.219.48:4108 , piece_id=XCMERIBX4ALNPPL54JBVJ2I5SB7X624OA43QA56JKHILUH7IKGQQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641158632 (343h24m31.072238763s) [noise=true , address=104.36.82.50:4031 , piece_id=JBHQ7IOSC3VKESJRX22AVJZ5D4R22RR4E6BFMWSJOCSXVNULI4AA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641398712 (343h24m31.072478833s) [noise=true , address=104.36.82.62:4423 , piece_id=RFYAIJXORZV4VDH6VRASR47AOEPXGYP4FPFUIWJWJV5GVH4BBCTQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641599906 (343h24m31.072680037s) [noise=true , address=77.90.31.16:4748 , piece_id=NK237YCVGJKICABNKPQ4JV5VXHPSU5VL4YCJNBKWHJTCTLP5D72A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641821570 (343h24m31.072901702s) [noise=true , address=104.36.82.34:4570 , piece_id=XBYGLTUGS5H3KXMU57DHHZFXXPGWFBN5FZY7MUIT3YR2JQEXD35A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641861698 (343h24m31.072941829s) [noise=true , address=45.91.116.11:4143 , piece_id=JZFPZ76E52DS65XHVCM322UB2UAU3EOSEQFKGMPCJQ7JUXD7G7PA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642124540 (343h24m31.073204661s) [noise=true , address=77.90.31.12:4604 , piece_id=MY6YXPLJ773DAOAWJ7TAZMBAAWDAAN7LAW6TOXG6AIMWDH6UTQEA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642351124 (343h24m31.073431245s) [noise=true , address=77.90.31.18:4835 , piece_id=2BBC3TUK36SFA7RIDBOXHDSEWZAQNXJ2CHTWKL4GGHUP3VHULPIA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642641529 (343h24m31.073721661s) [noise=true , address=104.36.82.9:4034 , piece_id=2Q54R2GTNK6CZFI5UNJNWVALMXWQ75VVUEGXLMXIVYENFCH7C62Q, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:38.143806591 (343h24m32.574886722s) [upload=357226]: Next returned nil segment
Aug 23 00:50:38.143826288 (343h24m32.574906419s) [upload=357226]: Waiting for error group managing segments...
Aug 23 00:50:38.537487515 (343h24m32.968567646s) [noise=true , address=77.90.31.12:4604 , piece_id=MY6YXPLJ773DAOAWJ7TAZMBAAWDAAN7LAW6TOXG6AIMWDH6UTQEA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.558312561 (343h24m32.989392692s) [noise=true , address=104.36.82.35:4595 , piece_id=7XAWWIANL4EFIROIP4N7QEJTE66B6Y4AVYC5MCOUQ62Z7PCI7LOA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.559281495 (343h24m32.990361626s) [noise=true , address=104.36.82.9:4034 , piece_id=2Q54R2GTNK6CZFI5UNJNWVALMXWQ75VVUEGXLMXIVYENFCH7C62Q, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.560152993 (343h24m32.991233124s) [noise=true , address=104.36.82.34:4570 , piece_id=XBYGLTUGS5H3KXMU57DHHZFXXPGWFBN5FZY7MUIT3YR2JQEXD35A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.569194232 (343h24m33.000274363s) [noise=true , address=104.36.82.62:4423 , piece_id=RFYAIJXORZV4VDH6VRASR47AOEPXGYP4FPFUIWJWJV5GVH4BBCTQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.572780634 (343h24m33.003860765s) [noise=true , address=77.90.31.11:4565 , piece_id=VP7SQ2AWRMRZAXYZNUKYU2OXIXXI4CV2F4R5NEJ5NFUVXVXTEBRQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.587894953 (343h24m33.018975084s) [noise=true , address=79.127.219.48:4108 , piece_id=XCMERIBX4ALNPPL54JBVJ2I5SB7X624OA43QA56JKHILUH7IKGQQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.590340432 (343h24m33.021420563s) [noise=true , address=77.90.31.18:4835 , piece_id=2BBC3TUK36SFA7RIDBOXHDSEWZAQNXJ2CHTWKL4GGHUP3VHULPIA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.611821283 (343h24m33.042901404s) [noise=true , address=77.90.31.16:4748 , piece_id=NK237YCVGJKICABNKPQ4JV5VXHPSU5VL4YCJNBKWHJTCTLP5D72A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.625378624 (343h24m33.056458755s) [noise=true , address=104.36.82.7:4935 , piece_id=WVB7HLXMUR4HVESI3WOT6DSKDQAHIB24SWZYIWYSC6J7EGL5BC7A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.627531103 (343h24m33.058611234s) [noise=true , address=104.36.82.19:4416 , piece_id=W3H4MM4MRNPQ5XBLOHVZEWQHVGIHQFPJ5ZFSPO7454SI4WECRYCA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.631188921 (343h24m33.062269092s) [noise=true , address=77.90.31.10:4548 , piece_id=YV27ZUT5OR7ZM6L2A2XWAUQ6WEEQTP3SF4NSG2WHJS45VJUMF4VQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.637452566 (343h24m33.068532698s) [noise=true , address=104.36.82.18:4367 , piece_id=LC7INYDUM6WPJHIOXM4EIYRNMHVNWK5AQUF4S4H7RS7PXL6A3XFA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.699486280 (343h24m33.130566412s) [noise=true , address=104.36.82.8:4978 , piece_id=C6IOJAGBUHDJVZRFA5YEDOE42MQEHBTZZFAEGCHNLC777XSKXMIQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.699516318 (343h24m33.130596449s) [seg_pos={0 0}, upload=357226]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:50:38.699625627 (343h24m33.130705758s) [noise=true , address=45.91.116.11:4143 , piece_id=JZFPZ76E52DS65XHVCM322UB2UAU3EOSEQFKGMPCJQ7JUXD7G7PA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12caEiJobigXcGWwaX3Vt16zd2NXqk1WzLWxZME44E8Q8wdhn3q): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699654923 (343h24m33.130735054s) [noise=true , address=104.36.82.50:4031 , piece_id=JBHQ7IOSC3VKESJRX22AVJZ5D4R22RR4E6BFMWSJOCSXVNULI4AA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ypc3zkMzWs3wqx9QaExy7sHvnSatwYH8Y9rHi7qt3xRELfsAa): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699700991 (343h24m33.130781123s) [noise=true , address=77.90.31.21:4905 , piece_id=4CLTQ6Q2KZMJZVEXZOYCXMMC2EMCKZQCRCS7GVJHSMWH6JPI6CMQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699719516 (343h24m33.130799697s) [noise=true , address=104.36.82.45:4933 , piece_id=TTASJWLGPYULP2QNSI52OJ6U4SHTJTT45P7JGJPIMMTBIIKTNCYA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kj9KJZo29cpWQSprwxjWe82BrKnYYDTuKguPJm9hn8yVG83ou): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699746979 (343h24m33.13082711s) [seg_pos={0 0}, upload=357226]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:50:38.699826351 (343h24m33.130906482s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:50:38.699831100 (343h24m33.130911231s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:50:39.015620264 (343h24m33.446700395s) [upload=357226]: Done uploading segments...
Aug 23 00:50:39.015639371 (343h24m33.446719502s) [upload=357226]: Upload finished. err: <nil>
Duration: 5.877654512s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X....................X........XX.....X................] duration:
1.897468299s
FAIL (2025-08-23 00:55:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 1.897495671s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......X....................X........XX.....X...............] duration:
1.955931424s
FAIL (2025-08-23 00:55:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 1.956009083s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........X....................X........XX.....X..............] duration:
2.028875884s
FAIL (2025-08-23 00:54:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 2.028905911s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [....XX............X............X....X..............X...X....] duration:
5.815172514s
FAIL (2025-08-23 00:54:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1616dff85fdc1e79799be9d4711f65b71949ade4bf2f50b441ba788aaa363870 != before 2eaf06ea70f0db11df6b5f2e7ec58774a26884c2a506482a72174eae93bdc2cc
======LOGS======
Aug 23 00:50:36.188315609 (343h24m30.61939574s) [upload=357226]: Starting upload
Aug 23 00:50:36.188364953 (343h24m30.619445084s) [upload=357226]: Done starting upload
Aug 23 00:50:36.188429106 (343h24m30.619509227s) [upload=357226]: Uploading segments...
Aug 23 00:50:36.188695556 (343h24m30.619775687s) [upload=357226]: Got next segment. Inline: false
Aug 23 00:50:36.188730232 (343h24m30.619810363s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:50:36.188734721 (343h24m30.619814852s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:50:36.638155086 (343h24m31.069235217s) [seg_pos={0 0}, upload=357226]: Begin upload segment...
Aug 23 00:50:36.638206273 (343h24m31.069286404s) [seg_pos={0 0}, upload=357226]: Done begin upload segment.
Aug 23 00:50:36.638235158 (343h24m31.069315329s) [noise=true , address=104.36.82.7:4935 , piece_id=WVB7HLXMUR4HVESI3WOT6DSKDQAHIB24SWZYIWYSC6J7EGL5BC7A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.638929327 (343h24m31.070009448s) [noise=true , address=104.36.82.8:4978 , piece_id=C6IOJAGBUHDJVZRFA5YEDOE42MQEHBTZZFAEGCHNLC777XSKXMIQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639211426 (343h24m31.070291557s) [noise=true , address=77.90.31.21:4905 , piece_id=4CLTQ6Q2KZMJZVEXZOYCXMMC2EMCKZQCRCS7GVJHSMWH6JPI6CMQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639470011 (343h24m31.070550132s) [noise=true , address=77.90.31.11:4565 , piece_id=VP7SQ2AWRMRZAXYZNUKYU2OXIXXI4CV2F4R5NEJ5NFUVXVXTEBRQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639754947 (343h24m31.070835088s) [noise=true , address=104.36.82.35:4595 , piece_id=7XAWWIANL4EFIROIP4N7QEJTE66B6Y4AVYC5MCOUQ62Z7PCI7LOA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639987451 (343h24m31.071067582s) [noise=true , address=77.90.31.10:4548 , piece_id=YV27ZUT5OR7ZM6L2A2XWAUQ6WEEQTP3SF4NSG2WHJS45VJUMF4VQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640207953 (343h24m31.071288084s) [noise=true , address=104.36.82.45:4933 , piece_id=TTASJWLGPYULP2QNSI52OJ6U4SHTJTT45P7JGJPIMMTBIIKTNCYA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640500613 (343h24m31.071580744s) [noise=true , address=104.36.82.18:4367 , piece_id=LC7INYDUM6WPJHIOXM4EIYRNMHVNWK5AQUF4S4H7RS7PXL6A3XFA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640737016 (343h24m31.071817147s) [noise=true , address=104.36.82.19:4416 , piece_id=W3H4MM4MRNPQ5XBLOHVZEWQHVGIHQFPJ5ZFSPO7454SI4WECRYCA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640948941 (343h24m31.072029072s) [noise=true , address=79.127.219.48:4108 , piece_id=XCMERIBX4ALNPPL54JBVJ2I5SB7X624OA43QA56JKHILUH7IKGQQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641158632 (343h24m31.072238763s) [noise=true , address=104.36.82.50:4031 , piece_id=JBHQ7IOSC3VKESJRX22AVJZ5D4R22RR4E6BFMWSJOCSXVNULI4AA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641398712 (343h24m31.072478833s) [noise=true , address=104.36.82.62:4423 , piece_id=RFYAIJXORZV4VDH6VRASR47AOEPXGYP4FPFUIWJWJV5GVH4BBCTQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641599906 (343h24m31.072680037s) [noise=true , address=77.90.31.16:4748 , piece_id=NK237YCVGJKICABNKPQ4JV5VXHPSU5VL4YCJNBKWHJTCTLP5D72A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641821570 (343h24m31.072901702s) [noise=true , address=104.36.82.34:4570 , piece_id=XBYGLTUGS5H3KXMU57DHHZFXXPGWFBN5FZY7MUIT3YR2JQEXD35A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641861698 (343h24m31.072941829s) [noise=true , address=45.91.116.11:4143 , piece_id=JZFPZ76E52DS65XHVCM322UB2UAU3EOSEQFKGMPCJQ7JUXD7G7PA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642124540 (343h24m31.073204661s) [noise=true , address=77.90.31.12:4604 , piece_id=MY6YXPLJ773DAOAWJ7TAZMBAAWDAAN7LAW6TOXG6AIMWDH6UTQEA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642351124 (343h24m31.073431245s) [noise=true , address=77.90.31.18:4835 , piece_id=2BBC3TUK36SFA7RIDBOXHDSEWZAQNXJ2CHTWKL4GGHUP3VHULPIA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642641529 (343h24m31.073721661s) [noise=true , address=104.36.82.9:4034 , piece_id=2Q54R2GTNK6CZFI5UNJNWVALMXWQ75VVUEGXLMXIVYENFCH7C62Q, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:38.143806591 (343h24m32.574886722s) [upload=357226]: Next returned nil segment
Aug 23 00:50:38.143826288 (343h24m32.574906419s) [upload=357226]: Waiting for error group managing segments...
Aug 23 00:50:38.537487515 (343h24m32.968567646s) [noise=true , address=77.90.31.12:4604 , piece_id=MY6YXPLJ773DAOAWJ7TAZMBAAWDAAN7LAW6TOXG6AIMWDH6UTQEA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.558312561 (343h24m32.989392692s) [noise=true , address=104.36.82.35:4595 , piece_id=7XAWWIANL4EFIROIP4N7QEJTE66B6Y4AVYC5MCOUQ62Z7PCI7LOA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.559281495 (343h24m32.990361626s) [noise=true , address=104.36.82.9:4034 , piece_id=2Q54R2GTNK6CZFI5UNJNWVALMXWQ75VVUEGXLMXIVYENFCH7C62Q, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.560152993 (343h24m32.991233124s) [noise=true , address=104.36.82.34:4570 , piece_id=XBYGLTUGS5H3KXMU57DHHZFXXPGWFBN5FZY7MUIT3YR2JQEXD35A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.569194232 (343h24m33.000274363s) [noise=true , address=104.36.82.62:4423 , piece_id=RFYAIJXORZV4VDH6VRASR47AOEPXGYP4FPFUIWJWJV5GVH4BBCTQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.572780634 (343h24m33.003860765s) [noise=true , address=77.90.31.11:4565 , piece_id=VP7SQ2AWRMRZAXYZNUKYU2OXIXXI4CV2F4R5NEJ5NFUVXVXTEBRQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.587894953 (343h24m33.018975084s) [noise=true , address=79.127.219.48:4108 , piece_id=XCMERIBX4ALNPPL54JBVJ2I5SB7X624OA43QA56JKHILUH7IKGQQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.590340432 (343h24m33.021420563s) [noise=true , address=77.90.31.18:4835 , piece_id=2BBC3TUK36SFA7RIDBOXHDSEWZAQNXJ2CHTWKL4GGHUP3VHULPIA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.611821283 (343h24m33.042901404s) [noise=true , address=77.90.31.16:4748 , piece_id=NK237YCVGJKICABNKPQ4JV5VXHPSU5VL4YCJNBKWHJTCTLP5D72A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.625378624 (343h24m33.056458755s) [noise=true , address=104.36.82.7:4935 , piece_id=WVB7HLXMUR4HVESI3WOT6DSKDQAHIB24SWZYIWYSC6J7EGL5BC7A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.627531103 (343h24m33.058611234s) [noise=true , address=104.36.82.19:4416 , piece_id=W3H4MM4MRNPQ5XBLOHVZEWQHVGIHQFPJ5ZFSPO7454SI4WECRYCA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.631188921 (343h24m33.062269092s) [noise=true , address=77.90.31.10:4548 , piece_id=YV27ZUT5OR7ZM6L2A2XWAUQ6WEEQTP3SF4NSG2WHJS45VJUMF4VQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.637452566 (343h24m33.068532698s) [noise=true , address=104.36.82.18:4367 , piece_id=LC7INYDUM6WPJHIOXM4EIYRNMHVNWK5AQUF4S4H7RS7PXL6A3XFA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.699486280 (343h24m33.130566412s) [noise=true , address=104.36.82.8:4978 , piece_id=C6IOJAGBUHDJVZRFA5YEDOE42MQEHBTZZFAEGCHNLC777XSKXMIQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.699516318 (343h24m33.130596449s) [seg_pos={0 0}, upload=357226]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:50:38.699625627 (343h24m33.130705758s) [noise=true , address=45.91.116.11:4143 , piece_id=JZFPZ76E52DS65XHVCM322UB2UAU3EOSEQFKGMPCJQ7JUXD7G7PA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12caEiJobigXcGWwaX3Vt16zd2NXqk1WzLWxZME44E8Q8wdhn3q): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699654923 (343h24m33.130735054s) [noise=true , address=104.36.82.50:4031 , piece_id=JBHQ7IOSC3VKESJRX22AVJZ5D4R22RR4E6BFMWSJOCSXVNULI4AA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ypc3zkMzWs3wqx9QaExy7sHvnSatwYH8Y9rHi7qt3xRELfsAa): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699700991 (343h24m33.130781123s) [noise=true , address=77.90.31.21:4905 , piece_id=4CLTQ6Q2KZMJZVEXZOYCXMMC2EMCKZQCRCS7GVJHSMWH6JPI6CMQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699719516 (343h24m33.130799697s) [noise=true , address=104.36.82.45:4933 , piece_id=TTASJWLGPYULP2QNSI52OJ6U4SHTJTT45P7JGJPIMMTBIIKTNCYA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kj9KJZo29cpWQSprwxjWe82BrKnYYDTuKguPJm9hn8yVG83ou): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699746979 (343h24m33.13082711s) [seg_pos={0 0}, upload=357226]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:50:38.699826351 (343h24m33.130906482s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:50:38.699831100 (343h24m33.130911231s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:50:39.015620264 (343h24m33.446700395s) [upload=357226]: Done uploading segments...
Aug 23 00:50:39.015639371 (343h24m33.446719502s) [upload=357226]: Upload finished. err: <nil>
Duration: 5.815200346s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X....................X........XX.....X.............] duration:
2.062519316s
FAIL (2025-08-23 00:54:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 2.062576136s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.....XX............X............X....X..............X...X...] duration:
5.72072968s
FAIL (2025-08-23 00:53:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1616dff85fdc1e79799be9d4711f65b71949ade4bf2f50b441ba788aaa363870 != before 2eaf06ea70f0db11df6b5f2e7ec58774a26884c2a506482a72174eae93bdc2cc
======LOGS======
Aug 23 00:50:36.188315609 (343h24m30.61939574s) [upload=357226]: Starting upload
Aug 23 00:50:36.188364953 (343h24m30.619445084s) [upload=357226]: Done starting upload
Aug 23 00:50:36.188429106 (343h24m30.619509227s) [upload=357226]: Uploading segments...
Aug 23 00:50:36.188695556 (343h24m30.619775687s) [upload=357226]: Got next segment. Inline: false
Aug 23 00:50:36.188730232 (343h24m30.619810363s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:50:36.188734721 (343h24m30.619814852s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:50:36.638155086 (343h24m31.069235217s) [seg_pos={0 0}, upload=357226]: Begin upload segment...
Aug 23 00:50:36.638206273 (343h24m31.069286404s) [seg_pos={0 0}, upload=357226]: Done begin upload segment.
Aug 23 00:50:36.638235158 (343h24m31.069315329s) [noise=true , address=104.36.82.7:4935 , piece_id=WVB7HLXMUR4HVESI3WOT6DSKDQAHIB24SWZYIWYSC6J7EGL5BC7A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.638929327 (343h24m31.070009448s) [noise=true , address=104.36.82.8:4978 , piece_id=C6IOJAGBUHDJVZRFA5YEDOE42MQEHBTZZFAEGCHNLC777XSKXMIQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639211426 (343h24m31.070291557s) [noise=true , address=77.90.31.21:4905 , piece_id=4CLTQ6Q2KZMJZVEXZOYCXMMC2EMCKZQCRCS7GVJHSMWH6JPI6CMQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639470011 (343h24m31.070550132s) [noise=true , address=77.90.31.11:4565 , piece_id=VP7SQ2AWRMRZAXYZNUKYU2OXIXXI4CV2F4R5NEJ5NFUVXVXTEBRQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639754947 (343h24m31.070835088s) [noise=true , address=104.36.82.35:4595 , piece_id=7XAWWIANL4EFIROIP4N7QEJTE66B6Y4AVYC5MCOUQ62Z7PCI7LOA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639987451 (343h24m31.071067582s) [noise=true , address=77.90.31.10:4548 , piece_id=YV27ZUT5OR7ZM6L2A2XWAUQ6WEEQTP3SF4NSG2WHJS45VJUMF4VQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640207953 (343h24m31.071288084s) [noise=true , address=104.36.82.45:4933 , piece_id=TTASJWLGPYULP2QNSI52OJ6U4SHTJTT45P7JGJPIMMTBIIKTNCYA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640500613 (343h24m31.071580744s) [noise=true , address=104.36.82.18:4367 , piece_id=LC7INYDUM6WPJHIOXM4EIYRNMHVNWK5AQUF4S4H7RS7PXL6A3XFA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640737016 (343h24m31.071817147s) [noise=true , address=104.36.82.19:4416 , piece_id=W3H4MM4MRNPQ5XBLOHVZEWQHVGIHQFPJ5ZFSPO7454SI4WECRYCA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640948941 (343h24m31.072029072s) [noise=true , address=79.127.219.48:4108 , piece_id=XCMERIBX4ALNPPL54JBVJ2I5SB7X624OA43QA56JKHILUH7IKGQQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641158632 (343h24m31.072238763s) [noise=true , address=104.36.82.50:4031 , piece_id=JBHQ7IOSC3VKESJRX22AVJZ5D4R22RR4E6BFMWSJOCSXVNULI4AA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641398712 (343h24m31.072478833s) [noise=true , address=104.36.82.62:4423 , piece_id=RFYAIJXORZV4VDH6VRASR47AOEPXGYP4FPFUIWJWJV5GVH4BBCTQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641599906 (343h24m31.072680037s) [noise=true , address=77.90.31.16:4748 , piece_id=NK237YCVGJKICABNKPQ4JV5VXHPSU5VL4YCJNBKWHJTCTLP5D72A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641821570 (343h24m31.072901702s) [noise=true , address=104.36.82.34:4570 , piece_id=XBYGLTUGS5H3KXMU57DHHZFXXPGWFBN5FZY7MUIT3YR2JQEXD35A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641861698 (343h24m31.072941829s) [noise=true , address=45.91.116.11:4143 , piece_id=JZFPZ76E52DS65XHVCM322UB2UAU3EOSEQFKGMPCJQ7JUXD7G7PA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642124540 (343h24m31.073204661s) [noise=true , address=77.90.31.12:4604 , piece_id=MY6YXPLJ773DAOAWJ7TAZMBAAWDAAN7LAW6TOXG6AIMWDH6UTQEA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642351124 (343h24m31.073431245s) [noise=true , address=77.90.31.18:4835 , piece_id=2BBC3TUK36SFA7RIDBOXHDSEWZAQNXJ2CHTWKL4GGHUP3VHULPIA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642641529 (343h24m31.073721661s) [noise=true , address=104.36.82.9:4034 , piece_id=2Q54R2GTNK6CZFI5UNJNWVALMXWQ75VVUEGXLMXIVYENFCH7C62Q, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:38.143806591 (343h24m32.574886722s) [upload=357226]: Next returned nil segment
Aug 23 00:50:38.143826288 (343h24m32.574906419s) [upload=357226]: Waiting for error group managing segments...
Aug 23 00:50:38.537487515 (343h24m32.968567646s) [noise=true , address=77.90.31.12:4604 , piece_id=MY6YXPLJ773DAOAWJ7TAZMBAAWDAAN7LAW6TOXG6AIMWDH6UTQEA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.558312561 (343h24m32.989392692s) [noise=true , address=104.36.82.35:4595 , piece_id=7XAWWIANL4EFIROIP4N7QEJTE66B6Y4AVYC5MCOUQ62Z7PCI7LOA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.559281495 (343h24m32.990361626s) [noise=true , address=104.36.82.9:4034 , piece_id=2Q54R2GTNK6CZFI5UNJNWVALMXWQ75VVUEGXLMXIVYENFCH7C62Q, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.560152993 (343h24m32.991233124s) [noise=true , address=104.36.82.34:4570 , piece_id=XBYGLTUGS5H3KXMU57DHHZFXXPGWFBN5FZY7MUIT3YR2JQEXD35A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.569194232 (343h24m33.000274363s) [noise=true , address=104.36.82.62:4423 , piece_id=RFYAIJXORZV4VDH6VRASR47AOEPXGYP4FPFUIWJWJV5GVH4BBCTQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.572780634 (343h24m33.003860765s) [noise=true , address=77.90.31.11:4565 , piece_id=VP7SQ2AWRMRZAXYZNUKYU2OXIXXI4CV2F4R5NEJ5NFUVXVXTEBRQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.587894953 (343h24m33.018975084s) [noise=true , address=79.127.219.48:4108 , piece_id=XCMERIBX4ALNPPL54JBVJ2I5SB7X624OA43QA56JKHILUH7IKGQQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.590340432 (343h24m33.021420563s) [noise=true , address=77.90.31.18:4835 , piece_id=2BBC3TUK36SFA7RIDBOXHDSEWZAQNXJ2CHTWKL4GGHUP3VHULPIA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.611821283 (343h24m33.042901404s) [noise=true , address=77.90.31.16:4748 , piece_id=NK237YCVGJKICABNKPQ4JV5VXHPSU5VL4YCJNBKWHJTCTLP5D72A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.625378624 (343h24m33.056458755s) [noise=true , address=104.36.82.7:4935 , piece_id=WVB7HLXMUR4HVESI3WOT6DSKDQAHIB24SWZYIWYSC6J7EGL5BC7A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.627531103 (343h24m33.058611234s) [noise=true , address=104.36.82.19:4416 , piece_id=W3H4MM4MRNPQ5XBLOHVZEWQHVGIHQFPJ5ZFSPO7454SI4WECRYCA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.631188921 (343h24m33.062269092s) [noise=true , address=77.90.31.10:4548 , piece_id=YV27ZUT5OR7ZM6L2A2XWAUQ6WEEQTP3SF4NSG2WHJS45VJUMF4VQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.637452566 (343h24m33.068532698s) [noise=true , address=104.36.82.18:4367 , piece_id=LC7INYDUM6WPJHIOXM4EIYRNMHVNWK5AQUF4S4H7RS7PXL6A3XFA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.699486280 (343h24m33.130566412s) [noise=true , address=104.36.82.8:4978 , piece_id=C6IOJAGBUHDJVZRFA5YEDOE42MQEHBTZZFAEGCHNLC777XSKXMIQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.699516318 (343h24m33.130596449s) [seg_pos={0 0}, upload=357226]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:50:38.699625627 (343h24m33.130705758s) [noise=true , address=45.91.116.11:4143 , piece_id=JZFPZ76E52DS65XHVCM322UB2UAU3EOSEQFKGMPCJQ7JUXD7G7PA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12caEiJobigXcGWwaX3Vt16zd2NXqk1WzLWxZME44E8Q8wdhn3q): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699654923 (343h24m33.130735054s) [noise=true , address=104.36.82.50:4031 , piece_id=JBHQ7IOSC3VKESJRX22AVJZ5D4R22RR4E6BFMWSJOCSXVNULI4AA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ypc3zkMzWs3wqx9QaExy7sHvnSatwYH8Y9rHi7qt3xRELfsAa): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699700991 (343h24m33.130781123s) [noise=true , address=77.90.31.21:4905 , piece_id=4CLTQ6Q2KZMJZVEXZOYCXMMC2EMCKZQCRCS7GVJHSMWH6JPI6CMQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699719516 (343h24m33.130799697s) [noise=true , address=104.36.82.45:4933 , piece_id=TTASJWLGPYULP2QNSI52OJ6U4SHTJTT45P7JGJPIMMTBIIKTNCYA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kj9KJZo29cpWQSprwxjWe82BrKnYYDTuKguPJm9hn8yVG83ou): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699746979 (343h24m33.13082711s) [seg_pos={0 0}, upload=357226]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:50:38.699826351 (343h24m33.130906482s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:50:38.699831100 (343h24m33.130911231s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:50:39.015620264 (343h24m33.446700395s) [upload=357226]: Done uploading segments...
Aug 23 00:50:39.015639371 (343h24m33.446719502s) [upload=357226]: Upload finished. err: <nil>
Duration: 5.7207615s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X....................X........XX.....X............] duration:
2.036244443s
FAIL (2025-08-23 00:53:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 2.036274622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X....................X........XX.....X...........] duration:
1.854298109s
FAIL (2025-08-23 00:53:09 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 1.854317787s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X....................X........XX.....X..........] duration:
1.94296511s
FAIL (2025-08-23 00:52:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 1.942993806s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [......XX............X............X....X..............X...X..] duration:
5.9253223s
FAIL (2025-08-23 00:52:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1616dff85fdc1e79799be9d4711f65b71949ade4bf2f50b441ba788aaa363870 != before 2eaf06ea70f0db11df6b5f2e7ec58774a26884c2a506482a72174eae93bdc2cc
======LOGS======
Aug 23 00:50:36.188315609 (343h24m30.61939574s) [upload=357226]: Starting upload
Aug 23 00:50:36.188364953 (343h24m30.619445084s) [upload=357226]: Done starting upload
Aug 23 00:50:36.188429106 (343h24m30.619509227s) [upload=357226]: Uploading segments...
Aug 23 00:50:36.188695556 (343h24m30.619775687s) [upload=357226]: Got next segment. Inline: false
Aug 23 00:50:36.188730232 (343h24m30.619810363s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:50:36.188734721 (343h24m30.619814852s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:50:36.638155086 (343h24m31.069235217s) [seg_pos={0 0}, upload=357226]: Begin upload segment...
Aug 23 00:50:36.638206273 (343h24m31.069286404s) [seg_pos={0 0}, upload=357226]: Done begin upload segment.
Aug 23 00:50:36.638235158 (343h24m31.069315329s) [noise=true , address=104.36.82.7:4935 , piece_id=WVB7HLXMUR4HVESI3WOT6DSKDQAHIB24SWZYIWYSC6J7EGL5BC7A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.638929327 (343h24m31.070009448s) [noise=true , address=104.36.82.8:4978 , piece_id=C6IOJAGBUHDJVZRFA5YEDOE42MQEHBTZZFAEGCHNLC777XSKXMIQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639211426 (343h24m31.070291557s) [noise=true , address=77.90.31.21:4905 , piece_id=4CLTQ6Q2KZMJZVEXZOYCXMMC2EMCKZQCRCS7GVJHSMWH6JPI6CMQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639470011 (343h24m31.070550132s) [noise=true , address=77.90.31.11:4565 , piece_id=VP7SQ2AWRMRZAXYZNUKYU2OXIXXI4CV2F4R5NEJ5NFUVXVXTEBRQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639754947 (343h24m31.070835088s) [noise=true , address=104.36.82.35:4595 , piece_id=7XAWWIANL4EFIROIP4N7QEJTE66B6Y4AVYC5MCOUQ62Z7PCI7LOA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639987451 (343h24m31.071067582s) [noise=true , address=77.90.31.10:4548 , piece_id=YV27ZUT5OR7ZM6L2A2XWAUQ6WEEQTP3SF4NSG2WHJS45VJUMF4VQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640207953 (343h24m31.071288084s) [noise=true , address=104.36.82.45:4933 , piece_id=TTASJWLGPYULP2QNSI52OJ6U4SHTJTT45P7JGJPIMMTBIIKTNCYA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640500613 (343h24m31.071580744s) [noise=true , address=104.36.82.18:4367 , piece_id=LC7INYDUM6WPJHIOXM4EIYRNMHVNWK5AQUF4S4H7RS7PXL6A3XFA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640737016 (343h24m31.071817147s) [noise=true , address=104.36.82.19:4416 , piece_id=W3H4MM4MRNPQ5XBLOHVZEWQHVGIHQFPJ5ZFSPO7454SI4WECRYCA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640948941 (343h24m31.072029072s) [noise=true , address=79.127.219.48:4108 , piece_id=XCMERIBX4ALNPPL54JBVJ2I5SB7X624OA43QA56JKHILUH7IKGQQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641158632 (343h24m31.072238763s) [noise=true , address=104.36.82.50:4031 , piece_id=JBHQ7IOSC3VKESJRX22AVJZ5D4R22RR4E6BFMWSJOCSXVNULI4AA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641398712 (343h24m31.072478833s) [noise=true , address=104.36.82.62:4423 , piece_id=RFYAIJXORZV4VDH6VRASR47AOEPXGYP4FPFUIWJWJV5GVH4BBCTQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641599906 (343h24m31.072680037s) [noise=true , address=77.90.31.16:4748 , piece_id=NK237YCVGJKICABNKPQ4JV5VXHPSU5VL4YCJNBKWHJTCTLP5D72A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641821570 (343h24m31.072901702s) [noise=true , address=104.36.82.34:4570 , piece_id=XBYGLTUGS5H3KXMU57DHHZFXXPGWFBN5FZY7MUIT3YR2JQEXD35A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641861698 (343h24m31.072941829s) [noise=true , address=45.91.116.11:4143 , piece_id=JZFPZ76E52DS65XHVCM322UB2UAU3EOSEQFKGMPCJQ7JUXD7G7PA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642124540 (343h24m31.073204661s) [noise=true , address=77.90.31.12:4604 , piece_id=MY6YXPLJ773DAOAWJ7TAZMBAAWDAAN7LAW6TOXG6AIMWDH6UTQEA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642351124 (343h24m31.073431245s) [noise=true , address=77.90.31.18:4835 , piece_id=2BBC3TUK36SFA7RIDBOXHDSEWZAQNXJ2CHTWKL4GGHUP3VHULPIA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642641529 (343h24m31.073721661s) [noise=true , address=104.36.82.9:4034 , piece_id=2Q54R2GTNK6CZFI5UNJNWVALMXWQ75VVUEGXLMXIVYENFCH7C62Q, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:38.143806591 (343h24m32.574886722s) [upload=357226]: Next returned nil segment
Aug 23 00:50:38.143826288 (343h24m32.574906419s) [upload=357226]: Waiting for error group managing segments...
Aug 23 00:50:38.537487515 (343h24m32.968567646s) [noise=true , address=77.90.31.12:4604 , piece_id=MY6YXPLJ773DAOAWJ7TAZMBAAWDAAN7LAW6TOXG6AIMWDH6UTQEA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.558312561 (343h24m32.989392692s) [noise=true , address=104.36.82.35:4595 , piece_id=7XAWWIANL4EFIROIP4N7QEJTE66B6Y4AVYC5MCOUQ62Z7PCI7LOA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.559281495 (343h24m32.990361626s) [noise=true , address=104.36.82.9:4034 , piece_id=2Q54R2GTNK6CZFI5UNJNWVALMXWQ75VVUEGXLMXIVYENFCH7C62Q, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.560152993 (343h24m32.991233124s) [noise=true , address=104.36.82.34:4570 , piece_id=XBYGLTUGS5H3KXMU57DHHZFXXPGWFBN5FZY7MUIT3YR2JQEXD35A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.569194232 (343h24m33.000274363s) [noise=true , address=104.36.82.62:4423 , piece_id=RFYAIJXORZV4VDH6VRASR47AOEPXGYP4FPFUIWJWJV5GVH4BBCTQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.572780634 (343h24m33.003860765s) [noise=true , address=77.90.31.11:4565 , piece_id=VP7SQ2AWRMRZAXYZNUKYU2OXIXXI4CV2F4R5NEJ5NFUVXVXTEBRQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.587894953 (343h24m33.018975084s) [noise=true , address=79.127.219.48:4108 , piece_id=XCMERIBX4ALNPPL54JBVJ2I5SB7X624OA43QA56JKHILUH7IKGQQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.590340432 (343h24m33.021420563s) [noise=true , address=77.90.31.18:4835 , piece_id=2BBC3TUK36SFA7RIDBOXHDSEWZAQNXJ2CHTWKL4GGHUP3VHULPIA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.611821283 (343h24m33.042901404s) [noise=true , address=77.90.31.16:4748 , piece_id=NK237YCVGJKICABNKPQ4JV5VXHPSU5VL4YCJNBKWHJTCTLP5D72A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.625378624 (343h24m33.056458755s) [noise=true , address=104.36.82.7:4935 , piece_id=WVB7HLXMUR4HVESI3WOT6DSKDQAHIB24SWZYIWYSC6J7EGL5BC7A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.627531103 (343h24m33.058611234s) [noise=true , address=104.36.82.19:4416 , piece_id=W3H4MM4MRNPQ5XBLOHVZEWQHVGIHQFPJ5ZFSPO7454SI4WECRYCA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.631188921 (343h24m33.062269092s) [noise=true , address=77.90.31.10:4548 , piece_id=YV27ZUT5OR7ZM6L2A2XWAUQ6WEEQTP3SF4NSG2WHJS45VJUMF4VQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.637452566 (343h24m33.068532698s) [noise=true , address=104.36.82.18:4367 , piece_id=LC7INYDUM6WPJHIOXM4EIYRNMHVNWK5AQUF4S4H7RS7PXL6A3XFA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.699486280 (343h24m33.130566412s) [noise=true , address=104.36.82.8:4978 , piece_id=C6IOJAGBUHDJVZRFA5YEDOE42MQEHBTZZFAEGCHNLC777XSKXMIQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.699516318 (343h24m33.130596449s) [seg_pos={0 0}, upload=357226]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:50:38.699625627 (343h24m33.130705758s) [noise=true , address=45.91.116.11:4143 , piece_id=JZFPZ76E52DS65XHVCM322UB2UAU3EOSEQFKGMPCJQ7JUXD7G7PA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12caEiJobigXcGWwaX3Vt16zd2NXqk1WzLWxZME44E8Q8wdhn3q): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699654923 (343h24m33.130735054s) [noise=true , address=104.36.82.50:4031 , piece_id=JBHQ7IOSC3VKESJRX22AVJZ5D4R22RR4E6BFMWSJOCSXVNULI4AA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ypc3zkMzWs3wqx9QaExy7sHvnSatwYH8Y9rHi7qt3xRELfsAa): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699700991 (343h24m33.130781123s) [noise=true , address=77.90.31.21:4905 , piece_id=4CLTQ6Q2KZMJZVEXZOYCXMMC2EMCKZQCRCS7GVJHSMWH6JPI6CMQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699719516 (343h24m33.130799697s) [noise=true , address=104.36.82.45:4933 , piece_id=TTASJWLGPYULP2QNSI52OJ6U4SHTJTT45P7JGJPIMMTBIIKTNCYA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kj9KJZo29cpWQSprwxjWe82BrKnYYDTuKguPJm9hn8yVG83ou): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699746979 (343h24m33.13082711s) [seg_pos={0 0}, upload=357226]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:50:38.699826351 (343h24m33.130906482s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:50:38.699831100 (343h24m33.130911231s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:50:39.015620264 (343h24m33.446700395s) [upload=357226]: Done uploading segments...
Aug 23 00:50:39.015639371 (343h24m33.446719502s) [upload=357226]: Upload finished. err: <nil>
Duration: 5.925342479s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.......XX............X............X....X..............X...X.] duration:
5.826615812s
FAIL (2025-08-23 00:51:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1616dff85fdc1e79799be9d4711f65b71949ade4bf2f50b441ba788aaa363870 != before 2eaf06ea70f0db11df6b5f2e7ec58774a26884c2a506482a72174eae93bdc2cc
======LOGS======
Aug 23 00:50:36.188315609 (343h24m30.61939574s) [upload=357226]: Starting upload
Aug 23 00:50:36.188364953 (343h24m30.619445084s) [upload=357226]: Done starting upload
Aug 23 00:50:36.188429106 (343h24m30.619509227s) [upload=357226]: Uploading segments...
Aug 23 00:50:36.188695556 (343h24m30.619775687s) [upload=357226]: Got next segment. Inline: false
Aug 23 00:50:36.188730232 (343h24m30.619810363s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:50:36.188734721 (343h24m30.619814852s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:50:36.638155086 (343h24m31.069235217s) [seg_pos={0 0}, upload=357226]: Begin upload segment...
Aug 23 00:50:36.638206273 (343h24m31.069286404s) [seg_pos={0 0}, upload=357226]: Done begin upload segment.
Aug 23 00:50:36.638235158 (343h24m31.069315329s) [noise=true , address=104.36.82.7:4935 , piece_id=WVB7HLXMUR4HVESI3WOT6DSKDQAHIB24SWZYIWYSC6J7EGL5BC7A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.638929327 (343h24m31.070009448s) [noise=true , address=104.36.82.8:4978 , piece_id=C6IOJAGBUHDJVZRFA5YEDOE42MQEHBTZZFAEGCHNLC777XSKXMIQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639211426 (343h24m31.070291557s) [noise=true , address=77.90.31.21:4905 , piece_id=4CLTQ6Q2KZMJZVEXZOYCXMMC2EMCKZQCRCS7GVJHSMWH6JPI6CMQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639470011 (343h24m31.070550132s) [noise=true , address=77.90.31.11:4565 , piece_id=VP7SQ2AWRMRZAXYZNUKYU2OXIXXI4CV2F4R5NEJ5NFUVXVXTEBRQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639754947 (343h24m31.070835088s) [noise=true , address=104.36.82.35:4595 , piece_id=7XAWWIANL4EFIROIP4N7QEJTE66B6Y4AVYC5MCOUQ62Z7PCI7LOA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639987451 (343h24m31.071067582s) [noise=true , address=77.90.31.10:4548 , piece_id=YV27ZUT5OR7ZM6L2A2XWAUQ6WEEQTP3SF4NSG2WHJS45VJUMF4VQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640207953 (343h24m31.071288084s) [noise=true , address=104.36.82.45:4933 , piece_id=TTASJWLGPYULP2QNSI52OJ6U4SHTJTT45P7JGJPIMMTBIIKTNCYA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640500613 (343h24m31.071580744s) [noise=true , address=104.36.82.18:4367 , piece_id=LC7INYDUM6WPJHIOXM4EIYRNMHVNWK5AQUF4S4H7RS7PXL6A3XFA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640737016 (343h24m31.071817147s) [noise=true , address=104.36.82.19:4416 , piece_id=W3H4MM4MRNPQ5XBLOHVZEWQHVGIHQFPJ5ZFSPO7454SI4WECRYCA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640948941 (343h24m31.072029072s) [noise=true , address=79.127.219.48:4108 , piece_id=XCMERIBX4ALNPPL54JBVJ2I5SB7X624OA43QA56JKHILUH7IKGQQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641158632 (343h24m31.072238763s) [noise=true , address=104.36.82.50:4031 , piece_id=JBHQ7IOSC3VKESJRX22AVJZ5D4R22RR4E6BFMWSJOCSXVNULI4AA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641398712 (343h24m31.072478833s) [noise=true , address=104.36.82.62:4423 , piece_id=RFYAIJXORZV4VDH6VRASR47AOEPXGYP4FPFUIWJWJV5GVH4BBCTQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641599906 (343h24m31.072680037s) [noise=true , address=77.90.31.16:4748 , piece_id=NK237YCVGJKICABNKPQ4JV5VXHPSU5VL4YCJNBKWHJTCTLP5D72A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641821570 (343h24m31.072901702s) [noise=true , address=104.36.82.34:4570 , piece_id=XBYGLTUGS5H3KXMU57DHHZFXXPGWFBN5FZY7MUIT3YR2JQEXD35A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641861698 (343h24m31.072941829s) [noise=true , address=45.91.116.11:4143 , piece_id=JZFPZ76E52DS65XHVCM322UB2UAU3EOSEQFKGMPCJQ7JUXD7G7PA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642124540 (343h24m31.073204661s) [noise=true , address=77.90.31.12:4604 , piece_id=MY6YXPLJ773DAOAWJ7TAZMBAAWDAAN7LAW6TOXG6AIMWDH6UTQEA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642351124 (343h24m31.073431245s) [noise=true , address=77.90.31.18:4835 , piece_id=2BBC3TUK36SFA7RIDBOXHDSEWZAQNXJ2CHTWKL4GGHUP3VHULPIA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642641529 (343h24m31.073721661s) [noise=true , address=104.36.82.9:4034 , piece_id=2Q54R2GTNK6CZFI5UNJNWVALMXWQ75VVUEGXLMXIVYENFCH7C62Q, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:38.143806591 (343h24m32.574886722s) [upload=357226]: Next returned nil segment
Aug 23 00:50:38.143826288 (343h24m32.574906419s) [upload=357226]: Waiting for error group managing segments...
Aug 23 00:50:38.537487515 (343h24m32.968567646s) [noise=true , address=77.90.31.12:4604 , piece_id=MY6YXPLJ773DAOAWJ7TAZMBAAWDAAN7LAW6TOXG6AIMWDH6UTQEA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.558312561 (343h24m32.989392692s) [noise=true , address=104.36.82.35:4595 , piece_id=7XAWWIANL4EFIROIP4N7QEJTE66B6Y4AVYC5MCOUQ62Z7PCI7LOA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.559281495 (343h24m32.990361626s) [noise=true , address=104.36.82.9:4034 , piece_id=2Q54R2GTNK6CZFI5UNJNWVALMXWQ75VVUEGXLMXIVYENFCH7C62Q, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.560152993 (343h24m32.991233124s) [noise=true , address=104.36.82.34:4570 , piece_id=XBYGLTUGS5H3KXMU57DHHZFXXPGWFBN5FZY7MUIT3YR2JQEXD35A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.569194232 (343h24m33.000274363s) [noise=true , address=104.36.82.62:4423 , piece_id=RFYAIJXORZV4VDH6VRASR47AOEPXGYP4FPFUIWJWJV5GVH4BBCTQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.572780634 (343h24m33.003860765s) [noise=true , address=77.90.31.11:4565 , piece_id=VP7SQ2AWRMRZAXYZNUKYU2OXIXXI4CV2F4R5NEJ5NFUVXVXTEBRQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.587894953 (343h24m33.018975084s) [noise=true , address=79.127.219.48:4108 , piece_id=XCMERIBX4ALNPPL54JBVJ2I5SB7X624OA43QA56JKHILUH7IKGQQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.590340432 (343h24m33.021420563s) [noise=true , address=77.90.31.18:4835 , piece_id=2BBC3TUK36SFA7RIDBOXHDSEWZAQNXJ2CHTWKL4GGHUP3VHULPIA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.611821283 (343h24m33.042901404s) [noise=true , address=77.90.31.16:4748 , piece_id=NK237YCVGJKICABNKPQ4JV5VXHPSU5VL4YCJNBKWHJTCTLP5D72A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.625378624 (343h24m33.056458755s) [noise=true , address=104.36.82.7:4935 , piece_id=WVB7HLXMUR4HVESI3WOT6DSKDQAHIB24SWZYIWYSC6J7EGL5BC7A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.627531103 (343h24m33.058611234s) [noise=true , address=104.36.82.19:4416 , piece_id=W3H4MM4MRNPQ5XBLOHVZEWQHVGIHQFPJ5ZFSPO7454SI4WECRYCA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.631188921 (343h24m33.062269092s) [noise=true , address=77.90.31.10:4548 , piece_id=YV27ZUT5OR7ZM6L2A2XWAUQ6WEEQTP3SF4NSG2WHJS45VJUMF4VQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.637452566 (343h24m33.068532698s) [noise=true , address=104.36.82.18:4367 , piece_id=LC7INYDUM6WPJHIOXM4EIYRNMHVNWK5AQUF4S4H7RS7PXL6A3XFA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.699486280 (343h24m33.130566412s) [noise=true , address=104.36.82.8:4978 , piece_id=C6IOJAGBUHDJVZRFA5YEDOE42MQEHBTZZFAEGCHNLC777XSKXMIQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.699516318 (343h24m33.130596449s) [seg_pos={0 0}, upload=357226]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:50:38.699625627 (343h24m33.130705758s) [noise=true , address=45.91.116.11:4143 , piece_id=JZFPZ76E52DS65XHVCM322UB2UAU3EOSEQFKGMPCJQ7JUXD7G7PA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12caEiJobigXcGWwaX3Vt16zd2NXqk1WzLWxZME44E8Q8wdhn3q): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699654923 (343h24m33.130735054s) [noise=true , address=104.36.82.50:4031 , piece_id=JBHQ7IOSC3VKESJRX22AVJZ5D4R22RR4E6BFMWSJOCSXVNULI4AA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ypc3zkMzWs3wqx9QaExy7sHvnSatwYH8Y9rHi7qt3xRELfsAa): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699700991 (343h24m33.130781123s) [noise=true , address=77.90.31.21:4905 , piece_id=4CLTQ6Q2KZMJZVEXZOYCXMMC2EMCKZQCRCS7GVJHSMWH6JPI6CMQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699719516 (343h24m33.130799697s) [noise=true , address=104.36.82.45:4933 , piece_id=TTASJWLGPYULP2QNSI52OJ6U4SHTJTT45P7JGJPIMMTBIIKTNCYA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kj9KJZo29cpWQSprwxjWe82BrKnYYDTuKguPJm9hn8yVG83ou): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699746979 (343h24m33.13082711s) [seg_pos={0 0}, upload=357226]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:50:38.699826351 (343h24m33.130906482s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:50:38.699831100 (343h24m33.130911231s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:50:39.015620264 (343h24m33.446700395s) [upload=357226]: Done uploading segments...
Aug 23 00:50:39.015639371 (343h24m33.446719502s) [upload=357226]: Upload finished. err: <nil>
Duration: 5.82663598s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.............X....................X........XX.....X.........] duration:
1.909997746s
FAIL (2025-08-23 00:51:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 1.910030367s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..............X....................X........XX.....X........] duration:
2.002604398s
FAIL (2025-08-23 00:51:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 2.002633794s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [X.......XX............X............X....X..............X...X] duration:
5.786750349s
FAIL (2025-08-23 00:50:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1616dff85fdc1e79799be9d4711f65b71949ade4bf2f50b441ba788aaa363870 != before 2eaf06ea70f0db11df6b5f2e7ec58774a26884c2a506482a72174eae93bdc2cc
======LOGS======
Aug 23 00:50:36.188315609 (343h24m30.61939574s) [upload=357226]: Starting upload
Aug 23 00:50:36.188364953 (343h24m30.619445084s) [upload=357226]: Done starting upload
Aug 23 00:50:36.188429106 (343h24m30.619509227s) [upload=357226]: Uploading segments...
Aug 23 00:50:36.188695556 (343h24m30.619775687s) [upload=357226]: Got next segment. Inline: false
Aug 23 00:50:36.188730232 (343h24m30.619810363s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:50:36.188734721 (343h24m30.619814852s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:50:36.638155086 (343h24m31.069235217s) [seg_pos={0 0}, upload=357226]: Begin upload segment...
Aug 23 00:50:36.638206273 (343h24m31.069286404s) [seg_pos={0 0}, upload=357226]: Done begin upload segment.
Aug 23 00:50:36.638235158 (343h24m31.069315329s) [noise=true , address=104.36.82.7:4935 , piece_id=WVB7HLXMUR4HVESI3WOT6DSKDQAHIB24SWZYIWYSC6J7EGL5BC7A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.638929327 (343h24m31.070009448s) [noise=true , address=104.36.82.8:4978 , piece_id=C6IOJAGBUHDJVZRFA5YEDOE42MQEHBTZZFAEGCHNLC777XSKXMIQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639211426 (343h24m31.070291557s) [noise=true , address=77.90.31.21:4905 , piece_id=4CLTQ6Q2KZMJZVEXZOYCXMMC2EMCKZQCRCS7GVJHSMWH6JPI6CMQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639470011 (343h24m31.070550132s) [noise=true , address=77.90.31.11:4565 , piece_id=VP7SQ2AWRMRZAXYZNUKYU2OXIXXI4CV2F4R5NEJ5NFUVXVXTEBRQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639754947 (343h24m31.070835088s) [noise=true , address=104.36.82.35:4595 , piece_id=7XAWWIANL4EFIROIP4N7QEJTE66B6Y4AVYC5MCOUQ62Z7PCI7LOA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.639987451 (343h24m31.071067582s) [noise=true , address=77.90.31.10:4548 , piece_id=YV27ZUT5OR7ZM6L2A2XWAUQ6WEEQTP3SF4NSG2WHJS45VJUMF4VQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640207953 (343h24m31.071288084s) [noise=true , address=104.36.82.45:4933 , piece_id=TTASJWLGPYULP2QNSI52OJ6U4SHTJTT45P7JGJPIMMTBIIKTNCYA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640500613 (343h24m31.071580744s) [noise=true , address=104.36.82.18:4367 , piece_id=LC7INYDUM6WPJHIOXM4EIYRNMHVNWK5AQUF4S4H7RS7PXL6A3XFA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640737016 (343h24m31.071817147s) [noise=true , address=104.36.82.19:4416 , piece_id=W3H4MM4MRNPQ5XBLOHVZEWQHVGIHQFPJ5ZFSPO7454SI4WECRYCA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.640948941 (343h24m31.072029072s) [noise=true , address=79.127.219.48:4108 , piece_id=XCMERIBX4ALNPPL54JBVJ2I5SB7X624OA43QA56JKHILUH7IKGQQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641158632 (343h24m31.072238763s) [noise=true , address=104.36.82.50:4031 , piece_id=JBHQ7IOSC3VKESJRX22AVJZ5D4R22RR4E6BFMWSJOCSXVNULI4AA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641398712 (343h24m31.072478833s) [noise=true , address=104.36.82.62:4423 , piece_id=RFYAIJXORZV4VDH6VRASR47AOEPXGYP4FPFUIWJWJV5GVH4BBCTQ, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641599906 (343h24m31.072680037s) [noise=true , address=77.90.31.16:4748 , piece_id=NK237YCVGJKICABNKPQ4JV5VXHPSU5VL4YCJNBKWHJTCTLP5D72A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641821570 (343h24m31.072901702s) [noise=true , address=104.36.82.34:4570 , piece_id=XBYGLTUGS5H3KXMU57DHHZFXXPGWFBN5FZY7MUIT3YR2JQEXD35A, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.641861698 (343h24m31.072941829s) [noise=true , address=45.91.116.11:4143 , piece_id=JZFPZ76E52DS65XHVCM322UB2UAU3EOSEQFKGMPCJQ7JUXD7G7PA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642124540 (343h24m31.073204661s) [noise=true , address=77.90.31.12:4604 , piece_id=MY6YXPLJ773DAOAWJ7TAZMBAAWDAAN7LAW6TOXG6AIMWDH6UTQEA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642351124 (343h24m31.073431245s) [noise=true , address=77.90.31.18:4835 , piece_id=2BBC3TUK36SFA7RIDBOXHDSEWZAQNXJ2CHTWKL4GGHUP3VHULPIA, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:36.642641529 (343h24m31.073721661s) [noise=true , address=104.36.82.9:4034 , piece_id=2Q54R2GTNK6CZFI5UNJNWVALMXWQ75VVUEGXLMXIVYENFCH7C62Q, seg_pos={0 0}, upload=357226]: Uploading piece...
Aug 23 00:50:38.143806591 (343h24m32.574886722s) [upload=357226]: Next returned nil segment
Aug 23 00:50:38.143826288 (343h24m32.574906419s) [upload=357226]: Waiting for error group managing segments...
Aug 23 00:50:38.537487515 (343h24m32.968567646s) [noise=true , address=77.90.31.12:4604 , piece_id=MY6YXPLJ773DAOAWJ7TAZMBAAWDAAN7LAW6TOXG6AIMWDH6UTQEA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.558312561 (343h24m32.989392692s) [noise=true , address=104.36.82.35:4595 , piece_id=7XAWWIANL4EFIROIP4N7QEJTE66B6Y4AVYC5MCOUQ62Z7PCI7LOA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.559281495 (343h24m32.990361626s) [noise=true , address=104.36.82.9:4034 , piece_id=2Q54R2GTNK6CZFI5UNJNWVALMXWQ75VVUEGXLMXIVYENFCH7C62Q, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.560152993 (343h24m32.991233124s) [noise=true , address=104.36.82.34:4570 , piece_id=XBYGLTUGS5H3KXMU57DHHZFXXPGWFBN5FZY7MUIT3YR2JQEXD35A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.569194232 (343h24m33.000274363s) [noise=true , address=104.36.82.62:4423 , piece_id=RFYAIJXORZV4VDH6VRASR47AOEPXGYP4FPFUIWJWJV5GVH4BBCTQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.572780634 (343h24m33.003860765s) [noise=true , address=77.90.31.11:4565 , piece_id=VP7SQ2AWRMRZAXYZNUKYU2OXIXXI4CV2F4R5NEJ5NFUVXVXTEBRQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.587894953 (343h24m33.018975084s) [noise=true , address=79.127.219.48:4108 , piece_id=XCMERIBX4ALNPPL54JBVJ2I5SB7X624OA43QA56JKHILUH7IKGQQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.590340432 (343h24m33.021420563s) [noise=true , address=77.90.31.18:4835 , piece_id=2BBC3TUK36SFA7RIDBOXHDSEWZAQNXJ2CHTWKL4GGHUP3VHULPIA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.611821283 (343h24m33.042901404s) [noise=true , address=77.90.31.16:4748 , piece_id=NK237YCVGJKICABNKPQ4JV5VXHPSU5VL4YCJNBKWHJTCTLP5D72A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.625378624 (343h24m33.056458755s) [noise=true , address=104.36.82.7:4935 , piece_id=WVB7HLXMUR4HVESI3WOT6DSKDQAHIB24SWZYIWYSC6J7EGL5BC7A, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.627531103 (343h24m33.058611234s) [noise=true , address=104.36.82.19:4416 , piece_id=W3H4MM4MRNPQ5XBLOHVZEWQHVGIHQFPJ5ZFSPO7454SI4WECRYCA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.631188921 (343h24m33.062269092s) [noise=true , address=77.90.31.10:4548 , piece_id=YV27ZUT5OR7ZM6L2A2XWAUQ6WEEQTP3SF4NSG2WHJS45VJUMF4VQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.637452566 (343h24m33.068532698s) [noise=true , address=104.36.82.18:4367 , piece_id=LC7INYDUM6WPJHIOXM4EIYRNMHVNWK5AQUF4S4H7RS7PXL6A3XFA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.699486280 (343h24m33.130566412s) [noise=true , address=104.36.82.8:4978 , piece_id=C6IOJAGBUHDJVZRFA5YEDOE42MQEHBTZZFAEGCHNLC777XSKXMIQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: <nil>
Aug 23 00:50:38.699516318 (343h24m33.130596449s) [seg_pos={0 0}, upload=357226]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:50:38.699625627 (343h24m33.130705758s) [noise=true , address=45.91.116.11:4143 , piece_id=JZFPZ76E52DS65XHVCM322UB2UAU3EOSEQFKGMPCJQ7JUXD7G7PA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12caEiJobigXcGWwaX3Vt16zd2NXqk1WzLWxZME44E8Q8wdhn3q): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699654923 (343h24m33.130735054s) [noise=true , address=104.36.82.50:4031 , piece_id=JBHQ7IOSC3VKESJRX22AVJZ5D4R22RR4E6BFMWSJOCSXVNULI4AA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ypc3zkMzWs3wqx9QaExy7sHvnSatwYH8Y9rHi7qt3xRELfsAa): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699700991 (343h24m33.130781123s) [noise=true , address=77.90.31.21:4905 , piece_id=4CLTQ6Q2KZMJZVEXZOYCXMMC2EMCKZQCRCS7GVJHSMWH6JPI6CMQ, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1X5A7bLqMEQuaMbf9xZ7PDUD4161sz2QqdM9r59y3bsyPBJhaK): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699719516 (343h24m33.130799697s) [noise=true , address=104.36.82.45:4933 , piece_id=TTASJWLGPYULP2QNSI52OJ6U4SHTJTT45P7JGJPIMMTBIIKTNCYA, seg_pos={0 0}, upload=357226]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Kj9KJZo29cpWQSprwxjWe82BrKnYYDTuKguPJm9hn8yVG83ou): protocol: expected piece hash; context canceled; EOF
Aug 23 00:50:38.699746979 (343h24m33.13082711s) [seg_pos={0 0}, upload=357226]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:50:38.699826351 (343h24m33.130906482s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:50:38.699831100 (343h24m33.130911231s) [upload=357226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:50:39.015620264 (343h24m33.446700395s) [upload=357226]: Done uploading segments...
Aug 23 00:50:39.015639371 (343h24m33.446719502s) [upload=357226]: Upload finished. err: <nil>
Duration: 5.786780165s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...............X....................X........XX.....X.......] duration:
1.856008835s
FAIL (2025-08-23 00:50:25 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 1.856034293s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.X.......XX............X............X....X..............X...] duration:
5.678816181s
FAIL (2025-08-23 00:49:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 23 00:47:25.001402247 (343h21m19.432482398s) [upload=357171]: Starting upload
Aug 23 00:47:25.001497579 (343h21m19.43257778s) [upload=357171]: Done starting upload
Aug 23 00:47:25.001625825 (343h21m19.432705966s) [upload=357171]: Uploading segments...
Aug 23 00:47:25.002063192 (343h21m19.433143323s) [upload=357171]: Got next segment. Inline: false
Aug 23 00:47:25.002111384 (343h21m19.433191515s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:47:25.002116414 (343h21m19.433196535s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:47:25.455280201 (343h21m19.886360332s) [seg_pos={0 0}, upload=357171]: Begin upload segment...
Aug 23 00:47:25.455330788 (343h21m19.886410919s) [seg_pos={0 0}, upload=357171]: Done begin upload segment.
Aug 23 00:47:25.455354803 (343h21m19.886434934s) [noise=true , address=104.36.82.5:4872 , piece_id=R2V3VMLFKPMK6Z3F34HH5KPPI5SGY7V5D73NBQLF6M5DYJZAJOTQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.455380803 (343h21m19.886460934s) [noise=true , address=104.36.82.49:4987 , piece_id=JIECM3OOL6IYQ3RJ53AZQDDPHJTUUPIUIWG7L6CG7ZLZE6OGXLQA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.455731474 (343h21m19.886811605s) [noise=true , address=77.90.31.11:4557 , piece_id=CAUVBE5FPQQBWWXKJGU57UE27F5ZHMFWOSYVOCCOQXPKGGHZQHZA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.455814032 (343h21m19.886894153s) [noise=true , address=79.127.219.48:4093 , piece_id=OJEJH4OGGPQX6ZUOPYRPZQL2JSR5WHGZXW52OK6TBJDZ5FPUOFLA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456069311 (343h21m19.887149442s) [noise=true , address=77.90.31.10:4523 , piece_id=3DJUNKQIAWINRZGPRFDSCJ35Z346E4B7QRTIKHTQ337AUUGRMGHA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456099799 (343h21m19.88717993s) [noise=true , address=77.90.31.18:4824 , piece_id=KQYX5T7CSGIHHIJT6FO5CQM565T5JB4GCOP6GWELPDA2QCXD75WQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456416074 (343h21m19.887496205s) [noise=true , address=45.91.116.6:4988 , piece_id=Q34YCUCGA64LUKKD5IT3VMMJRHQFBEH3BARRUHLNY3BKLMFUXVUA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456718723 (343h21m19.887798854s) [noise=true , address=104.36.82.6:4902 , piece_id=NHSIRPQ7L3JBVITIZYZ5M544PWRFWWUSUSA6I3YB7B5NX3SIQ6BQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456994080 (343h21m19.888074211s) [noise=true , address=104.36.82.6:4892 , piece_id=XGZI6G4A5Q3RFKKFZXOJTYJ2HHARANN6U5HYVEOQE72RYYBAWTKA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457219731 (343h21m19.888299862s) [noise=true , address=104.36.82.44:4894 , piece_id=STWZBH3F2JV2ML4O7OYFMWBR3NHGDZ67SZDKSAJ5QW6HLBP5BCXQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457478166 (343h21m19.888558287s) [noise=true , address=104.36.82.45:4932 , piece_id=LOQOTVEDLKNI2OQ43ZRUAROSQ4NV5SW4QCGMAGPWR5C4PU35NNOA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457693909 (343h21m19.88877404s) [noise=true , address=104.36.82.42:4823 , piece_id=SGO5GVI5VXOLVSKVBEEVMI37SDVOG3M624WOHUBIJDBAP5UNZJTA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457945591 (343h21m19.889025722s) [noise=true , address=77.90.31.19:4859 , piece_id=AAMVJSWWDZNSKVDO74UP6D5W3VO2RFSGW6B4ARGDEQAEYDHKYKGQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458177594 (343h21m19.889257725s) [noise=true , address=104.36.82.35:4594 , piece_id=MXD6XREZYJ37GBU6IJWLEX4XMH75JX6F56TGJ4NLGXGHKHYQMOAQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458379892 (343h21m19.889460013s) [noise=true , address=77.90.31.21:4883 , piece_id=BIJ24ORFDOP47IFDGQYKZHX4HYOEUCK7IDFBBKA2ERI54WU2U7SA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458583381 (343h21m19.889663502s) [noise=true , address=45.91.116.4:4943 , piece_id=4TUGGONFOPKRSTKW5YG6TLAE6DWSJZ4F5X5D2TQYVRTMD2MNNEJQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458817379 (343h21m19.8898975s) [noise=true , address=45.91.116.7:4022 , piece_id=LNO4TYOEXBICVEXSJ2SQJVQNACTAV6XVHHCJ4Q2N2O4T556YBAVA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.459124917 (343h21m19.890205048s) [noise=true , address=104.36.82.23:4466 , piece_id=JPMRW7RHYAZH57JWMCIMXCSZOTAUDMQEM3D5QBDLMW2HXEYDE7SA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:26.933318817 (343h21m21.364398948s) [upload=357171]: Next returned nil segment
Aug 23 00:47:26.933338134 (343h21m21.364418265s) [upload=357171]: Waiting for error group managing segments...
Aug 23 00:47:27.371332896 (343h21m21.802413027s) [noise=true , address=77.90.31.18:4824 , piece_id=KQYX5T7CSGIHHIJT6FO5CQM565T5JB4GCOP6GWELPDA2QCXD75WQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.371996285 (343h21m21.803076416s) [noise=true , address=45.91.116.7:4022 , piece_id=LNO4TYOEXBICVEXSJ2SQJVQNACTAV6XVHHCJ4Q2N2O4T556YBAVA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.372190477 (343h21m21.803270598s) [noise=true , address=77.90.31.19:4859 , piece_id=AAMVJSWWDZNSKVDO74UP6D5W3VO2RFSGW6B4ARGDEQAEYDHKYKGQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.388921189 (343h21m21.82000132s) [noise=true , address=104.36.82.6:4902 , piece_id=NHSIRPQ7L3JBVITIZYZ5M544PWRFWWUSUSA6I3YB7B5NX3SIQ6BQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.394693765 (343h21m21.825773896s) [noise=true , address=104.36.82.42:4823 , piece_id=SGO5GVI5VXOLVSKVBEEVMI37SDVOG3M624WOHUBIJDBAP5UNZJTA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.437744126 (343h21m21.868824257s) [noise=true , address=77.90.31.11:4557 , piece_id=CAUVBE5FPQQBWWXKJGU57UE27F5ZHMFWOSYVOCCOQXPKGGHZQHZA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.438028290 (343h21m21.869108422s) [noise=true , address=79.127.219.48:4093 , piece_id=OJEJH4OGGPQX6ZUOPYRPZQL2JSR5WHGZXW52OK6TBJDZ5FPUOFLA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.440347077 (343h21m21.871427208s) [noise=true , address=104.36.82.6:4892 , piece_id=XGZI6G4A5Q3RFKKFZXOJTYJ2HHARANN6U5HYVEOQE72RYYBAWTKA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.446511782 (343h21m21.877591903s) [noise=true , address=77.90.31.10:4523 , piece_id=3DJUNKQIAWINRZGPRFDSCJ35Z346E4B7QRTIKHTQ337AUUGRMGHA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.448913016 (343h21m21.879993147s) [noise=true , address=45.91.116.6:4988 , piece_id=Q34YCUCGA64LUKKD5IT3VMMJRHQFBEH3BARRUHLNY3BKLMFUXVUA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.476338763 (343h21m21.907418894s) [noise=true , address=104.36.82.45:4932 , piece_id=LOQOTVEDLKNI2OQ43ZRUAROSQ4NV5SW4QCGMAGPWR5C4PU35NNOA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.485202973 (343h21m21.916283094s) [noise=true , address=104.36.82.44:4894 , piece_id=STWZBH3F2JV2ML4O7OYFMWBR3NHGDZ67SZDKSAJ5QW6HLBP5BCXQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.514958046 (343h21m21.946038177s) [noise=true , address=104.36.82.49:4987 , piece_id=JIECM3OOL6IYQ3RJ53AZQDDPHJTUUPIUIWG7L6CG7ZLZE6OGXLQA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.516406588 (343h21m21.947486719s) [noise=true , address=104.36.82.23:4466 , piece_id=JPMRW7RHYAZH57JWMCIMXCSZOTAUDMQEM3D5QBDLMW2HXEYDE7SA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.516420655 (343h21m21.947500786s) [seg_pos={0 0}, upload=357171]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:47:27.516659171 (343h21m21.947739292s) [noise=true , address=104.36.82.5:4872 , piece_id=R2V3VMLFKPMK6Z3F34HH5KPPI5SGY7V5D73NBQLF6M5DYJZAJOTQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: write tcp 188.166.225.170:43340->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:43340->104.36.82.5:4872: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43340->104.36.82.5:4872: use of closed network connection
Aug 23 00:47:27.516664611 (343h21m21.947744742s) [noise=true , address=77.90.31.21:4883 , piece_id=BIJ24ORFDOP47IFDGQYKZHX4HYOEUCK7IDFBBKA2ERI54WU2U7SA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:191MKpEnoarS7sK4Gs63ZM8zGc5jevFX8VeqViP82duW33nJJz): protocol: expected piece hash; context canceled; EOF
Aug 23 00:47:27.516701802 (343h21m21.947781933s) [noise=true , address=45.91.116.4:4943 , piece_id=4TUGGONFOPKRSTKW5YG6TLAE6DWSJZ4F5X5D2TQYVRTMD2MNNEJQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128QuaUBgwagbp1fCbMDLMncgCth8bd4kaMTnd4ebP1pvQMB1jv): protocol: write tcp 188.166.225.170:39920->45.91.116.4:4943: use of closed network connection; write tcp 188.166.225.170:39920->45.91.116.4:4943: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39920->45.91.116.4:4943: use of closed network connection
Aug 23 00:47:27.516773129 (343h21m21.94785326s) [noise=true , address=104.36.82.35:4594 , piece_id=MXD6XREZYJ37GBU6IJWLEX4XMH75JX6F56TGJ4NLGXGHKHYQMOAQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D9nh4XFmsjjFcZEMjaL4uw4Whsa8nfMrAsYPu6NVpsxgb3jvf): protocol: expected piece hash; context canceled; EOF
Aug 23 00:47:27.516799189 (343h21m21.94787932s) [seg_pos={0 0}, upload=357171]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:47:27.516882599 (343h21m21.94796273s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:47:27.516887458 (343h21m21.947967589s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:47:27.930461664 (343h21m22.361541825s) [upload=357171]: Done uploading segments...
Aug 23 00:47:27.930485760 (343h21m22.361565881s) [upload=357171]: Upload finished. err: <nil>
Duration: 5.67884176s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [................X....................X........XX.....X......] duration:
1.900622551s
FAIL (2025-08-23 00:49:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 1.900652629s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..X.......XX............X............X....X..............X..] duration:
5.874315846s
FAIL (2025-08-23 00:49:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 23 00:47:25.001402247 (343h21m19.432482398s) [upload=357171]: Starting upload
Aug 23 00:47:25.001497579 (343h21m19.43257778s) [upload=357171]: Done starting upload
Aug 23 00:47:25.001625825 (343h21m19.432705966s) [upload=357171]: Uploading segments...
Aug 23 00:47:25.002063192 (343h21m19.433143323s) [upload=357171]: Got next segment. Inline: false
Aug 23 00:47:25.002111384 (343h21m19.433191515s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:47:25.002116414 (343h21m19.433196535s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:47:25.455280201 (343h21m19.886360332s) [seg_pos={0 0}, upload=357171]: Begin upload segment...
Aug 23 00:47:25.455330788 (343h21m19.886410919s) [seg_pos={0 0}, upload=357171]: Done begin upload segment.
Aug 23 00:47:25.455354803 (343h21m19.886434934s) [noise=true , address=104.36.82.5:4872 , piece_id=R2V3VMLFKPMK6Z3F34HH5KPPI5SGY7V5D73NBQLF6M5DYJZAJOTQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.455380803 (343h21m19.886460934s) [noise=true , address=104.36.82.49:4987 , piece_id=JIECM3OOL6IYQ3RJ53AZQDDPHJTUUPIUIWG7L6CG7ZLZE6OGXLQA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.455731474 (343h21m19.886811605s) [noise=true , address=77.90.31.11:4557 , piece_id=CAUVBE5FPQQBWWXKJGU57UE27F5ZHMFWOSYVOCCOQXPKGGHZQHZA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.455814032 (343h21m19.886894153s) [noise=true , address=79.127.219.48:4093 , piece_id=OJEJH4OGGPQX6ZUOPYRPZQL2JSR5WHGZXW52OK6TBJDZ5FPUOFLA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456069311 (343h21m19.887149442s) [noise=true , address=77.90.31.10:4523 , piece_id=3DJUNKQIAWINRZGPRFDSCJ35Z346E4B7QRTIKHTQ337AUUGRMGHA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456099799 (343h21m19.88717993s) [noise=true , address=77.90.31.18:4824 , piece_id=KQYX5T7CSGIHHIJT6FO5CQM565T5JB4GCOP6GWELPDA2QCXD75WQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456416074 (343h21m19.887496205s) [noise=true , address=45.91.116.6:4988 , piece_id=Q34YCUCGA64LUKKD5IT3VMMJRHQFBEH3BARRUHLNY3BKLMFUXVUA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456718723 (343h21m19.887798854s) [noise=true , address=104.36.82.6:4902 , piece_id=NHSIRPQ7L3JBVITIZYZ5M544PWRFWWUSUSA6I3YB7B5NX3SIQ6BQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456994080 (343h21m19.888074211s) [noise=true , address=104.36.82.6:4892 , piece_id=XGZI6G4A5Q3RFKKFZXOJTYJ2HHARANN6U5HYVEOQE72RYYBAWTKA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457219731 (343h21m19.888299862s) [noise=true , address=104.36.82.44:4894 , piece_id=STWZBH3F2JV2ML4O7OYFMWBR3NHGDZ67SZDKSAJ5QW6HLBP5BCXQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457478166 (343h21m19.888558287s) [noise=true , address=104.36.82.45:4932 , piece_id=LOQOTVEDLKNI2OQ43ZRUAROSQ4NV5SW4QCGMAGPWR5C4PU35NNOA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457693909 (343h21m19.88877404s) [noise=true , address=104.36.82.42:4823 , piece_id=SGO5GVI5VXOLVSKVBEEVMI37SDVOG3M624WOHUBIJDBAP5UNZJTA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457945591 (343h21m19.889025722s) [noise=true , address=77.90.31.19:4859 , piece_id=AAMVJSWWDZNSKVDO74UP6D5W3VO2RFSGW6B4ARGDEQAEYDHKYKGQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458177594 (343h21m19.889257725s) [noise=true , address=104.36.82.35:4594 , piece_id=MXD6XREZYJ37GBU6IJWLEX4XMH75JX6F56TGJ4NLGXGHKHYQMOAQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458379892 (343h21m19.889460013s) [noise=true , address=77.90.31.21:4883 , piece_id=BIJ24ORFDOP47IFDGQYKZHX4HYOEUCK7IDFBBKA2ERI54WU2U7SA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458583381 (343h21m19.889663502s) [noise=true , address=45.91.116.4:4943 , piece_id=4TUGGONFOPKRSTKW5YG6TLAE6DWSJZ4F5X5D2TQYVRTMD2MNNEJQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458817379 (343h21m19.8898975s) [noise=true , address=45.91.116.7:4022 , piece_id=LNO4TYOEXBICVEXSJ2SQJVQNACTAV6XVHHCJ4Q2N2O4T556YBAVA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.459124917 (343h21m19.890205048s) [noise=true , address=104.36.82.23:4466 , piece_id=JPMRW7RHYAZH57JWMCIMXCSZOTAUDMQEM3D5QBDLMW2HXEYDE7SA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:26.933318817 (343h21m21.364398948s) [upload=357171]: Next returned nil segment
Aug 23 00:47:26.933338134 (343h21m21.364418265s) [upload=357171]: Waiting for error group managing segments...
Aug 23 00:47:27.371332896 (343h21m21.802413027s) [noise=true , address=77.90.31.18:4824 , piece_id=KQYX5T7CSGIHHIJT6FO5CQM565T5JB4GCOP6GWELPDA2QCXD75WQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.371996285 (343h21m21.803076416s) [noise=true , address=45.91.116.7:4022 , piece_id=LNO4TYOEXBICVEXSJ2SQJVQNACTAV6XVHHCJ4Q2N2O4T556YBAVA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.372190477 (343h21m21.803270598s) [noise=true , address=77.90.31.19:4859 , piece_id=AAMVJSWWDZNSKVDO74UP6D5W3VO2RFSGW6B4ARGDEQAEYDHKYKGQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.388921189 (343h21m21.82000132s) [noise=true , address=104.36.82.6:4902 , piece_id=NHSIRPQ7L3JBVITIZYZ5M544PWRFWWUSUSA6I3YB7B5NX3SIQ6BQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.394693765 (343h21m21.825773896s) [noise=true , address=104.36.82.42:4823 , piece_id=SGO5GVI5VXOLVSKVBEEVMI37SDVOG3M624WOHUBIJDBAP5UNZJTA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.437744126 (343h21m21.868824257s) [noise=true , address=77.90.31.11:4557 , piece_id=CAUVBE5FPQQBWWXKJGU57UE27F5ZHMFWOSYVOCCOQXPKGGHZQHZA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.438028290 (343h21m21.869108422s) [noise=true , address=79.127.219.48:4093 , piece_id=OJEJH4OGGPQX6ZUOPYRPZQL2JSR5WHGZXW52OK6TBJDZ5FPUOFLA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.440347077 (343h21m21.871427208s) [noise=true , address=104.36.82.6:4892 , piece_id=XGZI6G4A5Q3RFKKFZXOJTYJ2HHARANN6U5HYVEOQE72RYYBAWTKA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.446511782 (343h21m21.877591903s) [noise=true , address=77.90.31.10:4523 , piece_id=3DJUNKQIAWINRZGPRFDSCJ35Z346E4B7QRTIKHTQ337AUUGRMGHA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.448913016 (343h21m21.879993147s) [noise=true , address=45.91.116.6:4988 , piece_id=Q34YCUCGA64LUKKD5IT3VMMJRHQFBEH3BARRUHLNY3BKLMFUXVUA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.476338763 (343h21m21.907418894s) [noise=true , address=104.36.82.45:4932 , piece_id=LOQOTVEDLKNI2OQ43ZRUAROSQ4NV5SW4QCGMAGPWR5C4PU35NNOA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.485202973 (343h21m21.916283094s) [noise=true , address=104.36.82.44:4894 , piece_id=STWZBH3F2JV2ML4O7OYFMWBR3NHGDZ67SZDKSAJ5QW6HLBP5BCXQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.514958046 (343h21m21.946038177s) [noise=true , address=104.36.82.49:4987 , piece_id=JIECM3OOL6IYQ3RJ53AZQDDPHJTUUPIUIWG7L6CG7ZLZE6OGXLQA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.516406588 (343h21m21.947486719s) [noise=true , address=104.36.82.23:4466 , piece_id=JPMRW7RHYAZH57JWMCIMXCSZOTAUDMQEM3D5QBDLMW2HXEYDE7SA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.516420655 (343h21m21.947500786s) [seg_pos={0 0}, upload=357171]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:47:27.516659171 (343h21m21.947739292s) [noise=true , address=104.36.82.5:4872 , piece_id=R2V3VMLFKPMK6Z3F34HH5KPPI5SGY7V5D73NBQLF6M5DYJZAJOTQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: write tcp 188.166.225.170:43340->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:43340->104.36.82.5:4872: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43340->104.36.82.5:4872: use of closed network connection
Aug 23 00:47:27.516664611 (343h21m21.947744742s) [noise=true , address=77.90.31.21:4883 , piece_id=BIJ24ORFDOP47IFDGQYKZHX4HYOEUCK7IDFBBKA2ERI54WU2U7SA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:191MKpEnoarS7sK4Gs63ZM8zGc5jevFX8VeqViP82duW33nJJz): protocol: expected piece hash; context canceled; EOF
Aug 23 00:47:27.516701802 (343h21m21.947781933s) [noise=true , address=45.91.116.4:4943 , piece_id=4TUGGONFOPKRSTKW5YG6TLAE6DWSJZ4F5X5D2TQYVRTMD2MNNEJQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128QuaUBgwagbp1fCbMDLMncgCth8bd4kaMTnd4ebP1pvQMB1jv): protocol: write tcp 188.166.225.170:39920->45.91.116.4:4943: use of closed network connection; write tcp 188.166.225.170:39920->45.91.116.4:4943: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39920->45.91.116.4:4943: use of closed network connection
Aug 23 00:47:27.516773129 (343h21m21.94785326s) [noise=true , address=104.36.82.35:4594 , piece_id=MXD6XREZYJ37GBU6IJWLEX4XMH75JX6F56TGJ4NLGXGHKHYQMOAQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D9nh4XFmsjjFcZEMjaL4uw4Whsa8nfMrAsYPu6NVpsxgb3jvf): protocol: expected piece hash; context canceled; EOF
Aug 23 00:47:27.516799189 (343h21m21.94787932s) [seg_pos={0 0}, upload=357171]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:47:27.516882599 (343h21m21.94796273s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:47:27.516887458 (343h21m21.947967589s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:47:27.930461664 (343h21m22.361541825s) [upload=357171]: Done uploading segments...
Aug 23 00:47:27.930485760 (343h21m22.361565881s) [upload=357171]: Upload finished. err: <nil>
Duration: 5.874342978s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.................X....................X........XX.....X.....] duration:
2.04239625s
FAIL (2025-08-23 00:48:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 2.04242261s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...X.......XX............X............X....X..............X.] duration:
5.589098128s
FAIL (2025-08-23 00:48:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 23 00:47:25.001402247 (343h21m19.432482398s) [upload=357171]: Starting upload
Aug 23 00:47:25.001497579 (343h21m19.43257778s) [upload=357171]: Done starting upload
Aug 23 00:47:25.001625825 (343h21m19.432705966s) [upload=357171]: Uploading segments...
Aug 23 00:47:25.002063192 (343h21m19.433143323s) [upload=357171]: Got next segment. Inline: false
Aug 23 00:47:25.002111384 (343h21m19.433191515s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:47:25.002116414 (343h21m19.433196535s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:47:25.455280201 (343h21m19.886360332s) [seg_pos={0 0}, upload=357171]: Begin upload segment...
Aug 23 00:47:25.455330788 (343h21m19.886410919s) [seg_pos={0 0}, upload=357171]: Done begin upload segment.
Aug 23 00:47:25.455354803 (343h21m19.886434934s) [noise=true , address=104.36.82.5:4872 , piece_id=R2V3VMLFKPMK6Z3F34HH5KPPI5SGY7V5D73NBQLF6M5DYJZAJOTQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.455380803 (343h21m19.886460934s) [noise=true , address=104.36.82.49:4987 , piece_id=JIECM3OOL6IYQ3RJ53AZQDDPHJTUUPIUIWG7L6CG7ZLZE6OGXLQA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.455731474 (343h21m19.886811605s) [noise=true , address=77.90.31.11:4557 , piece_id=CAUVBE5FPQQBWWXKJGU57UE27F5ZHMFWOSYVOCCOQXPKGGHZQHZA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.455814032 (343h21m19.886894153s) [noise=true , address=79.127.219.48:4093 , piece_id=OJEJH4OGGPQX6ZUOPYRPZQL2JSR5WHGZXW52OK6TBJDZ5FPUOFLA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456069311 (343h21m19.887149442s) [noise=true , address=77.90.31.10:4523 , piece_id=3DJUNKQIAWINRZGPRFDSCJ35Z346E4B7QRTIKHTQ337AUUGRMGHA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456099799 (343h21m19.88717993s) [noise=true , address=77.90.31.18:4824 , piece_id=KQYX5T7CSGIHHIJT6FO5CQM565T5JB4GCOP6GWELPDA2QCXD75WQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456416074 (343h21m19.887496205s) [noise=true , address=45.91.116.6:4988 , piece_id=Q34YCUCGA64LUKKD5IT3VMMJRHQFBEH3BARRUHLNY3BKLMFUXVUA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456718723 (343h21m19.887798854s) [noise=true , address=104.36.82.6:4902 , piece_id=NHSIRPQ7L3JBVITIZYZ5M544PWRFWWUSUSA6I3YB7B5NX3SIQ6BQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456994080 (343h21m19.888074211s) [noise=true , address=104.36.82.6:4892 , piece_id=XGZI6G4A5Q3RFKKFZXOJTYJ2HHARANN6U5HYVEOQE72RYYBAWTKA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457219731 (343h21m19.888299862s) [noise=true , address=104.36.82.44:4894 , piece_id=STWZBH3F2JV2ML4O7OYFMWBR3NHGDZ67SZDKSAJ5QW6HLBP5BCXQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457478166 (343h21m19.888558287s) [noise=true , address=104.36.82.45:4932 , piece_id=LOQOTVEDLKNI2OQ43ZRUAROSQ4NV5SW4QCGMAGPWR5C4PU35NNOA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457693909 (343h21m19.88877404s) [noise=true , address=104.36.82.42:4823 , piece_id=SGO5GVI5VXOLVSKVBEEVMI37SDVOG3M624WOHUBIJDBAP5UNZJTA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457945591 (343h21m19.889025722s) [noise=true , address=77.90.31.19:4859 , piece_id=AAMVJSWWDZNSKVDO74UP6D5W3VO2RFSGW6B4ARGDEQAEYDHKYKGQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458177594 (343h21m19.889257725s) [noise=true , address=104.36.82.35:4594 , piece_id=MXD6XREZYJ37GBU6IJWLEX4XMH75JX6F56TGJ4NLGXGHKHYQMOAQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458379892 (343h21m19.889460013s) [noise=true , address=77.90.31.21:4883 , piece_id=BIJ24ORFDOP47IFDGQYKZHX4HYOEUCK7IDFBBKA2ERI54WU2U7SA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458583381 (343h21m19.889663502s) [noise=true , address=45.91.116.4:4943 , piece_id=4TUGGONFOPKRSTKW5YG6TLAE6DWSJZ4F5X5D2TQYVRTMD2MNNEJQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458817379 (343h21m19.8898975s) [noise=true , address=45.91.116.7:4022 , piece_id=LNO4TYOEXBICVEXSJ2SQJVQNACTAV6XVHHCJ4Q2N2O4T556YBAVA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.459124917 (343h21m19.890205048s) [noise=true , address=104.36.82.23:4466 , piece_id=JPMRW7RHYAZH57JWMCIMXCSZOTAUDMQEM3D5QBDLMW2HXEYDE7SA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:26.933318817 (343h21m21.364398948s) [upload=357171]: Next returned nil segment
Aug 23 00:47:26.933338134 (343h21m21.364418265s) [upload=357171]: Waiting for error group managing segments...
Aug 23 00:47:27.371332896 (343h21m21.802413027s) [noise=true , address=77.90.31.18:4824 , piece_id=KQYX5T7CSGIHHIJT6FO5CQM565T5JB4GCOP6GWELPDA2QCXD75WQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.371996285 (343h21m21.803076416s) [noise=true , address=45.91.116.7:4022 , piece_id=LNO4TYOEXBICVEXSJ2SQJVQNACTAV6XVHHCJ4Q2N2O4T556YBAVA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.372190477 (343h21m21.803270598s) [noise=true , address=77.90.31.19:4859 , piece_id=AAMVJSWWDZNSKVDO74UP6D5W3VO2RFSGW6B4ARGDEQAEYDHKYKGQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.388921189 (343h21m21.82000132s) [noise=true , address=104.36.82.6:4902 , piece_id=NHSIRPQ7L3JBVITIZYZ5M544PWRFWWUSUSA6I3YB7B5NX3SIQ6BQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.394693765 (343h21m21.825773896s) [noise=true , address=104.36.82.42:4823 , piece_id=SGO5GVI5VXOLVSKVBEEVMI37SDVOG3M624WOHUBIJDBAP5UNZJTA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.437744126 (343h21m21.868824257s) [noise=true , address=77.90.31.11:4557 , piece_id=CAUVBE5FPQQBWWXKJGU57UE27F5ZHMFWOSYVOCCOQXPKGGHZQHZA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.438028290 (343h21m21.869108422s) [noise=true , address=79.127.219.48:4093 , piece_id=OJEJH4OGGPQX6ZUOPYRPZQL2JSR5WHGZXW52OK6TBJDZ5FPUOFLA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.440347077 (343h21m21.871427208s) [noise=true , address=104.36.82.6:4892 , piece_id=XGZI6G4A5Q3RFKKFZXOJTYJ2HHARANN6U5HYVEOQE72RYYBAWTKA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.446511782 (343h21m21.877591903s) [noise=true , address=77.90.31.10:4523 , piece_id=3DJUNKQIAWINRZGPRFDSCJ35Z346E4B7QRTIKHTQ337AUUGRMGHA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.448913016 (343h21m21.879993147s) [noise=true , address=45.91.116.6:4988 , piece_id=Q34YCUCGA64LUKKD5IT3VMMJRHQFBEH3BARRUHLNY3BKLMFUXVUA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.476338763 (343h21m21.907418894s) [noise=true , address=104.36.82.45:4932 , piece_id=LOQOTVEDLKNI2OQ43ZRUAROSQ4NV5SW4QCGMAGPWR5C4PU35NNOA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.485202973 (343h21m21.916283094s) [noise=true , address=104.36.82.44:4894 , piece_id=STWZBH3F2JV2ML4O7OYFMWBR3NHGDZ67SZDKSAJ5QW6HLBP5BCXQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.514958046 (343h21m21.946038177s) [noise=true , address=104.36.82.49:4987 , piece_id=JIECM3OOL6IYQ3RJ53AZQDDPHJTUUPIUIWG7L6CG7ZLZE6OGXLQA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.516406588 (343h21m21.947486719s) [noise=true , address=104.36.82.23:4466 , piece_id=JPMRW7RHYAZH57JWMCIMXCSZOTAUDMQEM3D5QBDLMW2HXEYDE7SA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.516420655 (343h21m21.947500786s) [seg_pos={0 0}, upload=357171]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:47:27.516659171 (343h21m21.947739292s) [noise=true , address=104.36.82.5:4872 , piece_id=R2V3VMLFKPMK6Z3F34HH5KPPI5SGY7V5D73NBQLF6M5DYJZAJOTQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: write tcp 188.166.225.170:43340->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:43340->104.36.82.5:4872: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43340->104.36.82.5:4872: use of closed network connection
Aug 23 00:47:27.516664611 (343h21m21.947744742s) [noise=true , address=77.90.31.21:4883 , piece_id=BIJ24ORFDOP47IFDGQYKZHX4HYOEUCK7IDFBBKA2ERI54WU2U7SA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:191MKpEnoarS7sK4Gs63ZM8zGc5jevFX8VeqViP82duW33nJJz): protocol: expected piece hash; context canceled; EOF
Aug 23 00:47:27.516701802 (343h21m21.947781933s) [noise=true , address=45.91.116.4:4943 , piece_id=4TUGGONFOPKRSTKW5YG6TLAE6DWSJZ4F5X5D2TQYVRTMD2MNNEJQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128QuaUBgwagbp1fCbMDLMncgCth8bd4kaMTnd4ebP1pvQMB1jv): protocol: write tcp 188.166.225.170:39920->45.91.116.4:4943: use of closed network connection; write tcp 188.166.225.170:39920->45.91.116.4:4943: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39920->45.91.116.4:4943: use of closed network connection
Aug 23 00:47:27.516773129 (343h21m21.94785326s) [noise=true , address=104.36.82.35:4594 , piece_id=MXD6XREZYJ37GBU6IJWLEX4XMH75JX6F56TGJ4NLGXGHKHYQMOAQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D9nh4XFmsjjFcZEMjaL4uw4Whsa8nfMrAsYPu6NVpsxgb3jvf): protocol: expected piece hash; context canceled; EOF
Aug 23 00:47:27.516799189 (343h21m21.94787932s) [seg_pos={0 0}, upload=357171]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:47:27.516882599 (343h21m21.94796273s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:47:27.516887458 (343h21m21.947967589s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:47:27.930461664 (343h21m22.361541825s) [upload=357171]: Done uploading segments...
Aug 23 00:47:27.930485760 (343h21m22.361565881s) [upload=357171]: Upload finished. err: <nil>
Duration: 5.589127735s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..................X....................X........XX.....X....] duration:
1.958616698s
FAIL (2025-08-23 00:47:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 1.958646454s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [....X.......XX............X............X....X..............X] duration:
4.370391059s
FAIL (2025-08-23 00:47:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 23 00:47:25.001402247 (343h21m19.432482398s) [upload=357171]: Starting upload
Aug 23 00:47:25.001497579 (343h21m19.43257778s) [upload=357171]: Done starting upload
Aug 23 00:47:25.001625825 (343h21m19.432705966s) [upload=357171]: Uploading segments...
Aug 23 00:47:25.002063192 (343h21m19.433143323s) [upload=357171]: Got next segment. Inline: false
Aug 23 00:47:25.002111384 (343h21m19.433191515s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:47:25.002116414 (343h21m19.433196535s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:47:25.455280201 (343h21m19.886360332s) [seg_pos={0 0}, upload=357171]: Begin upload segment...
Aug 23 00:47:25.455330788 (343h21m19.886410919s) [seg_pos={0 0}, upload=357171]: Done begin upload segment.
Aug 23 00:47:25.455354803 (343h21m19.886434934s) [noise=true , address=104.36.82.5:4872 , piece_id=R2V3VMLFKPMK6Z3F34HH5KPPI5SGY7V5D73NBQLF6M5DYJZAJOTQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.455380803 (343h21m19.886460934s) [noise=true , address=104.36.82.49:4987 , piece_id=JIECM3OOL6IYQ3RJ53AZQDDPHJTUUPIUIWG7L6CG7ZLZE6OGXLQA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.455731474 (343h21m19.886811605s) [noise=true , address=77.90.31.11:4557 , piece_id=CAUVBE5FPQQBWWXKJGU57UE27F5ZHMFWOSYVOCCOQXPKGGHZQHZA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.455814032 (343h21m19.886894153s) [noise=true , address=79.127.219.48:4093 , piece_id=OJEJH4OGGPQX6ZUOPYRPZQL2JSR5WHGZXW52OK6TBJDZ5FPUOFLA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456069311 (343h21m19.887149442s) [noise=true , address=77.90.31.10:4523 , piece_id=3DJUNKQIAWINRZGPRFDSCJ35Z346E4B7QRTIKHTQ337AUUGRMGHA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456099799 (343h21m19.88717993s) [noise=true , address=77.90.31.18:4824 , piece_id=KQYX5T7CSGIHHIJT6FO5CQM565T5JB4GCOP6GWELPDA2QCXD75WQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456416074 (343h21m19.887496205s) [noise=true , address=45.91.116.6:4988 , piece_id=Q34YCUCGA64LUKKD5IT3VMMJRHQFBEH3BARRUHLNY3BKLMFUXVUA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456718723 (343h21m19.887798854s) [noise=true , address=104.36.82.6:4902 , piece_id=NHSIRPQ7L3JBVITIZYZ5M544PWRFWWUSUSA6I3YB7B5NX3SIQ6BQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.456994080 (343h21m19.888074211s) [noise=true , address=104.36.82.6:4892 , piece_id=XGZI6G4A5Q3RFKKFZXOJTYJ2HHARANN6U5HYVEOQE72RYYBAWTKA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457219731 (343h21m19.888299862s) [noise=true , address=104.36.82.44:4894 , piece_id=STWZBH3F2JV2ML4O7OYFMWBR3NHGDZ67SZDKSAJ5QW6HLBP5BCXQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457478166 (343h21m19.888558287s) [noise=true , address=104.36.82.45:4932 , piece_id=LOQOTVEDLKNI2OQ43ZRUAROSQ4NV5SW4QCGMAGPWR5C4PU35NNOA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457693909 (343h21m19.88877404s) [noise=true , address=104.36.82.42:4823 , piece_id=SGO5GVI5VXOLVSKVBEEVMI37SDVOG3M624WOHUBIJDBAP5UNZJTA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.457945591 (343h21m19.889025722s) [noise=true , address=77.90.31.19:4859 , piece_id=AAMVJSWWDZNSKVDO74UP6D5W3VO2RFSGW6B4ARGDEQAEYDHKYKGQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458177594 (343h21m19.889257725s) [noise=true , address=104.36.82.35:4594 , piece_id=MXD6XREZYJ37GBU6IJWLEX4XMH75JX6F56TGJ4NLGXGHKHYQMOAQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458379892 (343h21m19.889460013s) [noise=true , address=77.90.31.21:4883 , piece_id=BIJ24ORFDOP47IFDGQYKZHX4HYOEUCK7IDFBBKA2ERI54WU2U7SA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458583381 (343h21m19.889663502s) [noise=true , address=45.91.116.4:4943 , piece_id=4TUGGONFOPKRSTKW5YG6TLAE6DWSJZ4F5X5D2TQYVRTMD2MNNEJQ, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.458817379 (343h21m19.8898975s) [noise=true , address=45.91.116.7:4022 , piece_id=LNO4TYOEXBICVEXSJ2SQJVQNACTAV6XVHHCJ4Q2N2O4T556YBAVA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:25.459124917 (343h21m19.890205048s) [noise=true , address=104.36.82.23:4466 , piece_id=JPMRW7RHYAZH57JWMCIMXCSZOTAUDMQEM3D5QBDLMW2HXEYDE7SA, seg_pos={0 0}, upload=357171]: Uploading piece...
Aug 23 00:47:26.933318817 (343h21m21.364398948s) [upload=357171]: Next returned nil segment
Aug 23 00:47:26.933338134 (343h21m21.364418265s) [upload=357171]: Waiting for error group managing segments...
Aug 23 00:47:27.371332896 (343h21m21.802413027s) [noise=true , address=77.90.31.18:4824 , piece_id=KQYX5T7CSGIHHIJT6FO5CQM565T5JB4GCOP6GWELPDA2QCXD75WQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.371996285 (343h21m21.803076416s) [noise=true , address=45.91.116.7:4022 , piece_id=LNO4TYOEXBICVEXSJ2SQJVQNACTAV6XVHHCJ4Q2N2O4T556YBAVA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.372190477 (343h21m21.803270598s) [noise=true , address=77.90.31.19:4859 , piece_id=AAMVJSWWDZNSKVDO74UP6D5W3VO2RFSGW6B4ARGDEQAEYDHKYKGQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.388921189 (343h21m21.82000132s) [noise=true , address=104.36.82.6:4902 , piece_id=NHSIRPQ7L3JBVITIZYZ5M544PWRFWWUSUSA6I3YB7B5NX3SIQ6BQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.394693765 (343h21m21.825773896s) [noise=true , address=104.36.82.42:4823 , piece_id=SGO5GVI5VXOLVSKVBEEVMI37SDVOG3M624WOHUBIJDBAP5UNZJTA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.437744126 (343h21m21.868824257s) [noise=true , address=77.90.31.11:4557 , piece_id=CAUVBE5FPQQBWWXKJGU57UE27F5ZHMFWOSYVOCCOQXPKGGHZQHZA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.438028290 (343h21m21.869108422s) [noise=true , address=79.127.219.48:4093 , piece_id=OJEJH4OGGPQX6ZUOPYRPZQL2JSR5WHGZXW52OK6TBJDZ5FPUOFLA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.440347077 (343h21m21.871427208s) [noise=true , address=104.36.82.6:4892 , piece_id=XGZI6G4A5Q3RFKKFZXOJTYJ2HHARANN6U5HYVEOQE72RYYBAWTKA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.446511782 (343h21m21.877591903s) [noise=true , address=77.90.31.10:4523 , piece_id=3DJUNKQIAWINRZGPRFDSCJ35Z346E4B7QRTIKHTQ337AUUGRMGHA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.448913016 (343h21m21.879993147s) [noise=true , address=45.91.116.6:4988 , piece_id=Q34YCUCGA64LUKKD5IT3VMMJRHQFBEH3BARRUHLNY3BKLMFUXVUA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.476338763 (343h21m21.907418894s) [noise=true , address=104.36.82.45:4932 , piece_id=LOQOTVEDLKNI2OQ43ZRUAROSQ4NV5SW4QCGMAGPWR5C4PU35NNOA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.485202973 (343h21m21.916283094s) [noise=true , address=104.36.82.44:4894 , piece_id=STWZBH3F2JV2ML4O7OYFMWBR3NHGDZ67SZDKSAJ5QW6HLBP5BCXQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.514958046 (343h21m21.946038177s) [noise=true , address=104.36.82.49:4987 , piece_id=JIECM3OOL6IYQ3RJ53AZQDDPHJTUUPIUIWG7L6CG7ZLZE6OGXLQA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.516406588 (343h21m21.947486719s) [noise=true , address=104.36.82.23:4466 , piece_id=JPMRW7RHYAZH57JWMCIMXCSZOTAUDMQEM3D5QBDLMW2HXEYDE7SA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: <nil>
Aug 23 00:47:27.516420655 (343h21m21.947500786s) [seg_pos={0 0}, upload=357171]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:47:27.516659171 (343h21m21.947739292s) [noise=true , address=104.36.82.5:4872 , piece_id=R2V3VMLFKPMK6Z3F34HH5KPPI5SGY7V5D73NBQLF6M5DYJZAJOTQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zqxiFpqKeXT9mhXUDuZZmvJkhejC8gcHTQgTadY1xUpQyLyZi): protocol: write tcp 188.166.225.170:43340->104.36.82.5:4872: use of closed network connection; write tcp 188.166.225.170:43340->104.36.82.5:4872: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43340->104.36.82.5:4872: use of closed network connection
Aug 23 00:47:27.516664611 (343h21m21.947744742s) [noise=true , address=77.90.31.21:4883 , piece_id=BIJ24ORFDOP47IFDGQYKZHX4HYOEUCK7IDFBBKA2ERI54WU2U7SA, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:191MKpEnoarS7sK4Gs63ZM8zGc5jevFX8VeqViP82duW33nJJz): protocol: expected piece hash; context canceled; EOF
Aug 23 00:47:27.516701802 (343h21m21.947781933s) [noise=true , address=45.91.116.4:4943 , piece_id=4TUGGONFOPKRSTKW5YG6TLAE6DWSJZ4F5X5D2TQYVRTMD2MNNEJQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128QuaUBgwagbp1fCbMDLMncgCth8bd4kaMTnd4ebP1pvQMB1jv): protocol: write tcp 188.166.225.170:39920->45.91.116.4:4943: use of closed network connection; write tcp 188.166.225.170:39920->45.91.116.4:4943: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39920->45.91.116.4:4943: use of closed network connection
Aug 23 00:47:27.516773129 (343h21m21.94785326s) [noise=true , address=104.36.82.35:4594 , piece_id=MXD6XREZYJ37GBU6IJWLEX4XMH75JX6F56TGJ4NLGXGHKHYQMOAQ, seg_pos={0 0}, upload=357171]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12D9nh4XFmsjjFcZEMjaL4uw4Whsa8nfMrAsYPu6NVpsxgb3jvf): protocol: expected piece hash; context canceled; EOF
Aug 23 00:47:27.516799189 (343h21m21.94787932s) [seg_pos={0 0}, upload=357171]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:47:27.516882599 (343h21m21.94796273s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:47:27.516887458 (343h21m21.947967589s) [upload=357171]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:47:27.930461664 (343h21m22.361541825s) [upload=357171]: Done uploading segments...
Aug 23 00:47:27.930485760 (343h21m22.361565881s) [upload=357171]: Upload finished. err: <nil>
Duration: 4.370428541s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...................X....................X........XX.....X...] duration:
1.939550727s
FAIL (2025-08-23 00:46:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 1.939576397s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....................X....................X........XX.....X..] duration:
1.922093146s
FAIL (2025-08-23 00:46:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 1.922131859s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X.......XX............X............X....X..............] duration:
5.914492805s
FAIL (2025-08-23 00:46:22 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 00:34:16.194752327 (343h8m10.625832488s) [upload=356939]: Starting upload
Aug 23 00:34:16.194845054 (343h8m10.625925195s) [upload=356939]: Done starting upload
Aug 23 00:34:16.194927331 (343h8m10.626007482s) [upload=356939]: Uploading segments...
Aug 23 00:34:16.195247013 (343h8m10.626327184s) [upload=356939]: Got next segment. Inline: false
Aug 23 00:34:16.195299824 (343h8m10.626379955s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:34:16.195307970 (343h8m10.626388111s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:34:16.650571705 (343h8m11.081651846s) [seg_pos={0 0}, upload=356939]: Begin upload segment...
Aug 23 00:34:16.650633293 (343h8m11.081713424s) [seg_pos={0 0}, upload=356939]: Done begin upload segment.
Aug 23 00:34:16.650666106 (343h8m11.081746237s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.650721532 (343h8m11.081801653s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651269892 (343h8m11.082350023s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651277957 (343h8m11.082358088s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651675818 (343h8m11.082755949s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651760661 (343h8m11.082840782s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652093608 (343h8m11.083173739s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652295494 (343h8m11.083375655s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652631566 (343h8m11.083711697s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652826569 (343h8m11.0839067s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653198021 (343h8m11.084278152s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653409155 (343h8m11.084489286s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653602495 (343h8m11.084682626s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653839979 (343h8m11.08492011s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654084266 (343h8m11.085164397s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654309276 (343h8m11.085389407s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654507296 (343h8m11.085587417s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.655010238 (343h8m11.086090369s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:17.796453348 (343h8m12.227533469s) [upload=356939]: Next returned nil segment
Aug 23 00:34:17.796470451 (343h8m12.227550582s) [upload=356939]: Waiting for error group managing segments...
Aug 23 00:34:18.083415337 (343h8m12.514495468s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.089601254 (343h8m12.520681385s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.558618445 (343h8m12.989698576s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.581258043 (343h8m13.012338174s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605355360 (343h8m13.036435481s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605454419 (343h8m13.036534551s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.610500565 (343h8m13.041580686s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.627994978 (343h8m13.059075109s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.661169354 (343h8m13.092249475s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.669453564 (343h8m13.100533696s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.681073117 (343h8m13.112153248s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.684575859 (343h8m13.11565599s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.708997517 (343h8m13.140077648s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775302033 (343h8m13.206382164s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775332441 (343h8m13.206412572s) [seg_pos={0 0}, upload=356939]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:34:18.775469603 (343h8m13.206549734s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775522184 (343h8m13.206602355s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775552362 (343h8m13.206632493s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1coJuRC2n26y5sjxB49CVmri8gvxtVFwsxGDraVxZifM7Hrb1j): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775631824 (343h8m13.206711965s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CsQq2BuV9hNc5fVAsw882NkDJMEXZeNwhV2FGNGKAU6wuFBHm): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775653415 (343h8m13.206733556s) [seg_pos={0 0}, upload=356939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:34:18.775721996 (343h8m13.206802127s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:34:18.775727456 (343h8m13.206807587s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:34:19.230091661 (343h8m13.661171802s) [upload=356939]: Done uploading segments...
Aug 23 00:34:19.230113843 (343h8m13.661193974s) [upload=356939]: Upload finished. err: <nil>
Duration: 5.91452145s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....................X....................X........XX.....X.] duration:
1.890578132s
FAIL (2025-08-23 00:45:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 1.890610995s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......................X....................X........XX.....X] duration:
1.69840403s
FAIL (2025-08-23 00:45:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:45:21.755709943 (343h19m16.186790064s) [upload=357137]: Starting upload
Aug 23 00:45:21.755749709 (343h19m16.18682984s) [upload=357137]: Done starting upload
Aug 23 00:45:21.755792150 (343h19m16.186872281s) [upload=357137]: Uploading segments...
Aug 23 00:45:21.755847236 (343h19m16.186927367s) [upload=357137]: Got next segment. Inline: true
Aug 23 00:45:21.755851253 (343h19m16.186931384s) [upload=357137]: Waiting for error group managing segments...
Aug 23 00:45:21.755893334 (343h19m16.186973465s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:45:21.755897833 (343h19m16.186977964s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:45:21.755900738 (343h19m16.186980869s) [upload=357137]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:45:22.034314591 (343h19m16.465394722s) [upload=357137]: Done uploading segments...
Aug 23 00:45:22.034347724 (343h19m16.465427855s) [upload=357137]: Upload finished. err: <nil>
Duration: 1.698462923s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [X.....X.......XX............X............X....X.............] duration:
5.888296553s
FAIL (2025-08-23 00:45:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 00:34:16.194752327 (343h8m10.625832488s) [upload=356939]: Starting upload
Aug 23 00:34:16.194845054 (343h8m10.625925195s) [upload=356939]: Done starting upload
Aug 23 00:34:16.194927331 (343h8m10.626007482s) [upload=356939]: Uploading segments...
Aug 23 00:34:16.195247013 (343h8m10.626327184s) [upload=356939]: Got next segment. Inline: false
Aug 23 00:34:16.195299824 (343h8m10.626379955s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:34:16.195307970 (343h8m10.626388111s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:34:16.650571705 (343h8m11.081651846s) [seg_pos={0 0}, upload=356939]: Begin upload segment...
Aug 23 00:34:16.650633293 (343h8m11.081713424s) [seg_pos={0 0}, upload=356939]: Done begin upload segment.
Aug 23 00:34:16.650666106 (343h8m11.081746237s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.650721532 (343h8m11.081801653s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651269892 (343h8m11.082350023s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651277957 (343h8m11.082358088s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651675818 (343h8m11.082755949s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651760661 (343h8m11.082840782s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652093608 (343h8m11.083173739s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652295494 (343h8m11.083375655s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652631566 (343h8m11.083711697s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652826569 (343h8m11.0839067s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653198021 (343h8m11.084278152s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653409155 (343h8m11.084489286s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653602495 (343h8m11.084682626s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653839979 (343h8m11.08492011s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654084266 (343h8m11.085164397s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654309276 (343h8m11.085389407s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654507296 (343h8m11.085587417s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.655010238 (343h8m11.086090369s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:17.796453348 (343h8m12.227533469s) [upload=356939]: Next returned nil segment
Aug 23 00:34:17.796470451 (343h8m12.227550582s) [upload=356939]: Waiting for error group managing segments...
Aug 23 00:34:18.083415337 (343h8m12.514495468s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.089601254 (343h8m12.520681385s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.558618445 (343h8m12.989698576s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.581258043 (343h8m13.012338174s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605355360 (343h8m13.036435481s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605454419 (343h8m13.036534551s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.610500565 (343h8m13.041580686s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.627994978 (343h8m13.059075109s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.661169354 (343h8m13.092249475s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.669453564 (343h8m13.100533696s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.681073117 (343h8m13.112153248s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.684575859 (343h8m13.11565599s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.708997517 (343h8m13.140077648s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775302033 (343h8m13.206382164s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775332441 (343h8m13.206412572s) [seg_pos={0 0}, upload=356939]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:34:18.775469603 (343h8m13.206549734s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775522184 (343h8m13.206602355s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775552362 (343h8m13.206632493s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1coJuRC2n26y5sjxB49CVmri8gvxtVFwsxGDraVxZifM7Hrb1j): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775631824 (343h8m13.206711965s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CsQq2BuV9hNc5fVAsw882NkDJMEXZeNwhV2FGNGKAU6wuFBHm): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775653415 (343h8m13.206733556s) [seg_pos={0 0}, upload=356939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:34:18.775721996 (343h8m13.206802127s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:34:18.775727456 (343h8m13.206807587s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:34:19.230091661 (343h8m13.661171802s) [upload=356939]: Done uploading segments...
Aug 23 00:34:19.230113843 (343h8m13.661193974s) [upload=356939]: Upload finished. err: <nil>
Duration: 5.888329185s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X......................X....................X........XX.....] duration:
1.87617343s
FAIL (2025-08-23 00:45:01 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:41:22.642820511 (343h15m17.073900672s) [upload=357065]: Starting upload
Aug 23 00:41:22.642928367 (343h15m17.074008559s) [upload=357065]: Done starting upload
Aug 23 00:41:22.643037997 (343h15m17.074118128s) [upload=357065]: Uploading segments...
Aug 23 00:41:22.643131926 (343h15m17.074212057s) [upload=357065]: Got next segment. Inline: true
Aug 23 00:41:22.643137849 (343h15m17.07421798s) [upload=357065]: Waiting for error group managing segments...
Aug 23 00:41:22.643184327 (343h15m17.074264458s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:41:22.643190149 (343h15m17.07427028s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:41:22.643193485 (343h15m17.074273616s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:41:22.992315831 (343h15m17.423395962s) [upload=357065]: Done uploading segments...
Aug 23 00:41:22.992335388 (343h15m17.423415509s) [upload=357065]: Upload finished. err: <nil>
Duration: 1.876201555s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.824550357s
FAIL (2025-08-23 00:44:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded
Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 5.824573311s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X......................X....................X........XX....] duration:
1.855447907s
FAIL (2025-08-23 00:44:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:41:22.642820511 (343h15m17.073900672s) [upload=357065]: Starting upload
Aug 23 00:41:22.642928367 (343h15m17.074008559s) [upload=357065]: Done starting upload
Aug 23 00:41:22.643037997 (343h15m17.074118128s) [upload=357065]: Uploading segments...
Aug 23 00:41:22.643131926 (343h15m17.074212057s) [upload=357065]: Got next segment. Inline: true
Aug 23 00:41:22.643137849 (343h15m17.07421798s) [upload=357065]: Waiting for error group managing segments...
Aug 23 00:41:22.643184327 (343h15m17.074264458s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:41:22.643190149 (343h15m17.07427028s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:41:22.643193485 (343h15m17.074273616s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:41:22.992315831 (343h15m17.423395962s) [upload=357065]: Done uploading segments...
Aug 23 00:41:22.992335388 (343h15m17.423415509s) [upload=357065]: Upload finished. err: <nil>
Duration: 1.855475589s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.X.....X.......XX............X............X....X............] duration:
5.889660699s
FAIL (2025-08-23 00:44:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 00:34:16.194752327 (343h8m10.625832488s) [upload=356939]: Starting upload
Aug 23 00:34:16.194845054 (343h8m10.625925195s) [upload=356939]: Done starting upload
Aug 23 00:34:16.194927331 (343h8m10.626007482s) [upload=356939]: Uploading segments...
Aug 23 00:34:16.195247013 (343h8m10.626327184s) [upload=356939]: Got next segment. Inline: false
Aug 23 00:34:16.195299824 (343h8m10.626379955s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:34:16.195307970 (343h8m10.626388111s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:34:16.650571705 (343h8m11.081651846s) [seg_pos={0 0}, upload=356939]: Begin upload segment...
Aug 23 00:34:16.650633293 (343h8m11.081713424s) [seg_pos={0 0}, upload=356939]: Done begin upload segment.
Aug 23 00:34:16.650666106 (343h8m11.081746237s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.650721532 (343h8m11.081801653s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651269892 (343h8m11.082350023s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651277957 (343h8m11.082358088s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651675818 (343h8m11.082755949s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651760661 (343h8m11.082840782s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652093608 (343h8m11.083173739s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652295494 (343h8m11.083375655s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652631566 (343h8m11.083711697s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652826569 (343h8m11.0839067s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653198021 (343h8m11.084278152s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653409155 (343h8m11.084489286s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653602495 (343h8m11.084682626s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653839979 (343h8m11.08492011s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654084266 (343h8m11.085164397s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654309276 (343h8m11.085389407s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654507296 (343h8m11.085587417s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.655010238 (343h8m11.086090369s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:17.796453348 (343h8m12.227533469s) [upload=356939]: Next returned nil segment
Aug 23 00:34:17.796470451 (343h8m12.227550582s) [upload=356939]: Waiting for error group managing segments...
Aug 23 00:34:18.083415337 (343h8m12.514495468s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.089601254 (343h8m12.520681385s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.558618445 (343h8m12.989698576s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.581258043 (343h8m13.012338174s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605355360 (343h8m13.036435481s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605454419 (343h8m13.036534551s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.610500565 (343h8m13.041580686s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.627994978 (343h8m13.059075109s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.661169354 (343h8m13.092249475s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.669453564 (343h8m13.100533696s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.681073117 (343h8m13.112153248s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.684575859 (343h8m13.11565599s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.708997517 (343h8m13.140077648s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775302033 (343h8m13.206382164s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775332441 (343h8m13.206412572s) [seg_pos={0 0}, upload=356939]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:34:18.775469603 (343h8m13.206549734s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775522184 (343h8m13.206602355s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775552362 (343h8m13.206632493s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1coJuRC2n26y5sjxB49CVmri8gvxtVFwsxGDraVxZifM7Hrb1j): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775631824 (343h8m13.206711965s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CsQq2BuV9hNc5fVAsw882NkDJMEXZeNwhV2FGNGKAU6wuFBHm): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775653415 (343h8m13.206733556s) [seg_pos={0 0}, upload=356939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:34:18.775721996 (343h8m13.206802127s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:34:18.775727456 (343h8m13.206807587s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:34:19.230091661 (343h8m13.661171802s) [upload=356939]: Done uploading segments...
Aug 23 00:34:19.230113843 (343h8m13.661193974s) [upload=356939]: Upload finished. err: <nil>
Duration: 5.889689493s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..X.....X.......XX............X............X....X...........] duration:
5.780941367s
FAIL (2025-08-23 00:43:33 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 00:34:16.194752327 (343h8m10.625832488s) [upload=356939]: Starting upload
Aug 23 00:34:16.194845054 (343h8m10.625925195s) [upload=356939]: Done starting upload
Aug 23 00:34:16.194927331 (343h8m10.626007482s) [upload=356939]: Uploading segments...
Aug 23 00:34:16.195247013 (343h8m10.626327184s) [upload=356939]: Got next segment. Inline: false
Aug 23 00:34:16.195299824 (343h8m10.626379955s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:34:16.195307970 (343h8m10.626388111s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:34:16.650571705 (343h8m11.081651846s) [seg_pos={0 0}, upload=356939]: Begin upload segment...
Aug 23 00:34:16.650633293 (343h8m11.081713424s) [seg_pos={0 0}, upload=356939]: Done begin upload segment.
Aug 23 00:34:16.650666106 (343h8m11.081746237s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.650721532 (343h8m11.081801653s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651269892 (343h8m11.082350023s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651277957 (343h8m11.082358088s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651675818 (343h8m11.082755949s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651760661 (343h8m11.082840782s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652093608 (343h8m11.083173739s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652295494 (343h8m11.083375655s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652631566 (343h8m11.083711697s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652826569 (343h8m11.0839067s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653198021 (343h8m11.084278152s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653409155 (343h8m11.084489286s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653602495 (343h8m11.084682626s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653839979 (343h8m11.08492011s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654084266 (343h8m11.085164397s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654309276 (343h8m11.085389407s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654507296 (343h8m11.085587417s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.655010238 (343h8m11.086090369s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:17.796453348 (343h8m12.227533469s) [upload=356939]: Next returned nil segment
Aug 23 00:34:17.796470451 (343h8m12.227550582s) [upload=356939]: Waiting for error group managing segments...
Aug 23 00:34:18.083415337 (343h8m12.514495468s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.089601254 (343h8m12.520681385s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.558618445 (343h8m12.989698576s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.581258043 (343h8m13.012338174s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605355360 (343h8m13.036435481s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605454419 (343h8m13.036534551s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.610500565 (343h8m13.041580686s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.627994978 (343h8m13.059075109s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.661169354 (343h8m13.092249475s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.669453564 (343h8m13.100533696s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.681073117 (343h8m13.112153248s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.684575859 (343h8m13.11565599s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.708997517 (343h8m13.140077648s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775302033 (343h8m13.206382164s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775332441 (343h8m13.206412572s) [seg_pos={0 0}, upload=356939]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:34:18.775469603 (343h8m13.206549734s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775522184 (343h8m13.206602355s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775552362 (343h8m13.206632493s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1coJuRC2n26y5sjxB49CVmri8gvxtVFwsxGDraVxZifM7Hrb1j): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775631824 (343h8m13.206711965s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CsQq2BuV9hNc5fVAsw882NkDJMEXZeNwhV2FGNGKAU6wuFBHm): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775653415 (343h8m13.206733556s) [seg_pos={0 0}, upload=356939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:34:18.775721996 (343h8m13.206802127s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:34:18.775727456 (343h8m13.206807587s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:34:19.230091661 (343h8m13.661171802s) [upload=356939]: Done uploading segments...
Aug 23 00:34:19.230113843 (343h8m13.661193974s) [upload=356939]: Upload finished. err: <nil>
Duration: 5.780965012s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X......................X....................X........XX...] duration:
1.866361578s
FAIL (2025-08-23 00:43:29 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:41:22.642820511 (343h15m17.073900672s) [upload=357065]: Starting upload
Aug 23 00:41:22.642928367 (343h15m17.074008559s) [upload=357065]: Done starting upload
Aug 23 00:41:22.643037997 (343h15m17.074118128s) [upload=357065]: Uploading segments...
Aug 23 00:41:22.643131926 (343h15m17.074212057s) [upload=357065]: Got next segment. Inline: true
Aug 23 00:41:22.643137849 (343h15m17.07421798s) [upload=357065]: Waiting for error group managing segments...
Aug 23 00:41:22.643184327 (343h15m17.074264458s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:41:22.643190149 (343h15m17.07427028s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:41:22.643193485 (343h15m17.074273616s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:41:22.992315831 (343h15m17.423395962s) [upload=357065]: Done uploading segments...
Aug 23 00:41:22.992335388 (343h15m17.423415509s) [upload=357065]: Upload finished. err: <nil>
Duration: 1.866386316s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
5.813310771s
FAIL (2025-08-23 00:43:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded
Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 5.813332663s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...X.....X.......XX............X............X....X..........] duration:
5.820059384s
FAIL (2025-08-23 00:42:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 00:34:16.194752327 (343h8m10.625832488s) [upload=356939]: Starting upload
Aug 23 00:34:16.194845054 (343h8m10.625925195s) [upload=356939]: Done starting upload
Aug 23 00:34:16.194927331 (343h8m10.626007482s) [upload=356939]: Uploading segments...
Aug 23 00:34:16.195247013 (343h8m10.626327184s) [upload=356939]: Got next segment. Inline: false
Aug 23 00:34:16.195299824 (343h8m10.626379955s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:34:16.195307970 (343h8m10.626388111s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:34:16.650571705 (343h8m11.081651846s) [seg_pos={0 0}, upload=356939]: Begin upload segment...
Aug 23 00:34:16.650633293 (343h8m11.081713424s) [seg_pos={0 0}, upload=356939]: Done begin upload segment.
Aug 23 00:34:16.650666106 (343h8m11.081746237s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.650721532 (343h8m11.081801653s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651269892 (343h8m11.082350023s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651277957 (343h8m11.082358088s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651675818 (343h8m11.082755949s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651760661 (343h8m11.082840782s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652093608 (343h8m11.083173739s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652295494 (343h8m11.083375655s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652631566 (343h8m11.083711697s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652826569 (343h8m11.0839067s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653198021 (343h8m11.084278152s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653409155 (343h8m11.084489286s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653602495 (343h8m11.084682626s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653839979 (343h8m11.08492011s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654084266 (343h8m11.085164397s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654309276 (343h8m11.085389407s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654507296 (343h8m11.085587417s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.655010238 (343h8m11.086090369s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:17.796453348 (343h8m12.227533469s) [upload=356939]: Next returned nil segment
Aug 23 00:34:17.796470451 (343h8m12.227550582s) [upload=356939]: Waiting for error group managing segments...
Aug 23 00:34:18.083415337 (343h8m12.514495468s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.089601254 (343h8m12.520681385s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.558618445 (343h8m12.989698576s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.581258043 (343h8m13.012338174s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605355360 (343h8m13.036435481s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605454419 (343h8m13.036534551s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.610500565 (343h8m13.041580686s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.627994978 (343h8m13.059075109s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.661169354 (343h8m13.092249475s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.669453564 (343h8m13.100533696s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.681073117 (343h8m13.112153248s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.684575859 (343h8m13.11565599s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.708997517 (343h8m13.140077648s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775302033 (343h8m13.206382164s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775332441 (343h8m13.206412572s) [seg_pos={0 0}, upload=356939]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:34:18.775469603 (343h8m13.206549734s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775522184 (343h8m13.206602355s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775552362 (343h8m13.206632493s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1coJuRC2n26y5sjxB49CVmri8gvxtVFwsxGDraVxZifM7Hrb1j): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775631824 (343h8m13.206711965s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CsQq2BuV9hNc5fVAsw882NkDJMEXZeNwhV2FGNGKAU6wuFBHm): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775653415 (343h8m13.206733556s) [seg_pos={0 0}, upload=356939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:34:18.775721996 (343h8m13.206802127s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:34:18.775727456 (343h8m13.206807587s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:34:19.230091661 (343h8m13.661171802s) [upload=356939]: Done uploading segments...
Aug 23 00:34:19.230113843 (343h8m13.661193974s) [upload=356939]: Upload finished. err: <nil>
Duration: 5.820087017s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.963619271s
FAIL (2025-08-23 00:42:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded
Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 5.963648408s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X......................X....................X........XX..] duration:
1.839353711s
FAIL (2025-08-23 00:42:15 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:41:22.642820511 (343h15m17.073900672s) [upload=357065]: Starting upload
Aug 23 00:41:22.642928367 (343h15m17.074008559s) [upload=357065]: Done starting upload
Aug 23 00:41:22.643037997 (343h15m17.074118128s) [upload=357065]: Uploading segments...
Aug 23 00:41:22.643131926 (343h15m17.074212057s) [upload=357065]: Got next segment. Inline: true
Aug 23 00:41:22.643137849 (343h15m17.07421798s) [upload=357065]: Waiting for error group managing segments...
Aug 23 00:41:22.643184327 (343h15m17.074264458s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:41:22.643190149 (343h15m17.07427028s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:41:22.643193485 (343h15m17.074273616s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:41:22.992315831 (343h15m17.423395962s) [upload=357065]: Done uploading segments...
Aug 23 00:41:22.992335388 (343h15m17.423415509s) [upload=357065]: Upload finished. err: <nil>
Duration: 1.83939011s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.822128565s
FAIL (2025-08-23 00:42:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded
Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 5.822156046s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....X......................X....................X........XX.] duration:
2.215533919s
FAIL (2025-08-23 00:41:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:41:22.642820511 (343h15m17.073900672s) [upload=357065]: Starting upload
Aug 23 00:41:22.642928367 (343h15m17.074008559s) [upload=357065]: Done starting upload
Aug 23 00:41:22.643037997 (343h15m17.074118128s) [upload=357065]: Uploading segments...
Aug 23 00:41:22.643131926 (343h15m17.074212057s) [upload=357065]: Got next segment. Inline: true
Aug 23 00:41:22.643137849 (343h15m17.07421798s) [upload=357065]: Waiting for error group managing segments...
Aug 23 00:41:22.643184327 (343h15m17.074264458s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:41:22.643190149 (343h15m17.07427028s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:41:22.643193485 (343h15m17.074273616s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:41:22.992315831 (343h15m17.423395962s) [upload=357065]: Done uploading segments...
Aug 23 00:41:22.992335388 (343h15m17.423415509s) [upload=357065]: Upload finished. err: <nil>
Duration: 2.215566783s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [....X.....X.......XX............X............X....X.........] duration:
5.914904295s
FAIL (2025-08-23 00:41:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 00:34:16.194752327 (343h8m10.625832488s) [upload=356939]: Starting upload
Aug 23 00:34:16.194845054 (343h8m10.625925195s) [upload=356939]: Done starting upload
Aug 23 00:34:16.194927331 (343h8m10.626007482s) [upload=356939]: Uploading segments...
Aug 23 00:34:16.195247013 (343h8m10.626327184s) [upload=356939]: Got next segment. Inline: false
Aug 23 00:34:16.195299824 (343h8m10.626379955s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:34:16.195307970 (343h8m10.626388111s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:34:16.650571705 (343h8m11.081651846s) [seg_pos={0 0}, upload=356939]: Begin upload segment...
Aug 23 00:34:16.650633293 (343h8m11.081713424s) [seg_pos={0 0}, upload=356939]: Done begin upload segment.
Aug 23 00:34:16.650666106 (343h8m11.081746237s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.650721532 (343h8m11.081801653s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651269892 (343h8m11.082350023s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651277957 (343h8m11.082358088s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651675818 (343h8m11.082755949s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651760661 (343h8m11.082840782s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652093608 (343h8m11.083173739s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652295494 (343h8m11.083375655s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652631566 (343h8m11.083711697s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652826569 (343h8m11.0839067s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653198021 (343h8m11.084278152s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653409155 (343h8m11.084489286s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653602495 (343h8m11.084682626s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653839979 (343h8m11.08492011s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654084266 (343h8m11.085164397s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654309276 (343h8m11.085389407s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654507296 (343h8m11.085587417s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.655010238 (343h8m11.086090369s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:17.796453348 (343h8m12.227533469s) [upload=356939]: Next returned nil segment
Aug 23 00:34:17.796470451 (343h8m12.227550582s) [upload=356939]: Waiting for error group managing segments...
Aug 23 00:34:18.083415337 (343h8m12.514495468s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.089601254 (343h8m12.520681385s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.558618445 (343h8m12.989698576s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.581258043 (343h8m13.012338174s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605355360 (343h8m13.036435481s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605454419 (343h8m13.036534551s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.610500565 (343h8m13.041580686s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.627994978 (343h8m13.059075109s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.661169354 (343h8m13.092249475s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.669453564 (343h8m13.100533696s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.681073117 (343h8m13.112153248s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.684575859 (343h8m13.11565599s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.708997517 (343h8m13.140077648s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775302033 (343h8m13.206382164s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775332441 (343h8m13.206412572s) [seg_pos={0 0}, upload=356939]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:34:18.775469603 (343h8m13.206549734s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775522184 (343h8m13.206602355s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775552362 (343h8m13.206632493s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1coJuRC2n26y5sjxB49CVmri8gvxtVFwsxGDraVxZifM7Hrb1j): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775631824 (343h8m13.206711965s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CsQq2BuV9hNc5fVAsw882NkDJMEXZeNwhV2FGNGKAU6wuFBHm): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775653415 (343h8m13.206733556s) [seg_pos={0 0}, upload=356939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:34:18.775721996 (343h8m13.206802127s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:34:18.775727456 (343h8m13.206807587s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:34:19.230091661 (343h8m13.661171802s) [upload=356939]: Done uploading segments...
Aug 23 00:34:19.230113843 (343h8m13.661193974s) [upload=356939]: Upload finished. err: <nil>
Duration: 5.914969029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
6.014498039s
FAIL (2025-08-23 00:41:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded
Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 6.01452375s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.....X......................X....................X........XX] duration:
1.682901338s
FAIL (2025-08-23 00:41:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:41:22.642820511 (343h15m17.073900672s) [upload=357065]: Starting upload
Aug 23 00:41:22.642928367 (343h15m17.074008559s) [upload=357065]: Done starting upload
Aug 23 00:41:22.643037997 (343h15m17.074118128s) [upload=357065]: Uploading segments...
Aug 23 00:41:22.643131926 (343h15m17.074212057s) [upload=357065]: Got next segment. Inline: true
Aug 23 00:41:22.643137849 (343h15m17.07421798s) [upload=357065]: Waiting for error group managing segments...
Aug 23 00:41:22.643184327 (343h15m17.074264458s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:41:22.643190149 (343h15m17.07427028s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:41:22.643193485 (343h15m17.074273616s) [upload=357065]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:41:22.992315831 (343h15m17.423395962s) [upload=357065]: Done uploading segments...
Aug 23 00:41:22.992335388 (343h15m17.423415509s) [upload=357065]: Upload finished. err: <nil>
Duration: 1.682931507s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.....X.....X.......XX............X............X....X........] duration:
5.950067527s
FAIL (2025-08-23 00:41:06 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 00:34:16.194752327 (343h8m10.625832488s) [upload=356939]: Starting upload
Aug 23 00:34:16.194845054 (343h8m10.625925195s) [upload=356939]: Done starting upload
Aug 23 00:34:16.194927331 (343h8m10.626007482s) [upload=356939]: Uploading segments...
Aug 23 00:34:16.195247013 (343h8m10.626327184s) [upload=356939]: Got next segment. Inline: false
Aug 23 00:34:16.195299824 (343h8m10.626379955s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:34:16.195307970 (343h8m10.626388111s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:34:16.650571705 (343h8m11.081651846s) [seg_pos={0 0}, upload=356939]: Begin upload segment...
Aug 23 00:34:16.650633293 (343h8m11.081713424s) [seg_pos={0 0}, upload=356939]: Done begin upload segment.
Aug 23 00:34:16.650666106 (343h8m11.081746237s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.650721532 (343h8m11.081801653s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651269892 (343h8m11.082350023s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651277957 (343h8m11.082358088s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651675818 (343h8m11.082755949s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651760661 (343h8m11.082840782s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652093608 (343h8m11.083173739s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652295494 (343h8m11.083375655s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652631566 (343h8m11.083711697s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652826569 (343h8m11.0839067s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653198021 (343h8m11.084278152s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653409155 (343h8m11.084489286s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653602495 (343h8m11.084682626s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653839979 (343h8m11.08492011s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654084266 (343h8m11.085164397s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654309276 (343h8m11.085389407s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654507296 (343h8m11.085587417s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.655010238 (343h8m11.086090369s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:17.796453348 (343h8m12.227533469s) [upload=356939]: Next returned nil segment
Aug 23 00:34:17.796470451 (343h8m12.227550582s) [upload=356939]: Waiting for error group managing segments...
Aug 23 00:34:18.083415337 (343h8m12.514495468s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.089601254 (343h8m12.520681385s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.558618445 (343h8m12.989698576s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.581258043 (343h8m13.012338174s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605355360 (343h8m13.036435481s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605454419 (343h8m13.036534551s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.610500565 (343h8m13.041580686s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.627994978 (343h8m13.059075109s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.661169354 (343h8m13.092249475s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.669453564 (343h8m13.100533696s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.681073117 (343h8m13.112153248s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.684575859 (343h8m13.11565599s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.708997517 (343h8m13.140077648s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775302033 (343h8m13.206382164s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775332441 (343h8m13.206412572s) [seg_pos={0 0}, upload=356939]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:34:18.775469603 (343h8m13.206549734s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775522184 (343h8m13.206602355s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775552362 (343h8m13.206632493s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1coJuRC2n26y5sjxB49CVmri8gvxtVFwsxGDraVxZifM7Hrb1j): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775631824 (343h8m13.206711965s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CsQq2BuV9hNc5fVAsw882NkDJMEXZeNwhV2FGNGKAU6wuFBHm): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775653415 (343h8m13.206733556s) [seg_pos={0 0}, upload=356939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:34:18.775721996 (343h8m13.206802127s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:34:18.775727456 (343h8m13.206807587s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:34:19.230091661 (343h8m13.661171802s) [upload=356939]: Done uploading segments...
Aug 23 00:34:19.230113843 (343h8m13.661193974s) [upload=356939]: Upload finished. err: <nil>
Duration: 5.950183519s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.82597803s
FAIL (2025-08-23 00:40:55 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded
Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 5.826002367s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X......................X....................X........X] duration:
1.690496511s
FAIL (2025-08-23 00:40:36 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 23 00:40:35.383082054 (343h14m29.814162185s) [upload=357050]: Starting upload
Aug 23 00:40:35.383139785 (343h14m29.814219916s) [upload=357050]: Done starting upload
Aug 23 00:40:35.383240888 (343h14m29.814321019s) [upload=357050]: Uploading segments...
Aug 23 00:40:35.383326502 (343h14m29.814406633s) [upload=357050]: Got next segment. Inline: true
Aug 23 00:40:35.383331031 (343h14m29.814411162s) [upload=357050]: Waiting for error group managing segments...
Aug 23 00:40:35.383388120 (343h14m29.814468251s) [upload=357050]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:40:35.383393491 (343h14m29.814473632s) [upload=357050]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 23 00:40:35.383398520 (343h14m29.814478641s) [upload=357050]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:40:35.665198312 (343h14m30.096278443s) [upload=357050]: Done uploading segments...
Aug 23 00:40:35.665216276 (343h14m30.096296407s) [upload=357050]: Upload finished. err: <nil>
Duration: 1.690518332s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [......X.....X.......XX............X............X....X.......] duration:
5.848030782s
FAIL (2025-08-23 00:39:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 23 00:34:16.194752327 (343h8m10.625832488s) [upload=356939]: Starting upload
Aug 23 00:34:16.194845054 (343h8m10.625925195s) [upload=356939]: Done starting upload
Aug 23 00:34:16.194927331 (343h8m10.626007482s) [upload=356939]: Uploading segments...
Aug 23 00:34:16.195247013 (343h8m10.626327184s) [upload=356939]: Got next segment. Inline: false
Aug 23 00:34:16.195299824 (343h8m10.626379955s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 23 00:34:16.195307970 (343h8m10.626388111s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 23 00:34:16.650571705 (343h8m11.081651846s) [seg_pos={0 0}, upload=356939]: Begin upload segment...
Aug 23 00:34:16.650633293 (343h8m11.081713424s) [seg_pos={0 0}, upload=356939]: Done begin upload segment.
Aug 23 00:34:16.650666106 (343h8m11.081746237s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.650721532 (343h8m11.081801653s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651269892 (343h8m11.082350023s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651277957 (343h8m11.082358088s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651675818 (343h8m11.082755949s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.651760661 (343h8m11.082840782s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652093608 (343h8m11.083173739s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652295494 (343h8m11.083375655s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652631566 (343h8m11.083711697s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.652826569 (343h8m11.0839067s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653198021 (343h8m11.084278152s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653409155 (343h8m11.084489286s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653602495 (343h8m11.084682626s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.653839979 (343h8m11.08492011s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654084266 (343h8m11.085164397s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654309276 (343h8m11.085389407s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.654507296 (343h8m11.085587417s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:16.655010238 (343h8m11.086090369s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Uploading piece...
Aug 23 00:34:17.796453348 (343h8m12.227533469s) [upload=356939]: Next returned nil segment
Aug 23 00:34:17.796470451 (343h8m12.227550582s) [upload=356939]: Waiting for error group managing segments...
Aug 23 00:34:18.083415337 (343h8m12.514495468s) [noise=true , address=79.127.205.245:4252 , piece_id=EHETAXKZE4KVSUPQTXA4OAA5FE7GLC6YVAFJMKSVM35BRQAJIZFA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.089601254 (343h8m12.520681385s) [noise=true , address=79.127.205.234:4616 , piece_id=ZBHFOD5T2DYBZHP5RMZE7NGYQWNWMS7EVO3JVMO4TWEKJGFP653A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.558618445 (343h8m12.989698576s) [noise=true , address=104.36.82.45:4907 , piece_id=CAJEDYKHBU2SEEPHNDUX3X7PUKJFEZS3ZLFCDPH7VONK3XRZJ5WQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.581258043 (343h8m13.012338174s) [noise=true , address=104.36.82.50:4040 , piece_id=2R5PQ4QQ4LBPJB2QNZ5GXG7WJ5C3AETMAWIOBC4Y2CY2G6REWK3Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605355360 (343h8m13.036435481s) [noise=true , address=104.36.82.60:4371 , piece_id=EJJQYNMNVPNUDA3RPWYHQXVCRHKLVH5BV45YCHFEWRDYMMNN6KMA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.605454419 (343h8m13.036534551s) [noise=true , address=77.90.31.10:4550 , piece_id=AA6PCPND73SVS5P7RQQUFK2W6SFSQOTE5WMEEKJZ4VCBKU2XVQJA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.610500565 (343h8m13.041580686s) [noise=true , address=104.36.82.15:4260 , piece_id=LLKPXXN3CMUFENW2JEV4HUDTA5ZCQKFD46PQSA4RQYMICAATDLUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.627994978 (343h8m13.059075109s) [noise=true , address=104.36.82.20:4455 , piece_id=ZYVU5Y5BUAMJQ5NYZGT3BT2CVCTI26GDF7KUEGJCXZPY2MWYIIUQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.661169354 (343h8m13.092249475s) [noise=true , address=77.90.31.16:4741 , piece_id=3LNEVF62KQBH626LMTXLHSNVCRSJVJ6LO4CH2T4PGAWNFA2O4DGQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.669453564 (343h8m13.100533696s) [noise=true , address=104.36.82.51:4080 , piece_id=2HMIERXXONID4VTJ254MXCJFXLTJGSBIKFZH5RZQJI7TZKVMRG2Q, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.681073117 (343h8m13.112153248s) [noise=true , address=104.36.82.37:4663 , piece_id=5J37FSCGDAHZTNTPMSB6WAMUCNGMOBDHIBB2UCABNYUKKZDNYQOQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.684575859 (343h8m13.11565599s) [noise=true , address=104.36.82.23:4445 , piece_id=ZCXJRLYXWGEI3TENMHWKFNVG23HITPP7CSNKBLZZ2MJEWORK74HQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.708997517 (343h8m13.140077648s) [noise=true , address=104.36.82.16:4299 , piece_id=IEJ2ULMVVCBGKQ5T7GQRVQPSCZ35PBR73NJHID352KP4DXNGLSMQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775302033 (343h8m13.206382164s) [noise=true , address=104.36.82.42:4805 , piece_id=L72BRLPYJC3DWK4LJZGIYJZZLEH27DTFWGVIJMT7OSD3GPX2LX5A, seg_pos={0 0}, upload=356939]: Done uploading piece. err: <nil>
Aug 23 00:34:18.775332441 (343h8m13.206412572s) [seg_pos={0 0}, upload=356939]: Segment reached optimal threshold of 14 pieces.
Aug 23 00:34:18.775469603 (343h8m13.206549734s) [noise=true , address=104.36.82.44:4871 , piece_id=DKB6XLNLH6YPXQ6EOPPSJM3Z3RQ3H4IRYD4MPKCOSOGW7MWOSHEA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775522184 (343h8m13.206602355s) [noise=true , address=77.90.31.12:4605 , piece_id=5ANKLM24DQ6FYOJASLOIKSBFZDNRAS4MQZETFJDPO4ZGKKCDQAIA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V4Dj8k4kAnrS6GfSJvvDDPvyHTiJziufBCWWjNoPe1Yvc6M53): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775552362 (343h8m13.206632493s) [noise=true , address=104.36.82.10:4112 , piece_id=U4CWCHUBYYEB7RIPIWW2AGPMYRFCWZ7YMNX5WNMW7YTH6IUZQKOA, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1coJuRC2n26y5sjxB49CVmri8gvxtVFwsxGDraVxZifM7Hrb1j): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775631824 (343h8m13.206711965s) [noise=true , address=104.36.82.10:4106 , piece_id=GZZQRPT7DD2IA3YXE5PCFXSQQA4MJAVZNBKKTD3XHPGOBWMOX2UQ, seg_pos={0 0}, upload=356939]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CsQq2BuV9hNc5fVAsw882NkDJMEXZeNwhV2FGNGKAU6wuFBHm): protocol: expected piece hash; context canceled; EOF
Aug 23 00:34:18.775653415 (343h8m13.206733556s) [seg_pos={0 0}, upload=356939]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 23 00:34:18.775721996 (343h8m13.206802127s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 23 00:34:18.775727456 (343h8m13.206807587s) [upload=356939]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 23 00:34:19.230091661 (343h8m13.661171802s) [upload=356939]: Done uploading segments...
Aug 23 00:34:19.230113843 (343h8m13.661193974s) [upload=356939]: Upload finished. err: <nil>
Duration: 5.848058606s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.925069557s
FAIL (2025-08-23 00:39:50 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: encryption: failed to upload enough pieces (needed at least 13 but got 0)
======LOGS======
5.421110771s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990244790 (342h32m45.421324921s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990573729 (342h32m45.42165386s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990781947 (342h32m45.421862078s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.990997610 (342h32m45.422077731s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991173066 (342h32m45.422253197s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991423696 (342h32m45.422503817s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991658044 (342h32m45.422738175s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.991925275 (342h32m45.423005406s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:50.992153031 (342h32m45.423233162s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Uploading piece...
Aug 22 23:58:51.878312575 (342h32m46.309392706s) [upload=356334]: Next segment err: context deadline exceeded
Aug 22 23:58:51.878991865 (342h32m46.310071996s) [noise=true , address=45.91.116.6:4973 , piece_id=BAW2AT5RZ4J7LAE5DX5ZJQVRBOYUIUDFK2PBVFRAFTDZB4JOEE3Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 188.166.225.170:37300->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879044857 (342h32m46.310124988s) [noise=true , address=104.36.82.11:4113 , piece_id=FGONZGL4WWODC36AYX4X56BNOSCYE2YLPJF63CKNAWCUNUZIGC2A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: read tcp 188.166.225.170:50570->104.36.82.11:4113: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879098269 (342h32m46.3101784s) [noise=true , address=45.91.116.14:4190 , piece_id=EFQVNJDKUSY4DB3JTLLLFSIRVQ6FVWLNDY6SJVKI5DTB3SXXTDOA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG, address:45.91.116.14:4190): protocol: read tcp 188.166.225.170:32950->45.91.116.14:4190: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879138706 (342h32m46.310218847s) [noise=true , address=77.90.31.18:4806 , piece_id=LQTXPOUNVDT5PW6FIAPOHQ3C2OICLKZJLAJV6XGALUACUVKPVC7A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: read tcp 188.166.225.170:59450->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879301257 (342h32m46.310381388s) [noise=true , address=104.36.82.2:4731 , piece_id=Y7OU3F22UL6WWA5VXGAUUAWCVRBHLNROF6HUL7LEG6RSFDP7XIZQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: read tcp 188.166.225.170:59588->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879347496 (342h32m46.310427627s) [noise=true , address=104.36.82.10:4078 , piece_id=2SGVD2XXJ6XFNLVTVRSJXLRZB4WPRHCUXNBNDKMHAWK3HZMKAYCQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr, address:104.36.82.10:4078): protocol: read tcp 188.166.225.170:53878->104.36.82.10:4078: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879376822 (342h32m46.310456953s) [noise=true , address=104.36.82.16:4295 , piece_id=KPL4ZDZBIV6U5WEDHBDTBKSBFSEQSCHHLNNQE7ZF2F4LT6MQW2PQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: read tcp 188.166.225.170:37668->104.36.82.16:4295: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879406909 (342h32m46.31048704s) [noise=true , address=104.36.82.16:4293 , piece_id=CI7AYNZI3MCHVIAMYMTKOFUIJIIUM6UFKMEYZLCMMSZQDQZTHF3A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: read tcp 188.166.225.170:47712->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879437568 (342h32m46.310517699s) [noise=true , address=104.36.82.12:4150 , piece_id=IFVHWK6Q7CAH6KUHVH42YOQCCBBNP2AY5S36ZWU5YGHUGTVPVMJA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12YanYT7FkCt7SzDuqx15RP9zxaYmikVLzPkBp4i15WEShDpfpK, address:104.36.82.12:4150): protocol: read tcp 188.166.225.170:40304->104.36.82.12:4150: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879471542 (342h32m46.310551673s) [noise=true , address=45.91.116.7:4011 , piece_id=RFX3XZCB63J3ULPYUOAUIMDLDVS43HXDECX5FA6S3OBYGWFZFFAA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf, address:45.91.116.7:4011): protocol: read tcp 188.166.225.170:48074->45.91.116.7:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879494246 (342h32m46.310574377s) [noise=true , address=45.91.116.11:4117 , piece_id=7JJQWRBNEXLEI64XXXBZ2IY64VT6ZWEKJT6MJCX6BAGDSLTZY72A, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: read tcp 188.166.225.170:56382->45.91.116.11:4117: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879580751 (342h32m46.310660882s) [noise=true , address=77.90.31.19:4842 , piece_id=IAP2MHYCDSJQLQ4CIPU3T7GFDJKYPNGYD7GSK2KWJAPYRVISBOKQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: read tcp 188.166.225.170:56394->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879626700 (342h32m46.310706841s) [noise=true , address=104.36.82.2:4729 , piece_id=HAIFFULLS3CZTQ665F7D6A3QQKDKSJXY7NZSHL3JB5H2YIHXOQHQ, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: read tcp 188.166.225.170:46104->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879681174 (342h32m46.310761315s) [noise=true , address=104.36.82.3:4767 , piece_id=IOXK572YUY4DATK7R3FE5WUPT3SEUPVFJ64FMCHYOYBL5YHIGY7Q, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5, address:104.36.82.3:4767): protocol: read tcp 188.166.225.170:49806->104.36.82.3:4767: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879697576 (342h32m46.310777707s) [noise=true , address=104.36.82.7:4912 , piece_id=E2SJGCCNW7FK76ZVX3F4ZWXTC2NRZ67WBYWEP3T6TRXAMDGT3DGA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: read tcp 188.166.225.170:43910->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879720168 (342h32m46.310800299s) [noise=true , address=104.36.82.6:4876 , piece_id=JAXYWEHTQ7S7KIJ543CUKJJQ6CNE3DNOVEFXTSA642HXA44EYBCA, seg_pos={0 0}, upload=356334]: Done uploading piece. err: ecclient: upload failed (node:1jMZpvqeRXcQPi1XvVQpVpzU7ZkiemTZCE1yvfXDTjG4NEsmpP, address:104.36.82.6:4876): protocol: read tcp 188.166.225.170:60410->104.36.82.6:4876: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 22 23:58:51.879763091 (342h32m46.310843242s) [seg_pos={0 0}, upload=356334]: Done waiting for segment. successful: 0 optimal: 13 errs: <nil>
Duration: 5.925096238s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X......................X....................X........] duration:
2.090801075s
FAIL (2025-08-23 00:39:42 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 23 00:34:46.442187281 (343h8m40.873267422s) [upload=356950]: Starting upload Aug 23 00:34:46.442232017 (343h8m40.873312148s) [upload=356950]: Done starting upload Aug 23 00:34:46.442276582 (343h8m40.873356703s) [upload=356950]: Uploading segments... Aug 23 00:34:46.442307191 (343h8m40.873387312s) [upload=356950]: Got next segment. Inline: true Aug 23 00:34:46.442310447 (343h8m40.873390578s) [upload=356950]: Waiting for error group managing segments... Aug 23 00:34:46.442349010 (343h8m40.873429141s) [upload=356950]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 23 00:34:46.442353519 (343h8m40.87343365s) [upload=356950]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 23 00:34:46.442356314 (343h8m40.873436445s) [upload=356950]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 23 00:34:46.733459306 (343h8m41.164539437s) [upload=356950]: Done uploading segments... Aug 23 00:34:46.733483092 (343h8m41.164563223s) [upload=356950]: Upload finished. err: <nil>
Duration: 2.090831364s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|