Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X...................X..................X..................] duration:
2.030179705s
FAIL (2025-08-19 11:47:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 2.030228188s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [................X..X............................X.X.X.....X.] duration:
6.060613929s
FAIL (2025-08-19 11:46:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 11:46:16.935652539 (258h20m11.36673267s) [upload=268619]: Starting upload
Aug 19 11:46:16.935689601 (258h20m11.366769732s) [upload=268619]: Done starting upload
Aug 19 11:46:16.935867561 (258h20m11.366947682s) [upload=268619]: Uploading segments...
Aug 19 11:46:16.935897728 (258h20m11.366977859s) [upload=268619]: Got next segment. Inline: false
Aug 19 11:46:16.935926123 (258h20m11.367006244s) [upload=268619]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:46:16.935930281 (258h20m11.367010412s) [upload=268619]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:46:17.388531992 (258h20m11.819612123s) [seg_pos={0 0}, upload=268619]: Begin upload segment...
Aug 19 11:46:17.388576125 (258h20m11.819656256s) [seg_pos={0 0}, upload=268619]: Done begin upload segment.
Aug 19 11:46:17.388608096 (258h20m11.819688227s) [noise=true , address=104.36.82.44:4900 , piece_id=DPFFFOSGRJSY3Y3K7UC7N5HTHDMOX743RGYTV4LQK4MIVSCD6IJQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.388613107 (258h20m11.819693238s) [noise=true , address=104.36.82.5:4844 , piece_id=O4WZ7RWO4W77F3HHVMWWJZEQ7S4P34JGOZJK3HIP7C6EXHGHGY4Q, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.388646400 (258h20m11.819726531s) [noise=true , address=104.36.82.10:4085 , piece_id=6ZP255PMXEJF65JJRGRUG322LXUZHQ544YGCYW5YUZNSCGVEAANQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.388985499 (258h20m11.82006562s) [noise=true , address=79.127.201.215:4345 , piece_id=U2A76QIS4RZMFTNYMVRRKEYOSQNZFY3ECJJOR6RB4UHIGOTBBYAA, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.389008142 (258h20m11.820088273s) [noise=true , address=104.36.82.23:4451 , piece_id=F2UVYK3MGU57FC6G2567RCQQJSAZFTS3TAADFEN2CCH6RZGLDNRQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.389344325 (258h20m11.820424456s) [noise=true , address=77.90.31.19:4844 , piece_id=HGDKSZWBAQUMLH4IR6ACYH4LGLLNZAG5VCPXCBQQ7QBYXY7QRMTQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.389652796 (258h20m11.820732927s) [noise=true , address=79.127.219.48:4093 , piece_id=YCETHKHRTCOLN6QALPKWYZNROZYJOJAOQW4CHMVFDBYKFIU4VBIQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.389921980 (258h20m11.821002112s) [noise=true , address=104.36.82.60:4338 , piece_id=RCNOVTMTP5TONIKJ74ALNS2WA65BOALNZAJBJKCAMWQIWES36GCQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.390161018 (258h20m11.821241149s) [noise=true , address=77.90.31.16:4760 , piece_id=GEBXGHWRRM4UXH4N4TKLRDZ63TDZKFMEJHY3D7YBRCQERC54XTQA, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.390316516 (258h20m11.821396647s) [noise=true , address=104.36.82.13:4211 , piece_id=ED3EE6VYIQ7QHCS4R7PTE3CI3VEWWLZUN6VCEMBUANHWR3LV4NKA, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.390560974 (258h20m11.821641105s) [noise=true , address=45.91.116.7:4044 , piece_id=WDEKWD2GKXM42NLHWGD2EFGJ3FNGYVEUYWXUZLO4UMKO5G6OTOIA, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.390781355 (258h20m11.821861487s) [noise=true , address=104.36.82.43:4861 , piece_id=ZAC6AWSYCM273427TYWAMCE4FDXFKV5FQKITL2QHHOEJSMOL4FUA, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.390860417 (258h20m11.821940538s) [noise=true , address=77.90.31.18:4814 , piece_id=XJFNVOXMG7WAF6ZV2D3WWJRQPZTJORILOFRJTQ5PF4CF4KK5UZPA, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.391081370 (258h20m11.822161501s) [noise=true , address=66.23.193.175:4558 , piece_id=EBQZIIZGQKIVUJB5KUTODLHURTKC6EUE3WJ6S4VL32SYGQ5D3Z4Q, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.391357909 (258h20m11.82243804s) [noise=true , address=45.91.116.5:4313 , piece_id=WCC7KX333CHZHYXPOWVZQZ56WFPXSBKLTTP7F5K2ZTHU7YCK2ZMQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.391436679 (258h20m11.822516811s) [noise=true , address=77.90.31.12:4622 , piece_id=7AP6B3FKEEKXSIAFZ7XZJD77YZJOCM5SEAS2DWD2UBSADQBH5FWQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.391649406 (258h20m11.822729537s) [noise=true , address=104.36.82.18:4382 , piece_id=NBDDIRHVP3WMOW6PTXLZCB3IHAL6G4CH2GMGHSQTGMKIF6BXTR6A, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.391856012 (258h20m11.822936143s) [noise=true , address=77.90.31.10:4549 , piece_id=DUZ2ZMBSISF2OIZZQLDR237LB65OXQNDX2WDQV4CB37A5ERGQK6Q, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:18.526940809 (258h20m12.958020941s) [upload=268619]: Next returned nil segment
Aug 19 11:46:18.526979343 (258h20m12.958059474s) [upload=268619]: Waiting for error group managing segments...
Aug 19 11:46:18.814623579 (258h20m13.24570371s) [noise=true , address=66.23.193.175:4558 , piece_id=EBQZIIZGQKIVUJB5KUTODLHURTKC6EUE3WJ6S4VL32SYGQ5D3Z4Q, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.299403499 (258h20m13.73048363s) [noise=true , address=79.127.219.48:4093 , piece_id=YCETHKHRTCOLN6QALPKWYZNROZYJOJAOQW4CHMVFDBYKFIU4VBIQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.309564211 (258h20m13.740644342s) [noise=true , address=45.91.116.7:4044 , piece_id=WDEKWD2GKXM42NLHWGD2EFGJ3FNGYVEUYWXUZLO4UMKO5G6OTOIA, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.353592836 (258h20m13.784672957s) [noise=true , address=77.90.31.18:4814 , piece_id=XJFNVOXMG7WAF6ZV2D3WWJRQPZTJORILOFRJTQ5PF4CF4KK5UZPA, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.354726756 (258h20m13.785806887s) [noise=true , address=104.36.82.10:4085 , piece_id=6ZP255PMXEJF65JJRGRUG322LXUZHQ544YGCYW5YUZNSCGVEAANQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.359274207 (258h20m13.790354338s) [noise=true , address=79.127.201.215:4345 , piece_id=U2A76QIS4RZMFTNYMVRRKEYOSQNZFY3ECJJOR6RB4UHIGOTBBYAA, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.372668054 (258h20m13.803748185s) [noise=true , address=104.36.82.44:4900 , piece_id=DPFFFOSGRJSY3Y3K7UC7N5HTHDMOX743RGYTV4LQK4MIVSCD6IJQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.387532276 (258h20m13.818612407s) [noise=true , address=104.36.82.13:4211 , piece_id=ED3EE6VYIQ7QHCS4R7PTE3CI3VEWWLZUN6VCEMBUANHWR3LV4NKA, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.442061614 (258h20m13.873141735s) [noise=true , address=45.91.116.5:4313 , piece_id=WCC7KX333CHZHYXPOWVZQZ56WFPXSBKLTTP7F5K2ZTHU7YCK2ZMQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.443626548 (258h20m13.874706679s) [noise=true , address=77.90.31.16:4760 , piece_id=GEBXGHWRRM4UXH4N4TKLRDZ63TDZKFMEJHY3D7YBRCQERC54XTQA, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.451654549 (258h20m13.88273468s) [noise=true , address=77.90.31.10:4549 , piece_id=DUZ2ZMBSISF2OIZZQLDR237LB65OXQNDX2WDQV4CB37A5ERGQK6Q, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.472538399 (258h20m13.90361853s) [noise=true , address=104.36.82.23:4451 , piece_id=F2UVYK3MGU57FC6G2567RCQQJSAZFTS3TAADFEN2CCH6RZGLDNRQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.483950776 (258h20m13.915030897s) [noise=true , address=104.36.82.18:4382 , piece_id=NBDDIRHVP3WMOW6PTXLZCB3IHAL6G4CH2GMGHSQTGMKIF6BXTR6A, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.580317155 (258h20m14.011397286s) [noise=true , address=104.36.82.43:4861 , piece_id=ZAC6AWSYCM273427TYWAMCE4FDXFKV5FQKITL2QHHOEJSMOL4FUA, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.580342143 (258h20m14.011422274s) [seg_pos={0 0}, upload=268619]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:46:19.580461773 (258h20m14.011541904s) [noise=true , address=77.90.31.19:4844 , piece_id=HGDKSZWBAQUMLH4IR6ACYH4LGLLNZAG5VCPXCBQQ7QBYXY7QRMTQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t): protocol: expected piece hash; context canceled; EOF
Aug 19 11:46:19.580517569 (258h20m14.0115977s) [noise=true , address=77.90.31.12:4622 , piece_id=7AP6B3FKEEKXSIAFZ7XZJD77YZJOCM5SEAS2DWD2UBSADQBH5FWQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MQryCwJkVN1JhFm4QqhypX3WoMDR9rdjELj4oYoVbpa6U823Z): protocol: expected piece hash; context canceled; EOF
Aug 19 11:46:19.580527358 (258h20m14.011607479s) [noise=true , address=104.36.82.5:4844 , piece_id=O4WZ7RWO4W77F3HHVMWWJZEQ7S4P34JGOZJK3HIP7C6EXHGHGY4Q, seg_pos={0 0}, upload=268619]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:46:19.580558537 (258h20m14.011638658s) [noise=true , address=104.36.82.60:4338 , piece_id=RCNOVTMTP5TONIKJ74ALNS2WA65BOALNZAJBJKCAMWQIWES36GCQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: expected piece hash; context canceled; EOF
Aug 19 11:46:19.580571643 (258h20m14.011651774s) [seg_pos={0 0}, upload=268619]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:46:19.580631908 (258h20m14.011712039s) [upload=268619]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:46:19.580635545 (258h20m14.011715676s) [upload=268619]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:46:19.888568452 (258h20m14.319648573s) [upload=268619]: Done uploading segments...
Aug 19 11:46:19.888587749 (258h20m14.31966788s) [upload=268619]: Upload finished. err: <nil>
Duration: 6.060640389s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X...................X..................X.................] duration:
1.840038195s
FAIL (2025-08-19 11:46:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 1.840063934s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.................X..X............................X.X.X.....X] duration:
4.056267282s
FAIL (2025-08-19 11:46:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 11:46:16.935652539 (258h20m11.36673267s) [upload=268619]: Starting upload
Aug 19 11:46:16.935689601 (258h20m11.366769732s) [upload=268619]: Done starting upload
Aug 19 11:46:16.935867561 (258h20m11.366947682s) [upload=268619]: Uploading segments...
Aug 19 11:46:16.935897728 (258h20m11.366977859s) [upload=268619]: Got next segment. Inline: false
Aug 19 11:46:16.935926123 (258h20m11.367006244s) [upload=268619]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:46:16.935930281 (258h20m11.367010412s) [upload=268619]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:46:17.388531992 (258h20m11.819612123s) [seg_pos={0 0}, upload=268619]: Begin upload segment...
Aug 19 11:46:17.388576125 (258h20m11.819656256s) [seg_pos={0 0}, upload=268619]: Done begin upload segment.
Aug 19 11:46:17.388608096 (258h20m11.819688227s) [noise=true , address=104.36.82.44:4900 , piece_id=DPFFFOSGRJSY3Y3K7UC7N5HTHDMOX743RGYTV4LQK4MIVSCD6IJQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.388613107 (258h20m11.819693238s) [noise=true , address=104.36.82.5:4844 , piece_id=O4WZ7RWO4W77F3HHVMWWJZEQ7S4P34JGOZJK3HIP7C6EXHGHGY4Q, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.388646400 (258h20m11.819726531s) [noise=true , address=104.36.82.10:4085 , piece_id=6ZP255PMXEJF65JJRGRUG322LXUZHQ544YGCYW5YUZNSCGVEAANQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.388985499 (258h20m11.82006562s) [noise=true , address=79.127.201.215:4345 , piece_id=U2A76QIS4RZMFTNYMVRRKEYOSQNZFY3ECJJOR6RB4UHIGOTBBYAA, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.389008142 (258h20m11.820088273s) [noise=true , address=104.36.82.23:4451 , piece_id=F2UVYK3MGU57FC6G2567RCQQJSAZFTS3TAADFEN2CCH6RZGLDNRQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.389344325 (258h20m11.820424456s) [noise=true , address=77.90.31.19:4844 , piece_id=HGDKSZWBAQUMLH4IR6ACYH4LGLLNZAG5VCPXCBQQ7QBYXY7QRMTQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.389652796 (258h20m11.820732927s) [noise=true , address=79.127.219.48:4093 , piece_id=YCETHKHRTCOLN6QALPKWYZNROZYJOJAOQW4CHMVFDBYKFIU4VBIQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.389921980 (258h20m11.821002112s) [noise=true , address=104.36.82.60:4338 , piece_id=RCNOVTMTP5TONIKJ74ALNS2WA65BOALNZAJBJKCAMWQIWES36GCQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.390161018 (258h20m11.821241149s) [noise=true , address=77.90.31.16:4760 , piece_id=GEBXGHWRRM4UXH4N4TKLRDZ63TDZKFMEJHY3D7YBRCQERC54XTQA, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.390316516 (258h20m11.821396647s) [noise=true , address=104.36.82.13:4211 , piece_id=ED3EE6VYIQ7QHCS4R7PTE3CI3VEWWLZUN6VCEMBUANHWR3LV4NKA, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.390560974 (258h20m11.821641105s) [noise=true , address=45.91.116.7:4044 , piece_id=WDEKWD2GKXM42NLHWGD2EFGJ3FNGYVEUYWXUZLO4UMKO5G6OTOIA, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.390781355 (258h20m11.821861487s) [noise=true , address=104.36.82.43:4861 , piece_id=ZAC6AWSYCM273427TYWAMCE4FDXFKV5FQKITL2QHHOEJSMOL4FUA, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.390860417 (258h20m11.821940538s) [noise=true , address=77.90.31.18:4814 , piece_id=XJFNVOXMG7WAF6ZV2D3WWJRQPZTJORILOFRJTQ5PF4CF4KK5UZPA, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.391081370 (258h20m11.822161501s) [noise=true , address=66.23.193.175:4558 , piece_id=EBQZIIZGQKIVUJB5KUTODLHURTKC6EUE3WJ6S4VL32SYGQ5D3Z4Q, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.391357909 (258h20m11.82243804s) [noise=true , address=45.91.116.5:4313 , piece_id=WCC7KX333CHZHYXPOWVZQZ56WFPXSBKLTTP7F5K2ZTHU7YCK2ZMQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.391436679 (258h20m11.822516811s) [noise=true , address=77.90.31.12:4622 , piece_id=7AP6B3FKEEKXSIAFZ7XZJD77YZJOCM5SEAS2DWD2UBSADQBH5FWQ, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.391649406 (258h20m11.822729537s) [noise=true , address=104.36.82.18:4382 , piece_id=NBDDIRHVP3WMOW6PTXLZCB3IHAL6G4CH2GMGHSQTGMKIF6BXTR6A, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:17.391856012 (258h20m11.822936143s) [noise=true , address=77.90.31.10:4549 , piece_id=DUZ2ZMBSISF2OIZZQLDR237LB65OXQNDX2WDQV4CB37A5ERGQK6Q, seg_pos={0 0}, upload=268619]: Uploading piece...
Aug 19 11:46:18.526940809 (258h20m12.958020941s) [upload=268619]: Next returned nil segment
Aug 19 11:46:18.526979343 (258h20m12.958059474s) [upload=268619]: Waiting for error group managing segments...
Aug 19 11:46:18.814623579 (258h20m13.24570371s) [noise=true , address=66.23.193.175:4558 , piece_id=EBQZIIZGQKIVUJB5KUTODLHURTKC6EUE3WJ6S4VL32SYGQ5D3Z4Q, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.299403499 (258h20m13.73048363s) [noise=true , address=79.127.219.48:4093 , piece_id=YCETHKHRTCOLN6QALPKWYZNROZYJOJAOQW4CHMVFDBYKFIU4VBIQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.309564211 (258h20m13.740644342s) [noise=true , address=45.91.116.7:4044 , piece_id=WDEKWD2GKXM42NLHWGD2EFGJ3FNGYVEUYWXUZLO4UMKO5G6OTOIA, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.353592836 (258h20m13.784672957s) [noise=true , address=77.90.31.18:4814 , piece_id=XJFNVOXMG7WAF6ZV2D3WWJRQPZTJORILOFRJTQ5PF4CF4KK5UZPA, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.354726756 (258h20m13.785806887s) [noise=true , address=104.36.82.10:4085 , piece_id=6ZP255PMXEJF65JJRGRUG322LXUZHQ544YGCYW5YUZNSCGVEAANQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.359274207 (258h20m13.790354338s) [noise=true , address=79.127.201.215:4345 , piece_id=U2A76QIS4RZMFTNYMVRRKEYOSQNZFY3ECJJOR6RB4UHIGOTBBYAA, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.372668054 (258h20m13.803748185s) [noise=true , address=104.36.82.44:4900 , piece_id=DPFFFOSGRJSY3Y3K7UC7N5HTHDMOX743RGYTV4LQK4MIVSCD6IJQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.387532276 (258h20m13.818612407s) [noise=true , address=104.36.82.13:4211 , piece_id=ED3EE6VYIQ7QHCS4R7PTE3CI3VEWWLZUN6VCEMBUANHWR3LV4NKA, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.442061614 (258h20m13.873141735s) [noise=true , address=45.91.116.5:4313 , piece_id=WCC7KX333CHZHYXPOWVZQZ56WFPXSBKLTTP7F5K2ZTHU7YCK2ZMQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.443626548 (258h20m13.874706679s) [noise=true , address=77.90.31.16:4760 , piece_id=GEBXGHWRRM4UXH4N4TKLRDZ63TDZKFMEJHY3D7YBRCQERC54XTQA, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.451654549 (258h20m13.88273468s) [noise=true , address=77.90.31.10:4549 , piece_id=DUZ2ZMBSISF2OIZZQLDR237LB65OXQNDX2WDQV4CB37A5ERGQK6Q, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.472538399 (258h20m13.90361853s) [noise=true , address=104.36.82.23:4451 , piece_id=F2UVYK3MGU57FC6G2567RCQQJSAZFTS3TAADFEN2CCH6RZGLDNRQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.483950776 (258h20m13.915030897s) [noise=true , address=104.36.82.18:4382 , piece_id=NBDDIRHVP3WMOW6PTXLZCB3IHAL6G4CH2GMGHSQTGMKIF6BXTR6A, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.580317155 (258h20m14.011397286s) [noise=true , address=104.36.82.43:4861 , piece_id=ZAC6AWSYCM273427TYWAMCE4FDXFKV5FQKITL2QHHOEJSMOL4FUA, seg_pos={0 0}, upload=268619]: Done uploading piece. err: <nil>
Aug 19 11:46:19.580342143 (258h20m14.011422274s) [seg_pos={0 0}, upload=268619]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:46:19.580461773 (258h20m14.011541904s) [noise=true , address=77.90.31.19:4844 , piece_id=HGDKSZWBAQUMLH4IR6ACYH4LGLLNZAG5VCPXCBQQ7QBYXY7QRMTQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t): protocol: expected piece hash; context canceled; EOF
Aug 19 11:46:19.580517569 (258h20m14.0115977s) [noise=true , address=77.90.31.12:4622 , piece_id=7AP6B3FKEEKXSIAFZ7XZJD77YZJOCM5SEAS2DWD2UBSADQBH5FWQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MQryCwJkVN1JhFm4QqhypX3WoMDR9rdjELj4oYoVbpa6U823Z): protocol: expected piece hash; context canceled; EOF
Aug 19 11:46:19.580527358 (258h20m14.011607479s) [noise=true , address=104.36.82.5:4844 , piece_id=O4WZ7RWO4W77F3HHVMWWJZEQ7S4P34JGOZJK3HIP7C6EXHGHGY4Q, seg_pos={0 0}, upload=268619]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iovpNdbidkiv9mEHaAPjBubGmoqr4sUJWm8Cb64LzS6wuwLWa): protocol: expected piece hash; context canceled; EOF
Aug 19 11:46:19.580558537 (258h20m14.011638658s) [noise=true , address=104.36.82.60:4338 , piece_id=RCNOVTMTP5TONIKJ74ALNS2WA65BOALNZAJBJKCAMWQIWES36GCQ, seg_pos={0 0}, upload=268619]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cTadUV1Zu2Z8MoobXvyZ965fv6jPFhYGsy5qgRZHgWeSwyitN): protocol: expected piece hash; context canceled; EOF
Aug 19 11:46:19.580571643 (258h20m14.011651774s) [seg_pos={0 0}, upload=268619]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:46:19.580631908 (258h20m14.011712039s) [upload=268619]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:46:19.580635545 (258h20m14.011715676s) [upload=268619]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:46:19.888568452 (258h20m14.319648573s) [upload=268619]: Done uploading segments...
Aug 19 11:46:19.888587749 (258h20m14.31966788s) [upload=268619]: Upload finished. err: <nil>
Duration: 4.056303051s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X...................X..................X................] duration:
2.087657596s
FAIL (2025-08-19 11:46:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 2.087682434s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.706685126s
FAIL (2025-08-19 11:45:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.706706858s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
7.506722469s
FAIL (2025-08-19 11:45:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.50674393s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X...................X..................X...............] duration:
2.130561509s
FAIL (2025-08-19 11:45:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 2.13058815s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..................X..X............................X.X.X.....] duration:
6.155846726s
FAIL (2025-08-19 11:45:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 04adadbb5cf25c9a7d46b5184d9e9a71020b0a9d0bb0e25c685c9b9c6a13b7e5 != before ca876f63385e960b8b5781314ef9cb029c6ffcb92cb0f88447ed41d622b45990
======LOGS======
Aug 19 11:41:47.817286622 (258h15m42.248366753s) [upload=268543]: Starting upload
Aug 19 11:41:47.817336156 (258h15m42.248416287s) [upload=268543]: Done starting upload
Aug 19 11:41:47.817413204 (258h15m42.248493335s) [upload=268543]: Uploading segments...
Aug 19 11:41:47.817529987 (258h15m42.248610108s) [upload=268543]: Got next segment. Inline: false
Aug 19 11:41:47.817570325 (258h15m42.248650456s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:41:47.817576306 (258h15m42.248656437s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:41:48.345713116 (258h15m42.776793298s) [seg_pos={0 0}, upload=268543]: Begin upload segment...
Aug 19 11:41:48.345779413 (258h15m42.776859574s) [seg_pos={0 0}, upload=268543]: Done begin upload segment.
Aug 19 11:41:48.345828948 (258h15m42.776909149s) [noise=true , address=104.36.82.5:4842 , piece_id=E4QD3PQKODDZFBRXNOFM37WCMHKB3HWKSFLI7Y3WJB33LL3K6XUQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.345845821 (258h15m42.776925962s) [noise=true , address=104.36.82.23:4454 , piece_id=BNITK4VOOZZ4TDRNNMCDVVXRAFAYHISRG2WSTO3WQZZKYO7JQD2Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.345895816 (258h15m42.776976018s) [noise=true , address=77.90.31.16:4755 , piece_id=6R3UECCD4KU5BYBNMEFQ227SB6TBTWGM5C5SKGWLNA3ZYTG2BMWQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.346676510 (258h15m42.777756671s) [noise=true , address=104.36.82.12:4156 , piece_id=ESKFF2IPWZOD25PEOGV6CCH2ARUN43ME5HIKIR4FMW7MVYG2EHNA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.346709903 (258h15m42.777790054s) [noise=true , address=104.36.82.12:4167 , piece_id=P3IGYTBBA3BU6NZ7RWBGHVQLJNFZ4AOWZOPITU5F7WU3KUL3BKJQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347333156 (258h15m42.778413307s) [noise=true , address=77.90.31.18:4840 , piece_id=7J2FGEB22ZTSE34C3T65TN3CXUZFWNC6ZNVB7JYO4JWP7B2DX4DQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347340019 (258h15m42.77842015s) [noise=true , address=77.90.31.13:4650 , piece_id=S3QYZY7W2N672MESG2VPMSULMFDI3VI4DOTENTPBTDSOGYITCFXA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347919809 (258h15m42.77899994s) [noise=true , address=77.90.31.17:4786 , piece_id=WOTTIVSTRCFPZMWXNSWEIYPDG6MZPE7Y7QT3AJ4HTMOSLMJ3A7ZQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347936831 (258h15m42.779016972s) [noise=true , address=77.90.31.10:4543 , piece_id=UKQ4XH7DMUKKFNP5GOK3WCWEB4RQL5CDEIVHPK6NGJKUE6QZZJLA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348449042 (258h15m42.779529163s) [noise=true , address=45.91.116.10:4114 , piece_id=DAPK4Q4N76HFVALGOHMJNKJI56L4FTOU7OPR3265KKGKYB2Z72AA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348466555 (258h15m42.779546686s) [noise=true , address=104.36.82.44:4900 , piece_id=EF4STQAVQQJ6LDDTXJMSUQKYKVNZHZ6HJ3P3WS23CTQOHLXW2DZA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348929030 (258h15m42.780009161s) [noise=true , address=45.91.116.11:4129 , piece_id=7NDOFXPIEQB7UYCWHPYMLWVTWWZH6TKSHQXBJ7WSW7VTRJOZWQAQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.349304228 (258h15m42.780384359s) [noise=true , address=104.36.82.4:4814 , piece_id=Y63J3PWGS6EHQ3EW5AUPOKSNQ734FTS3MFK7OB7N4KOPK2H75F6Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.349688202 (258h15m42.780768323s) [noise=true , address=45.91.116.13:4169 , piece_id=XHE764YPBPDLFULGZJDLRNYYL5YIYV5XFVGIHQTJ22LRDTLU3LOA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350084069 (258h15m42.781164201s) [noise=true , address=104.36.82.60:4363 , piece_id=PFTQPOCLSPJYTTL5R3EVZ72TB6NKKQ562U3GKKJRMJAUIUOQL7UQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350430332 (258h15m42.781510463s) [noise=true , address=77.90.31.21:4891 , piece_id=HVOZDQTRBYCR4G7L3N56YH3BMJGJP432IUVLBE5NMX5J5OHATH5Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350766535 (258h15m42.781846666s) [noise=true , address=45.91.116.14:4204 , piece_id=SVEXVOUI3FPDKJEFBKIPYRAW6W2TFLFLWAPNIZPMB3SA3IVQIP5Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.352249323 (258h15m42.783329464s) [noise=true , address=77.90.31.15:4707 , piece_id=BFIRHKUGRF32YW73P375IVAIVYH7K4YR6KUNOWQ4DHWAQOIG2GEA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:49.865502248 (258h15m44.296582379s) [upload=268543]: Next returned nil segment
Aug 19 11:41:49.865520823 (258h15m44.296600954s) [upload=268543]: Waiting for error group managing segments...
Aug 19 11:41:50.288124564 (258h15m44.719204695s) [noise=true , address=45.91.116.13:4169 , piece_id=XHE764YPBPDLFULGZJDLRNYYL5YIYV5XFVGIHQTJ22LRDTLU3LOA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.328528754 (258h15m44.759608885s) [noise=true , address=77.90.31.17:4786 , piece_id=WOTTIVSTRCFPZMWXNSWEIYPDG6MZPE7Y7QT3AJ4HTMOSLMJ3A7ZQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.373155875 (258h15m44.804236006s) [noise=true , address=104.36.82.44:4900 , piece_id=EF4STQAVQQJ6LDDTXJMSUQKYKVNZHZ6HJ3P3WS23CTQOHLXW2DZA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.382133122 (258h15m44.813213253s) [noise=true , address=104.36.82.60:4363 , piece_id=PFTQPOCLSPJYTTL5R3EVZ72TB6NKKQ562U3GKKJRMJAUIUOQL7UQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.388799869 (258h15m44.81988s) [noise=true , address=45.91.116.11:4129 , piece_id=7NDOFXPIEQB7UYCWHPYMLWVTWWZH6TKSHQXBJ7WSW7VTRJOZWQAQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.391381658 (258h15m44.822461789s) [noise=true , address=104.36.82.4:4814 , piece_id=Y63J3PWGS6EHQ3EW5AUPOKSNQ734FTS3MFK7OB7N4KOPK2H75F6Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.411205630 (258h15m44.842285761s) [noise=true , address=45.91.116.14:4204 , piece_id=SVEXVOUI3FPDKJEFBKIPYRAW6W2TFLFLWAPNIZPMB3SA3IVQIP5Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.417309559 (258h15m44.84838969s) [noise=true , address=77.90.31.13:4650 , piece_id=S3QYZY7W2N672MESG2VPMSULMFDI3VI4DOTENTPBTDSOGYITCFXA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.421482284 (258h15m44.852562405s) [noise=true , address=104.36.82.5:4842 , piece_id=E4QD3PQKODDZFBRXNOFM37WCMHKB3HWKSFLI7Y3WJB33LL3K6XUQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.446716939 (258h15m44.87779707s) [noise=true , address=77.90.31.16:4755 , piece_id=6R3UECCD4KU5BYBNMEFQ227SB6TBTWGM5C5SKGWLNA3ZYTG2BMWQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.446823452 (258h15m44.877903583s) [noise=true , address=77.90.31.21:4891 , piece_id=HVOZDQTRBYCR4G7L3N56YH3BMJGJP432IUVLBE5NMX5J5OHATH5Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.457853177 (258h15m44.888933308s) [noise=true , address=104.36.82.12:4167 , piece_id=P3IGYTBBA3BU6NZ7RWBGHVQLJNFZ4AOWZOPITU5F7WU3KUL3BKJQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.459991478 (258h15m44.891071609s) [noise=true , address=45.91.116.10:4114 , piece_id=DAPK4Q4N76HFVALGOHMJNKJI56L4FTOU7OPR3265KKGKYB2Z72AA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.488009759 (258h15m44.91908988s) [noise=true , address=104.36.82.12:4156 , piece_id=ESKFF2IPWZOD25PEOGV6CCH2ARUN43ME5HIKIR4FMW7MVYG2EHNA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.488032192 (258h15m44.919112323s) [seg_pos={0 0}, upload=268543]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:41:50.488217617 (258h15m44.919297748s) [noise=true , address=77.90.31.18:4840 , piece_id=7J2FGEB22ZTSE34C3T65TN3CXUZFWNC6ZNVB7JYO4JWP7B2DX4DQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488274956 (258h15m44.919355087s) [noise=true , address=104.36.82.23:4454 , piece_id=BNITK4VOOZZ4TDRNNMCDVVXRAFAYHISRG2WSTO3WQZZKYO7JQD2Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488336093 (258h15m44.919416224s) [noise=true , address=77.90.31.10:4543 , piece_id=UKQ4XH7DMUKKFNP5GOK3WCWEB4RQL5CDEIVHPK6NGJKUE6QZZJLA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hFnVoQD97rytjEVNtPo8QumC37Eq1RM9MeXBP6Bap9rhK73bX): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488374828 (258h15m44.919454959s) [noise=true , address=77.90.31.15:4707 , piece_id=BFIRHKUGRF32YW73P375IVAIVYH7K4YR6KUNOWQ4DHWAQOIG2GEA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488383544 (258h15m44.919463675s) [seg_pos={0 0}, upload=268543]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:41:50.488434943 (258h15m44.919515074s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:41:50.488438590 (258h15m44.919518721s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:41:50.943637428 (258h15m45.374717549s) [upload=268543]: Done uploading segments...
Aug 19 11:41:50.943653790 (258h15m45.374733921s) [upload=268543]: Upload finished. err: <nil>
Duration: 6.15589574s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X...................X..................X..............] duration:
1.928883713s
FAIL (2025-08-19 11:44:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 1.928907979s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
6.516888815s
FAIL (2025-08-19 11:44:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.516903434s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...................X..X............................X.X.X....] duration:
5.906459003s
FAIL (2025-08-19 11:44:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 04adadbb5cf25c9a7d46b5184d9e9a71020b0a9d0bb0e25c685c9b9c6a13b7e5 != before ca876f63385e960b8b5781314ef9cb029c6ffcb92cb0f88447ed41d622b45990
======LOGS======
Aug 19 11:41:47.817286622 (258h15m42.248366753s) [upload=268543]: Starting upload
Aug 19 11:41:47.817336156 (258h15m42.248416287s) [upload=268543]: Done starting upload
Aug 19 11:41:47.817413204 (258h15m42.248493335s) [upload=268543]: Uploading segments...
Aug 19 11:41:47.817529987 (258h15m42.248610108s) [upload=268543]: Got next segment. Inline: false
Aug 19 11:41:47.817570325 (258h15m42.248650456s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:41:47.817576306 (258h15m42.248656437s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:41:48.345713116 (258h15m42.776793298s) [seg_pos={0 0}, upload=268543]: Begin upload segment...
Aug 19 11:41:48.345779413 (258h15m42.776859574s) [seg_pos={0 0}, upload=268543]: Done begin upload segment.
Aug 19 11:41:48.345828948 (258h15m42.776909149s) [noise=true , address=104.36.82.5:4842 , piece_id=E4QD3PQKODDZFBRXNOFM37WCMHKB3HWKSFLI7Y3WJB33LL3K6XUQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.345845821 (258h15m42.776925962s) [noise=true , address=104.36.82.23:4454 , piece_id=BNITK4VOOZZ4TDRNNMCDVVXRAFAYHISRG2WSTO3WQZZKYO7JQD2Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.345895816 (258h15m42.776976018s) [noise=true , address=77.90.31.16:4755 , piece_id=6R3UECCD4KU5BYBNMEFQ227SB6TBTWGM5C5SKGWLNA3ZYTG2BMWQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.346676510 (258h15m42.777756671s) [noise=true , address=104.36.82.12:4156 , piece_id=ESKFF2IPWZOD25PEOGV6CCH2ARUN43ME5HIKIR4FMW7MVYG2EHNA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.346709903 (258h15m42.777790054s) [noise=true , address=104.36.82.12:4167 , piece_id=P3IGYTBBA3BU6NZ7RWBGHVQLJNFZ4AOWZOPITU5F7WU3KUL3BKJQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347333156 (258h15m42.778413307s) [noise=true , address=77.90.31.18:4840 , piece_id=7J2FGEB22ZTSE34C3T65TN3CXUZFWNC6ZNVB7JYO4JWP7B2DX4DQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347340019 (258h15m42.77842015s) [noise=true , address=77.90.31.13:4650 , piece_id=S3QYZY7W2N672MESG2VPMSULMFDI3VI4DOTENTPBTDSOGYITCFXA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347919809 (258h15m42.77899994s) [noise=true , address=77.90.31.17:4786 , piece_id=WOTTIVSTRCFPZMWXNSWEIYPDG6MZPE7Y7QT3AJ4HTMOSLMJ3A7ZQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347936831 (258h15m42.779016972s) [noise=true , address=77.90.31.10:4543 , piece_id=UKQ4XH7DMUKKFNP5GOK3WCWEB4RQL5CDEIVHPK6NGJKUE6QZZJLA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348449042 (258h15m42.779529163s) [noise=true , address=45.91.116.10:4114 , piece_id=DAPK4Q4N76HFVALGOHMJNKJI56L4FTOU7OPR3265KKGKYB2Z72AA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348466555 (258h15m42.779546686s) [noise=true , address=104.36.82.44:4900 , piece_id=EF4STQAVQQJ6LDDTXJMSUQKYKVNZHZ6HJ3P3WS23CTQOHLXW2DZA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348929030 (258h15m42.780009161s) [noise=true , address=45.91.116.11:4129 , piece_id=7NDOFXPIEQB7UYCWHPYMLWVTWWZH6TKSHQXBJ7WSW7VTRJOZWQAQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.349304228 (258h15m42.780384359s) [noise=true , address=104.36.82.4:4814 , piece_id=Y63J3PWGS6EHQ3EW5AUPOKSNQ734FTS3MFK7OB7N4KOPK2H75F6Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.349688202 (258h15m42.780768323s) [noise=true , address=45.91.116.13:4169 , piece_id=XHE764YPBPDLFULGZJDLRNYYL5YIYV5XFVGIHQTJ22LRDTLU3LOA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350084069 (258h15m42.781164201s) [noise=true , address=104.36.82.60:4363 , piece_id=PFTQPOCLSPJYTTL5R3EVZ72TB6NKKQ562U3GKKJRMJAUIUOQL7UQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350430332 (258h15m42.781510463s) [noise=true , address=77.90.31.21:4891 , piece_id=HVOZDQTRBYCR4G7L3N56YH3BMJGJP432IUVLBE5NMX5J5OHATH5Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350766535 (258h15m42.781846666s) [noise=true , address=45.91.116.14:4204 , piece_id=SVEXVOUI3FPDKJEFBKIPYRAW6W2TFLFLWAPNIZPMB3SA3IVQIP5Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.352249323 (258h15m42.783329464s) [noise=true , address=77.90.31.15:4707 , piece_id=BFIRHKUGRF32YW73P375IVAIVYH7K4YR6KUNOWQ4DHWAQOIG2GEA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:49.865502248 (258h15m44.296582379s) [upload=268543]: Next returned nil segment
Aug 19 11:41:49.865520823 (258h15m44.296600954s) [upload=268543]: Waiting for error group managing segments...
Aug 19 11:41:50.288124564 (258h15m44.719204695s) [noise=true , address=45.91.116.13:4169 , piece_id=XHE764YPBPDLFULGZJDLRNYYL5YIYV5XFVGIHQTJ22LRDTLU3LOA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.328528754 (258h15m44.759608885s) [noise=true , address=77.90.31.17:4786 , piece_id=WOTTIVSTRCFPZMWXNSWEIYPDG6MZPE7Y7QT3AJ4HTMOSLMJ3A7ZQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.373155875 (258h15m44.804236006s) [noise=true , address=104.36.82.44:4900 , piece_id=EF4STQAVQQJ6LDDTXJMSUQKYKVNZHZ6HJ3P3WS23CTQOHLXW2DZA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.382133122 (258h15m44.813213253s) [noise=true , address=104.36.82.60:4363 , piece_id=PFTQPOCLSPJYTTL5R3EVZ72TB6NKKQ562U3GKKJRMJAUIUOQL7UQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.388799869 (258h15m44.81988s) [noise=true , address=45.91.116.11:4129 , piece_id=7NDOFXPIEQB7UYCWHPYMLWVTWWZH6TKSHQXBJ7WSW7VTRJOZWQAQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.391381658 (258h15m44.822461789s) [noise=true , address=104.36.82.4:4814 , piece_id=Y63J3PWGS6EHQ3EW5AUPOKSNQ734FTS3MFK7OB7N4KOPK2H75F6Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.411205630 (258h15m44.842285761s) [noise=true , address=45.91.116.14:4204 , piece_id=SVEXVOUI3FPDKJEFBKIPYRAW6W2TFLFLWAPNIZPMB3SA3IVQIP5Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.417309559 (258h15m44.84838969s) [noise=true , address=77.90.31.13:4650 , piece_id=S3QYZY7W2N672MESG2VPMSULMFDI3VI4DOTENTPBTDSOGYITCFXA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.421482284 (258h15m44.852562405s) [noise=true , address=104.36.82.5:4842 , piece_id=E4QD3PQKODDZFBRXNOFM37WCMHKB3HWKSFLI7Y3WJB33LL3K6XUQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.446716939 (258h15m44.87779707s) [noise=true , address=77.90.31.16:4755 , piece_id=6R3UECCD4KU5BYBNMEFQ227SB6TBTWGM5C5SKGWLNA3ZYTG2BMWQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.446823452 (258h15m44.877903583s) [noise=true , address=77.90.31.21:4891 , piece_id=HVOZDQTRBYCR4G7L3N56YH3BMJGJP432IUVLBE5NMX5J5OHATH5Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.457853177 (258h15m44.888933308s) [noise=true , address=104.36.82.12:4167 , piece_id=P3IGYTBBA3BU6NZ7RWBGHVQLJNFZ4AOWZOPITU5F7WU3KUL3BKJQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.459991478 (258h15m44.891071609s) [noise=true , address=45.91.116.10:4114 , piece_id=DAPK4Q4N76HFVALGOHMJNKJI56L4FTOU7OPR3265KKGKYB2Z72AA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.488009759 (258h15m44.91908988s) [noise=true , address=104.36.82.12:4156 , piece_id=ESKFF2IPWZOD25PEOGV6CCH2ARUN43ME5HIKIR4FMW7MVYG2EHNA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.488032192 (258h15m44.919112323s) [seg_pos={0 0}, upload=268543]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:41:50.488217617 (258h15m44.919297748s) [noise=true , address=77.90.31.18:4840 , piece_id=7J2FGEB22ZTSE34C3T65TN3CXUZFWNC6ZNVB7JYO4JWP7B2DX4DQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488274956 (258h15m44.919355087s) [noise=true , address=104.36.82.23:4454 , piece_id=BNITK4VOOZZ4TDRNNMCDVVXRAFAYHISRG2WSTO3WQZZKYO7JQD2Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488336093 (258h15m44.919416224s) [noise=true , address=77.90.31.10:4543 , piece_id=UKQ4XH7DMUKKFNP5GOK3WCWEB4RQL5CDEIVHPK6NGJKUE6QZZJLA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hFnVoQD97rytjEVNtPo8QumC37Eq1RM9MeXBP6Bap9rhK73bX): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488374828 (258h15m44.919454959s) [noise=true , address=77.90.31.15:4707 , piece_id=BFIRHKUGRF32YW73P375IVAIVYH7K4YR6KUNOWQ4DHWAQOIG2GEA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488383544 (258h15m44.919463675s) [seg_pos={0 0}, upload=268543]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:41:50.488434943 (258h15m44.919515074s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:41:50.488438590 (258h15m44.919518721s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:41:50.943637428 (258h15m45.374717549s) [upload=268543]: Done uploading segments...
Aug 19 11:41:50.943653790 (258h15m45.374733921s) [upload=268543]: Upload finished. err: <nil>
Duration: 5.906497226s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
6.757915961s
FAIL (2025-08-19 11:44:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.757936711s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....................X..X............................X.X.X...] duration:
5.875635086s
FAIL (2025-08-19 11:44:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 04adadbb5cf25c9a7d46b5184d9e9a71020b0a9d0bb0e25c685c9b9c6a13b7e5 != before ca876f63385e960b8b5781314ef9cb029c6ffcb92cb0f88447ed41d622b45990
======LOGS======
Aug 19 11:41:47.817286622 (258h15m42.248366753s) [upload=268543]: Starting upload
Aug 19 11:41:47.817336156 (258h15m42.248416287s) [upload=268543]: Done starting upload
Aug 19 11:41:47.817413204 (258h15m42.248493335s) [upload=268543]: Uploading segments...
Aug 19 11:41:47.817529987 (258h15m42.248610108s) [upload=268543]: Got next segment. Inline: false
Aug 19 11:41:47.817570325 (258h15m42.248650456s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:41:47.817576306 (258h15m42.248656437s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:41:48.345713116 (258h15m42.776793298s) [seg_pos={0 0}, upload=268543]: Begin upload segment...
Aug 19 11:41:48.345779413 (258h15m42.776859574s) [seg_pos={0 0}, upload=268543]: Done begin upload segment.
Aug 19 11:41:48.345828948 (258h15m42.776909149s) [noise=true , address=104.36.82.5:4842 , piece_id=E4QD3PQKODDZFBRXNOFM37WCMHKB3HWKSFLI7Y3WJB33LL3K6XUQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.345845821 (258h15m42.776925962s) [noise=true , address=104.36.82.23:4454 , piece_id=BNITK4VOOZZ4TDRNNMCDVVXRAFAYHISRG2WSTO3WQZZKYO7JQD2Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.345895816 (258h15m42.776976018s) [noise=true , address=77.90.31.16:4755 , piece_id=6R3UECCD4KU5BYBNMEFQ227SB6TBTWGM5C5SKGWLNA3ZYTG2BMWQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.346676510 (258h15m42.777756671s) [noise=true , address=104.36.82.12:4156 , piece_id=ESKFF2IPWZOD25PEOGV6CCH2ARUN43ME5HIKIR4FMW7MVYG2EHNA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.346709903 (258h15m42.777790054s) [noise=true , address=104.36.82.12:4167 , piece_id=P3IGYTBBA3BU6NZ7RWBGHVQLJNFZ4AOWZOPITU5F7WU3KUL3BKJQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347333156 (258h15m42.778413307s) [noise=true , address=77.90.31.18:4840 , piece_id=7J2FGEB22ZTSE34C3T65TN3CXUZFWNC6ZNVB7JYO4JWP7B2DX4DQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347340019 (258h15m42.77842015s) [noise=true , address=77.90.31.13:4650 , piece_id=S3QYZY7W2N672MESG2VPMSULMFDI3VI4DOTENTPBTDSOGYITCFXA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347919809 (258h15m42.77899994s) [noise=true , address=77.90.31.17:4786 , piece_id=WOTTIVSTRCFPZMWXNSWEIYPDG6MZPE7Y7QT3AJ4HTMOSLMJ3A7ZQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347936831 (258h15m42.779016972s) [noise=true , address=77.90.31.10:4543 , piece_id=UKQ4XH7DMUKKFNP5GOK3WCWEB4RQL5CDEIVHPK6NGJKUE6QZZJLA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348449042 (258h15m42.779529163s) [noise=true , address=45.91.116.10:4114 , piece_id=DAPK4Q4N76HFVALGOHMJNKJI56L4FTOU7OPR3265KKGKYB2Z72AA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348466555 (258h15m42.779546686s) [noise=true , address=104.36.82.44:4900 , piece_id=EF4STQAVQQJ6LDDTXJMSUQKYKVNZHZ6HJ3P3WS23CTQOHLXW2DZA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348929030 (258h15m42.780009161s) [noise=true , address=45.91.116.11:4129 , piece_id=7NDOFXPIEQB7UYCWHPYMLWVTWWZH6TKSHQXBJ7WSW7VTRJOZWQAQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.349304228 (258h15m42.780384359s) [noise=true , address=104.36.82.4:4814 , piece_id=Y63J3PWGS6EHQ3EW5AUPOKSNQ734FTS3MFK7OB7N4KOPK2H75F6Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.349688202 (258h15m42.780768323s) [noise=true , address=45.91.116.13:4169 , piece_id=XHE764YPBPDLFULGZJDLRNYYL5YIYV5XFVGIHQTJ22LRDTLU3LOA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350084069 (258h15m42.781164201s) [noise=true , address=104.36.82.60:4363 , piece_id=PFTQPOCLSPJYTTL5R3EVZ72TB6NKKQ562U3GKKJRMJAUIUOQL7UQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350430332 (258h15m42.781510463s) [noise=true , address=77.90.31.21:4891 , piece_id=HVOZDQTRBYCR4G7L3N56YH3BMJGJP432IUVLBE5NMX5J5OHATH5Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350766535 (258h15m42.781846666s) [noise=true , address=45.91.116.14:4204 , piece_id=SVEXVOUI3FPDKJEFBKIPYRAW6W2TFLFLWAPNIZPMB3SA3IVQIP5Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.352249323 (258h15m42.783329464s) [noise=true , address=77.90.31.15:4707 , piece_id=BFIRHKUGRF32YW73P375IVAIVYH7K4YR6KUNOWQ4DHWAQOIG2GEA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:49.865502248 (258h15m44.296582379s) [upload=268543]: Next returned nil segment
Aug 19 11:41:49.865520823 (258h15m44.296600954s) [upload=268543]: Waiting for error group managing segments...
Aug 19 11:41:50.288124564 (258h15m44.719204695s) [noise=true , address=45.91.116.13:4169 , piece_id=XHE764YPBPDLFULGZJDLRNYYL5YIYV5XFVGIHQTJ22LRDTLU3LOA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.328528754 (258h15m44.759608885s) [noise=true , address=77.90.31.17:4786 , piece_id=WOTTIVSTRCFPZMWXNSWEIYPDG6MZPE7Y7QT3AJ4HTMOSLMJ3A7ZQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.373155875 (258h15m44.804236006s) [noise=true , address=104.36.82.44:4900 , piece_id=EF4STQAVQQJ6LDDTXJMSUQKYKVNZHZ6HJ3P3WS23CTQOHLXW2DZA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.382133122 (258h15m44.813213253s) [noise=true , address=104.36.82.60:4363 , piece_id=PFTQPOCLSPJYTTL5R3EVZ72TB6NKKQ562U3GKKJRMJAUIUOQL7UQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.388799869 (258h15m44.81988s) [noise=true , address=45.91.116.11:4129 , piece_id=7NDOFXPIEQB7UYCWHPYMLWVTWWZH6TKSHQXBJ7WSW7VTRJOZWQAQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.391381658 (258h15m44.822461789s) [noise=true , address=104.36.82.4:4814 , piece_id=Y63J3PWGS6EHQ3EW5AUPOKSNQ734FTS3MFK7OB7N4KOPK2H75F6Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.411205630 (258h15m44.842285761s) [noise=true , address=45.91.116.14:4204 , piece_id=SVEXVOUI3FPDKJEFBKIPYRAW6W2TFLFLWAPNIZPMB3SA3IVQIP5Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.417309559 (258h15m44.84838969s) [noise=true , address=77.90.31.13:4650 , piece_id=S3QYZY7W2N672MESG2VPMSULMFDI3VI4DOTENTPBTDSOGYITCFXA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.421482284 (258h15m44.852562405s) [noise=true , address=104.36.82.5:4842 , piece_id=E4QD3PQKODDZFBRXNOFM37WCMHKB3HWKSFLI7Y3WJB33LL3K6XUQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.446716939 (258h15m44.87779707s) [noise=true , address=77.90.31.16:4755 , piece_id=6R3UECCD4KU5BYBNMEFQ227SB6TBTWGM5C5SKGWLNA3ZYTG2BMWQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.446823452 (258h15m44.877903583s) [noise=true , address=77.90.31.21:4891 , piece_id=HVOZDQTRBYCR4G7L3N56YH3BMJGJP432IUVLBE5NMX5J5OHATH5Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.457853177 (258h15m44.888933308s) [noise=true , address=104.36.82.12:4167 , piece_id=P3IGYTBBA3BU6NZ7RWBGHVQLJNFZ4AOWZOPITU5F7WU3KUL3BKJQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.459991478 (258h15m44.891071609s) [noise=true , address=45.91.116.10:4114 , piece_id=DAPK4Q4N76HFVALGOHMJNKJI56L4FTOU7OPR3265KKGKYB2Z72AA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.488009759 (258h15m44.91908988s) [noise=true , address=104.36.82.12:4156 , piece_id=ESKFF2IPWZOD25PEOGV6CCH2ARUN43ME5HIKIR4FMW7MVYG2EHNA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.488032192 (258h15m44.919112323s) [seg_pos={0 0}, upload=268543]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:41:50.488217617 (258h15m44.919297748s) [noise=true , address=77.90.31.18:4840 , piece_id=7J2FGEB22ZTSE34C3T65TN3CXUZFWNC6ZNVB7JYO4JWP7B2DX4DQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488274956 (258h15m44.919355087s) [noise=true , address=104.36.82.23:4454 , piece_id=BNITK4VOOZZ4TDRNNMCDVVXRAFAYHISRG2WSTO3WQZZKYO7JQD2Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488336093 (258h15m44.919416224s) [noise=true , address=77.90.31.10:4543 , piece_id=UKQ4XH7DMUKKFNP5GOK3WCWEB4RQL5CDEIVHPK6NGJKUE6QZZJLA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hFnVoQD97rytjEVNtPo8QumC37Eq1RM9MeXBP6Bap9rhK73bX): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488374828 (258h15m44.919454959s) [noise=true , address=77.90.31.15:4707 , piece_id=BFIRHKUGRF32YW73P375IVAIVYH7K4YR6KUNOWQ4DHWAQOIG2GEA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488383544 (258h15m44.919463675s) [seg_pos={0 0}, upload=268543]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:41:50.488434943 (258h15m44.919515074s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:41:50.488438590 (258h15m44.919518721s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:41:50.943637428 (258h15m45.374717549s) [upload=268543]: Done uploading segments...
Aug 19 11:41:50.943653790 (258h15m45.374733921s) [upload=268543]: Upload finished. err: <nil>
Duration: 5.875666375s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
6.650899325s
FAIL (2025-08-19 11:43:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.650923001s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X...................X..................X.............] duration:
1.926950004s
FAIL (2025-08-19 11:43:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 1.926979491s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
6.481688875s
FAIL (2025-08-19 11:43:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.481709615s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....................X..X............................X.X.X..] duration:
6.141985013s
FAIL (2025-08-19 11:43:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 04adadbb5cf25c9a7d46b5184d9e9a71020b0a9d0bb0e25c685c9b9c6a13b7e5 != before ca876f63385e960b8b5781314ef9cb029c6ffcb92cb0f88447ed41d622b45990
======LOGS======
Aug 19 11:41:47.817286622 (258h15m42.248366753s) [upload=268543]: Starting upload
Aug 19 11:41:47.817336156 (258h15m42.248416287s) [upload=268543]: Done starting upload
Aug 19 11:41:47.817413204 (258h15m42.248493335s) [upload=268543]: Uploading segments...
Aug 19 11:41:47.817529987 (258h15m42.248610108s) [upload=268543]: Got next segment. Inline: false
Aug 19 11:41:47.817570325 (258h15m42.248650456s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:41:47.817576306 (258h15m42.248656437s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:41:48.345713116 (258h15m42.776793298s) [seg_pos={0 0}, upload=268543]: Begin upload segment...
Aug 19 11:41:48.345779413 (258h15m42.776859574s) [seg_pos={0 0}, upload=268543]: Done begin upload segment.
Aug 19 11:41:48.345828948 (258h15m42.776909149s) [noise=true , address=104.36.82.5:4842 , piece_id=E4QD3PQKODDZFBRXNOFM37WCMHKB3HWKSFLI7Y3WJB33LL3K6XUQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.345845821 (258h15m42.776925962s) [noise=true , address=104.36.82.23:4454 , piece_id=BNITK4VOOZZ4TDRNNMCDVVXRAFAYHISRG2WSTO3WQZZKYO7JQD2Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.345895816 (258h15m42.776976018s) [noise=true , address=77.90.31.16:4755 , piece_id=6R3UECCD4KU5BYBNMEFQ227SB6TBTWGM5C5SKGWLNA3ZYTG2BMWQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.346676510 (258h15m42.777756671s) [noise=true , address=104.36.82.12:4156 , piece_id=ESKFF2IPWZOD25PEOGV6CCH2ARUN43ME5HIKIR4FMW7MVYG2EHNA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.346709903 (258h15m42.777790054s) [noise=true , address=104.36.82.12:4167 , piece_id=P3IGYTBBA3BU6NZ7RWBGHVQLJNFZ4AOWZOPITU5F7WU3KUL3BKJQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347333156 (258h15m42.778413307s) [noise=true , address=77.90.31.18:4840 , piece_id=7J2FGEB22ZTSE34C3T65TN3CXUZFWNC6ZNVB7JYO4JWP7B2DX4DQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347340019 (258h15m42.77842015s) [noise=true , address=77.90.31.13:4650 , piece_id=S3QYZY7W2N672MESG2VPMSULMFDI3VI4DOTENTPBTDSOGYITCFXA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347919809 (258h15m42.77899994s) [noise=true , address=77.90.31.17:4786 , piece_id=WOTTIVSTRCFPZMWXNSWEIYPDG6MZPE7Y7QT3AJ4HTMOSLMJ3A7ZQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347936831 (258h15m42.779016972s) [noise=true , address=77.90.31.10:4543 , piece_id=UKQ4XH7DMUKKFNP5GOK3WCWEB4RQL5CDEIVHPK6NGJKUE6QZZJLA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348449042 (258h15m42.779529163s) [noise=true , address=45.91.116.10:4114 , piece_id=DAPK4Q4N76HFVALGOHMJNKJI56L4FTOU7OPR3265KKGKYB2Z72AA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348466555 (258h15m42.779546686s) [noise=true , address=104.36.82.44:4900 , piece_id=EF4STQAVQQJ6LDDTXJMSUQKYKVNZHZ6HJ3P3WS23CTQOHLXW2DZA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348929030 (258h15m42.780009161s) [noise=true , address=45.91.116.11:4129 , piece_id=7NDOFXPIEQB7UYCWHPYMLWVTWWZH6TKSHQXBJ7WSW7VTRJOZWQAQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.349304228 (258h15m42.780384359s) [noise=true , address=104.36.82.4:4814 , piece_id=Y63J3PWGS6EHQ3EW5AUPOKSNQ734FTS3MFK7OB7N4KOPK2H75F6Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.349688202 (258h15m42.780768323s) [noise=true , address=45.91.116.13:4169 , piece_id=XHE764YPBPDLFULGZJDLRNYYL5YIYV5XFVGIHQTJ22LRDTLU3LOA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350084069 (258h15m42.781164201s) [noise=true , address=104.36.82.60:4363 , piece_id=PFTQPOCLSPJYTTL5R3EVZ72TB6NKKQ562U3GKKJRMJAUIUOQL7UQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350430332 (258h15m42.781510463s) [noise=true , address=77.90.31.21:4891 , piece_id=HVOZDQTRBYCR4G7L3N56YH3BMJGJP432IUVLBE5NMX5J5OHATH5Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350766535 (258h15m42.781846666s) [noise=true , address=45.91.116.14:4204 , piece_id=SVEXVOUI3FPDKJEFBKIPYRAW6W2TFLFLWAPNIZPMB3SA3IVQIP5Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.352249323 (258h15m42.783329464s) [noise=true , address=77.90.31.15:4707 , piece_id=BFIRHKUGRF32YW73P375IVAIVYH7K4YR6KUNOWQ4DHWAQOIG2GEA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:49.865502248 (258h15m44.296582379s) [upload=268543]: Next returned nil segment
Aug 19 11:41:49.865520823 (258h15m44.296600954s) [upload=268543]: Waiting for error group managing segments...
Aug 19 11:41:50.288124564 (258h15m44.719204695s) [noise=true , address=45.91.116.13:4169 , piece_id=XHE764YPBPDLFULGZJDLRNYYL5YIYV5XFVGIHQTJ22LRDTLU3LOA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.328528754 (258h15m44.759608885s) [noise=true , address=77.90.31.17:4786 , piece_id=WOTTIVSTRCFPZMWXNSWEIYPDG6MZPE7Y7QT3AJ4HTMOSLMJ3A7ZQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.373155875 (258h15m44.804236006s) [noise=true , address=104.36.82.44:4900 , piece_id=EF4STQAVQQJ6LDDTXJMSUQKYKVNZHZ6HJ3P3WS23CTQOHLXW2DZA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.382133122 (258h15m44.813213253s) [noise=true , address=104.36.82.60:4363 , piece_id=PFTQPOCLSPJYTTL5R3EVZ72TB6NKKQ562U3GKKJRMJAUIUOQL7UQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.388799869 (258h15m44.81988s) [noise=true , address=45.91.116.11:4129 , piece_id=7NDOFXPIEQB7UYCWHPYMLWVTWWZH6TKSHQXBJ7WSW7VTRJOZWQAQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.391381658 (258h15m44.822461789s) [noise=true , address=104.36.82.4:4814 , piece_id=Y63J3PWGS6EHQ3EW5AUPOKSNQ734FTS3MFK7OB7N4KOPK2H75F6Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.411205630 (258h15m44.842285761s) [noise=true , address=45.91.116.14:4204 , piece_id=SVEXVOUI3FPDKJEFBKIPYRAW6W2TFLFLWAPNIZPMB3SA3IVQIP5Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.417309559 (258h15m44.84838969s) [noise=true , address=77.90.31.13:4650 , piece_id=S3QYZY7W2N672MESG2VPMSULMFDI3VI4DOTENTPBTDSOGYITCFXA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.421482284 (258h15m44.852562405s) [noise=true , address=104.36.82.5:4842 , piece_id=E4QD3PQKODDZFBRXNOFM37WCMHKB3HWKSFLI7Y3WJB33LL3K6XUQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.446716939 (258h15m44.87779707s) [noise=true , address=77.90.31.16:4755 , piece_id=6R3UECCD4KU5BYBNMEFQ227SB6TBTWGM5C5SKGWLNA3ZYTG2BMWQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.446823452 (258h15m44.877903583s) [noise=true , address=77.90.31.21:4891 , piece_id=HVOZDQTRBYCR4G7L3N56YH3BMJGJP432IUVLBE5NMX5J5OHATH5Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.457853177 (258h15m44.888933308s) [noise=true , address=104.36.82.12:4167 , piece_id=P3IGYTBBA3BU6NZ7RWBGHVQLJNFZ4AOWZOPITU5F7WU3KUL3BKJQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.459991478 (258h15m44.891071609s) [noise=true , address=45.91.116.10:4114 , piece_id=DAPK4Q4N76HFVALGOHMJNKJI56L4FTOU7OPR3265KKGKYB2Z72AA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.488009759 (258h15m44.91908988s) [noise=true , address=104.36.82.12:4156 , piece_id=ESKFF2IPWZOD25PEOGV6CCH2ARUN43ME5HIKIR4FMW7MVYG2EHNA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.488032192 (258h15m44.919112323s) [seg_pos={0 0}, upload=268543]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:41:50.488217617 (258h15m44.919297748s) [noise=true , address=77.90.31.18:4840 , piece_id=7J2FGEB22ZTSE34C3T65TN3CXUZFWNC6ZNVB7JYO4JWP7B2DX4DQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488274956 (258h15m44.919355087s) [noise=true , address=104.36.82.23:4454 , piece_id=BNITK4VOOZZ4TDRNNMCDVVXRAFAYHISRG2WSTO3WQZZKYO7JQD2Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488336093 (258h15m44.919416224s) [noise=true , address=77.90.31.10:4543 , piece_id=UKQ4XH7DMUKKFNP5GOK3WCWEB4RQL5CDEIVHPK6NGJKUE6QZZJLA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hFnVoQD97rytjEVNtPo8QumC37Eq1RM9MeXBP6Bap9rhK73bX): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488374828 (258h15m44.919454959s) [noise=true , address=77.90.31.15:4707 , piece_id=BFIRHKUGRF32YW73P375IVAIVYH7K4YR6KUNOWQ4DHWAQOIG2GEA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488383544 (258h15m44.919463675s) [seg_pos={0 0}, upload=268543]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:41:50.488434943 (258h15m44.919515074s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:41:50.488438590 (258h15m44.919518721s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:41:50.943637428 (258h15m45.374717549s) [upload=268543]: Done uploading segments...
Aug 19 11:41:50.943653790 (258h15m45.374733921s) [upload=268543]: Upload finished. err: <nil>
Duration: 6.142011914s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X...................X..................X............] duration:
1.994170555s
FAIL (2025-08-19 11:42:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 1.99419942s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......................X..X............................X.X.X.] duration:
6.196832323s
FAIL (2025-08-19 11:42:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 04adadbb5cf25c9a7d46b5184d9e9a71020b0a9d0bb0e25c685c9b9c6a13b7e5 != before ca876f63385e960b8b5781314ef9cb029c6ffcb92cb0f88447ed41d622b45990
======LOGS======
Aug 19 11:41:47.817286622 (258h15m42.248366753s) [upload=268543]: Starting upload
Aug 19 11:41:47.817336156 (258h15m42.248416287s) [upload=268543]: Done starting upload
Aug 19 11:41:47.817413204 (258h15m42.248493335s) [upload=268543]: Uploading segments...
Aug 19 11:41:47.817529987 (258h15m42.248610108s) [upload=268543]: Got next segment. Inline: false
Aug 19 11:41:47.817570325 (258h15m42.248650456s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:41:47.817576306 (258h15m42.248656437s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:41:48.345713116 (258h15m42.776793298s) [seg_pos={0 0}, upload=268543]: Begin upload segment...
Aug 19 11:41:48.345779413 (258h15m42.776859574s) [seg_pos={0 0}, upload=268543]: Done begin upload segment.
Aug 19 11:41:48.345828948 (258h15m42.776909149s) [noise=true , address=104.36.82.5:4842 , piece_id=E4QD3PQKODDZFBRXNOFM37WCMHKB3HWKSFLI7Y3WJB33LL3K6XUQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.345845821 (258h15m42.776925962s) [noise=true , address=104.36.82.23:4454 , piece_id=BNITK4VOOZZ4TDRNNMCDVVXRAFAYHISRG2WSTO3WQZZKYO7JQD2Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.345895816 (258h15m42.776976018s) [noise=true , address=77.90.31.16:4755 , piece_id=6R3UECCD4KU5BYBNMEFQ227SB6TBTWGM5C5SKGWLNA3ZYTG2BMWQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.346676510 (258h15m42.777756671s) [noise=true , address=104.36.82.12:4156 , piece_id=ESKFF2IPWZOD25PEOGV6CCH2ARUN43ME5HIKIR4FMW7MVYG2EHNA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.346709903 (258h15m42.777790054s) [noise=true , address=104.36.82.12:4167 , piece_id=P3IGYTBBA3BU6NZ7RWBGHVQLJNFZ4AOWZOPITU5F7WU3KUL3BKJQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347333156 (258h15m42.778413307s) [noise=true , address=77.90.31.18:4840 , piece_id=7J2FGEB22ZTSE34C3T65TN3CXUZFWNC6ZNVB7JYO4JWP7B2DX4DQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347340019 (258h15m42.77842015s) [noise=true , address=77.90.31.13:4650 , piece_id=S3QYZY7W2N672MESG2VPMSULMFDI3VI4DOTENTPBTDSOGYITCFXA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347919809 (258h15m42.77899994s) [noise=true , address=77.90.31.17:4786 , piece_id=WOTTIVSTRCFPZMWXNSWEIYPDG6MZPE7Y7QT3AJ4HTMOSLMJ3A7ZQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347936831 (258h15m42.779016972s) [noise=true , address=77.90.31.10:4543 , piece_id=UKQ4XH7DMUKKFNP5GOK3WCWEB4RQL5CDEIVHPK6NGJKUE6QZZJLA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348449042 (258h15m42.779529163s) [noise=true , address=45.91.116.10:4114 , piece_id=DAPK4Q4N76HFVALGOHMJNKJI56L4FTOU7OPR3265KKGKYB2Z72AA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348466555 (258h15m42.779546686s) [noise=true , address=104.36.82.44:4900 , piece_id=EF4STQAVQQJ6LDDTXJMSUQKYKVNZHZ6HJ3P3WS23CTQOHLXW2DZA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348929030 (258h15m42.780009161s) [noise=true , address=45.91.116.11:4129 , piece_id=7NDOFXPIEQB7UYCWHPYMLWVTWWZH6TKSHQXBJ7WSW7VTRJOZWQAQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.349304228 (258h15m42.780384359s) [noise=true , address=104.36.82.4:4814 , piece_id=Y63J3PWGS6EHQ3EW5AUPOKSNQ734FTS3MFK7OB7N4KOPK2H75F6Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.349688202 (258h15m42.780768323s) [noise=true , address=45.91.116.13:4169 , piece_id=XHE764YPBPDLFULGZJDLRNYYL5YIYV5XFVGIHQTJ22LRDTLU3LOA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350084069 (258h15m42.781164201s) [noise=true , address=104.36.82.60:4363 , piece_id=PFTQPOCLSPJYTTL5R3EVZ72TB6NKKQ562U3GKKJRMJAUIUOQL7UQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350430332 (258h15m42.781510463s) [noise=true , address=77.90.31.21:4891 , piece_id=HVOZDQTRBYCR4G7L3N56YH3BMJGJP432IUVLBE5NMX5J5OHATH5Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350766535 (258h15m42.781846666s) [noise=true , address=45.91.116.14:4204 , piece_id=SVEXVOUI3FPDKJEFBKIPYRAW6W2TFLFLWAPNIZPMB3SA3IVQIP5Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.352249323 (258h15m42.783329464s) [noise=true , address=77.90.31.15:4707 , piece_id=BFIRHKUGRF32YW73P375IVAIVYH7K4YR6KUNOWQ4DHWAQOIG2GEA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:49.865502248 (258h15m44.296582379s) [upload=268543]: Next returned nil segment
Aug 19 11:41:49.865520823 (258h15m44.296600954s) [upload=268543]: Waiting for error group managing segments...
Aug 19 11:41:50.288124564 (258h15m44.719204695s) [noise=true , address=45.91.116.13:4169 , piece_id=XHE764YPBPDLFULGZJDLRNYYL5YIYV5XFVGIHQTJ22LRDTLU3LOA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.328528754 (258h15m44.759608885s) [noise=true , address=77.90.31.17:4786 , piece_id=WOTTIVSTRCFPZMWXNSWEIYPDG6MZPE7Y7QT3AJ4HTMOSLMJ3A7ZQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.373155875 (258h15m44.804236006s) [noise=true , address=104.36.82.44:4900 , piece_id=EF4STQAVQQJ6LDDTXJMSUQKYKVNZHZ6HJ3P3WS23CTQOHLXW2DZA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.382133122 (258h15m44.813213253s) [noise=true , address=104.36.82.60:4363 , piece_id=PFTQPOCLSPJYTTL5R3EVZ72TB6NKKQ562U3GKKJRMJAUIUOQL7UQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.388799869 (258h15m44.81988s) [noise=true , address=45.91.116.11:4129 , piece_id=7NDOFXPIEQB7UYCWHPYMLWVTWWZH6TKSHQXBJ7WSW7VTRJOZWQAQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.391381658 (258h15m44.822461789s) [noise=true , address=104.36.82.4:4814 , piece_id=Y63J3PWGS6EHQ3EW5AUPOKSNQ734FTS3MFK7OB7N4KOPK2H75F6Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.411205630 (258h15m44.842285761s) [noise=true , address=45.91.116.14:4204 , piece_id=SVEXVOUI3FPDKJEFBKIPYRAW6W2TFLFLWAPNIZPMB3SA3IVQIP5Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.417309559 (258h15m44.84838969s) [noise=true , address=77.90.31.13:4650 , piece_id=S3QYZY7W2N672MESG2VPMSULMFDI3VI4DOTENTPBTDSOGYITCFXA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.421482284 (258h15m44.852562405s) [noise=true , address=104.36.82.5:4842 , piece_id=E4QD3PQKODDZFBRXNOFM37WCMHKB3HWKSFLI7Y3WJB33LL3K6XUQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.446716939 (258h15m44.87779707s) [noise=true , address=77.90.31.16:4755 , piece_id=6R3UECCD4KU5BYBNMEFQ227SB6TBTWGM5C5SKGWLNA3ZYTG2BMWQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.446823452 (258h15m44.877903583s) [noise=true , address=77.90.31.21:4891 , piece_id=HVOZDQTRBYCR4G7L3N56YH3BMJGJP432IUVLBE5NMX5J5OHATH5Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.457853177 (258h15m44.888933308s) [noise=true , address=104.36.82.12:4167 , piece_id=P3IGYTBBA3BU6NZ7RWBGHVQLJNFZ4AOWZOPITU5F7WU3KUL3BKJQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.459991478 (258h15m44.891071609s) [noise=true , address=45.91.116.10:4114 , piece_id=DAPK4Q4N76HFVALGOHMJNKJI56L4FTOU7OPR3265KKGKYB2Z72AA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.488009759 (258h15m44.91908988s) [noise=true , address=104.36.82.12:4156 , piece_id=ESKFF2IPWZOD25PEOGV6CCH2ARUN43ME5HIKIR4FMW7MVYG2EHNA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.488032192 (258h15m44.919112323s) [seg_pos={0 0}, upload=268543]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:41:50.488217617 (258h15m44.919297748s) [noise=true , address=77.90.31.18:4840 , piece_id=7J2FGEB22ZTSE34C3T65TN3CXUZFWNC6ZNVB7JYO4JWP7B2DX4DQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488274956 (258h15m44.919355087s) [noise=true , address=104.36.82.23:4454 , piece_id=BNITK4VOOZZ4TDRNNMCDVVXRAFAYHISRG2WSTO3WQZZKYO7JQD2Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488336093 (258h15m44.919416224s) [noise=true , address=77.90.31.10:4543 , piece_id=UKQ4XH7DMUKKFNP5GOK3WCWEB4RQL5CDEIVHPK6NGJKUE6QZZJLA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hFnVoQD97rytjEVNtPo8QumC37Eq1RM9MeXBP6Bap9rhK73bX): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488374828 (258h15m44.919454959s) [noise=true , address=77.90.31.15:4707 , piece_id=BFIRHKUGRF32YW73P375IVAIVYH7K4YR6KUNOWQ4DHWAQOIG2GEA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488383544 (258h15m44.919463675s) [seg_pos={0 0}, upload=268543]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:41:50.488434943 (258h15m44.919515074s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:41:50.488438590 (258h15m44.919518721s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:41:50.943637428 (258h15m45.374717549s) [upload=268543]: Done uploading segments...
Aug 19 11:41:50.943653790 (258h15m45.374733921s) [upload=268543]: Upload finished. err: <nil>
Duration: 6.196848795s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.566472669s
FAIL (2025-08-19 11:42:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.566495674s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X...................X..................X...........] duration:
1.957958577s
FAIL (2025-08-19 11:41:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 1.957992892s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......................X..X............................X.X.X] duration:
6.234554028s
FAIL (2025-08-19 11:41:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 04adadbb5cf25c9a7d46b5184d9e9a71020b0a9d0bb0e25c685c9b9c6a13b7e5 != before ca876f63385e960b8b5781314ef9cb029c6ffcb92cb0f88447ed41d622b45990
======LOGS======
Aug 19 11:41:47.817286622 (258h15m42.248366753s) [upload=268543]: Starting upload
Aug 19 11:41:47.817336156 (258h15m42.248416287s) [upload=268543]: Done starting upload
Aug 19 11:41:47.817413204 (258h15m42.248493335s) [upload=268543]: Uploading segments...
Aug 19 11:41:47.817529987 (258h15m42.248610108s) [upload=268543]: Got next segment. Inline: false
Aug 19 11:41:47.817570325 (258h15m42.248650456s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:41:47.817576306 (258h15m42.248656437s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:41:48.345713116 (258h15m42.776793298s) [seg_pos={0 0}, upload=268543]: Begin upload segment...
Aug 19 11:41:48.345779413 (258h15m42.776859574s) [seg_pos={0 0}, upload=268543]: Done begin upload segment.
Aug 19 11:41:48.345828948 (258h15m42.776909149s) [noise=true , address=104.36.82.5:4842 , piece_id=E4QD3PQKODDZFBRXNOFM37WCMHKB3HWKSFLI7Y3WJB33LL3K6XUQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.345845821 (258h15m42.776925962s) [noise=true , address=104.36.82.23:4454 , piece_id=BNITK4VOOZZ4TDRNNMCDVVXRAFAYHISRG2WSTO3WQZZKYO7JQD2Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.345895816 (258h15m42.776976018s) [noise=true , address=77.90.31.16:4755 , piece_id=6R3UECCD4KU5BYBNMEFQ227SB6TBTWGM5C5SKGWLNA3ZYTG2BMWQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.346676510 (258h15m42.777756671s) [noise=true , address=104.36.82.12:4156 , piece_id=ESKFF2IPWZOD25PEOGV6CCH2ARUN43ME5HIKIR4FMW7MVYG2EHNA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.346709903 (258h15m42.777790054s) [noise=true , address=104.36.82.12:4167 , piece_id=P3IGYTBBA3BU6NZ7RWBGHVQLJNFZ4AOWZOPITU5F7WU3KUL3BKJQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347333156 (258h15m42.778413307s) [noise=true , address=77.90.31.18:4840 , piece_id=7J2FGEB22ZTSE34C3T65TN3CXUZFWNC6ZNVB7JYO4JWP7B2DX4DQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347340019 (258h15m42.77842015s) [noise=true , address=77.90.31.13:4650 , piece_id=S3QYZY7W2N672MESG2VPMSULMFDI3VI4DOTENTPBTDSOGYITCFXA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347919809 (258h15m42.77899994s) [noise=true , address=77.90.31.17:4786 , piece_id=WOTTIVSTRCFPZMWXNSWEIYPDG6MZPE7Y7QT3AJ4HTMOSLMJ3A7ZQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.347936831 (258h15m42.779016972s) [noise=true , address=77.90.31.10:4543 , piece_id=UKQ4XH7DMUKKFNP5GOK3WCWEB4RQL5CDEIVHPK6NGJKUE6QZZJLA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348449042 (258h15m42.779529163s) [noise=true , address=45.91.116.10:4114 , piece_id=DAPK4Q4N76HFVALGOHMJNKJI56L4FTOU7OPR3265KKGKYB2Z72AA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348466555 (258h15m42.779546686s) [noise=true , address=104.36.82.44:4900 , piece_id=EF4STQAVQQJ6LDDTXJMSUQKYKVNZHZ6HJ3P3WS23CTQOHLXW2DZA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.348929030 (258h15m42.780009161s) [noise=true , address=45.91.116.11:4129 , piece_id=7NDOFXPIEQB7UYCWHPYMLWVTWWZH6TKSHQXBJ7WSW7VTRJOZWQAQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.349304228 (258h15m42.780384359s) [noise=true , address=104.36.82.4:4814 , piece_id=Y63J3PWGS6EHQ3EW5AUPOKSNQ734FTS3MFK7OB7N4KOPK2H75F6Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.349688202 (258h15m42.780768323s) [noise=true , address=45.91.116.13:4169 , piece_id=XHE764YPBPDLFULGZJDLRNYYL5YIYV5XFVGIHQTJ22LRDTLU3LOA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350084069 (258h15m42.781164201s) [noise=true , address=104.36.82.60:4363 , piece_id=PFTQPOCLSPJYTTL5R3EVZ72TB6NKKQ562U3GKKJRMJAUIUOQL7UQ, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350430332 (258h15m42.781510463s) [noise=true , address=77.90.31.21:4891 , piece_id=HVOZDQTRBYCR4G7L3N56YH3BMJGJP432IUVLBE5NMX5J5OHATH5Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.350766535 (258h15m42.781846666s) [noise=true , address=45.91.116.14:4204 , piece_id=SVEXVOUI3FPDKJEFBKIPYRAW6W2TFLFLWAPNIZPMB3SA3IVQIP5Q, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:48.352249323 (258h15m42.783329464s) [noise=true , address=77.90.31.15:4707 , piece_id=BFIRHKUGRF32YW73P375IVAIVYH7K4YR6KUNOWQ4DHWAQOIG2GEA, seg_pos={0 0}, upload=268543]: Uploading piece...
Aug 19 11:41:49.865502248 (258h15m44.296582379s) [upload=268543]: Next returned nil segment
Aug 19 11:41:49.865520823 (258h15m44.296600954s) [upload=268543]: Waiting for error group managing segments...
Aug 19 11:41:50.288124564 (258h15m44.719204695s) [noise=true , address=45.91.116.13:4169 , piece_id=XHE764YPBPDLFULGZJDLRNYYL5YIYV5XFVGIHQTJ22LRDTLU3LOA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.328528754 (258h15m44.759608885s) [noise=true , address=77.90.31.17:4786 , piece_id=WOTTIVSTRCFPZMWXNSWEIYPDG6MZPE7Y7QT3AJ4HTMOSLMJ3A7ZQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.373155875 (258h15m44.804236006s) [noise=true , address=104.36.82.44:4900 , piece_id=EF4STQAVQQJ6LDDTXJMSUQKYKVNZHZ6HJ3P3WS23CTQOHLXW2DZA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.382133122 (258h15m44.813213253s) [noise=true , address=104.36.82.60:4363 , piece_id=PFTQPOCLSPJYTTL5R3EVZ72TB6NKKQ562U3GKKJRMJAUIUOQL7UQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.388799869 (258h15m44.81988s) [noise=true , address=45.91.116.11:4129 , piece_id=7NDOFXPIEQB7UYCWHPYMLWVTWWZH6TKSHQXBJ7WSW7VTRJOZWQAQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.391381658 (258h15m44.822461789s) [noise=true , address=104.36.82.4:4814 , piece_id=Y63J3PWGS6EHQ3EW5AUPOKSNQ734FTS3MFK7OB7N4KOPK2H75F6Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.411205630 (258h15m44.842285761s) [noise=true , address=45.91.116.14:4204 , piece_id=SVEXVOUI3FPDKJEFBKIPYRAW6W2TFLFLWAPNIZPMB3SA3IVQIP5Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.417309559 (258h15m44.84838969s) [noise=true , address=77.90.31.13:4650 , piece_id=S3QYZY7W2N672MESG2VPMSULMFDI3VI4DOTENTPBTDSOGYITCFXA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.421482284 (258h15m44.852562405s) [noise=true , address=104.36.82.5:4842 , piece_id=E4QD3PQKODDZFBRXNOFM37WCMHKB3HWKSFLI7Y3WJB33LL3K6XUQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.446716939 (258h15m44.87779707s) [noise=true , address=77.90.31.16:4755 , piece_id=6R3UECCD4KU5BYBNMEFQ227SB6TBTWGM5C5SKGWLNA3ZYTG2BMWQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.446823452 (258h15m44.877903583s) [noise=true , address=77.90.31.21:4891 , piece_id=HVOZDQTRBYCR4G7L3N56YH3BMJGJP432IUVLBE5NMX5J5OHATH5Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.457853177 (258h15m44.888933308s) [noise=true , address=104.36.82.12:4167 , piece_id=P3IGYTBBA3BU6NZ7RWBGHVQLJNFZ4AOWZOPITU5F7WU3KUL3BKJQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.459991478 (258h15m44.891071609s) [noise=true , address=45.91.116.10:4114 , piece_id=DAPK4Q4N76HFVALGOHMJNKJI56L4FTOU7OPR3265KKGKYB2Z72AA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.488009759 (258h15m44.91908988s) [noise=true , address=104.36.82.12:4156 , piece_id=ESKFF2IPWZOD25PEOGV6CCH2ARUN43ME5HIKIR4FMW7MVYG2EHNA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: <nil>
Aug 19 11:41:50.488032192 (258h15m44.919112323s) [seg_pos={0 0}, upload=268543]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:41:50.488217617 (258h15m44.919297748s) [noise=true , address=77.90.31.18:4840 , piece_id=7J2FGEB22ZTSE34C3T65TN3CXUZFWNC6ZNVB7JYO4JWP7B2DX4DQ, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HcxQABJsUpjxiYdAkRFTpRTrT4KfrP8RKZkUhsyea1EKmwd5V): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488274956 (258h15m44.919355087s) [noise=true , address=104.36.82.23:4454 , piece_id=BNITK4VOOZZ4TDRNNMCDVVXRAFAYHISRG2WSTO3WQZZKYO7JQD2Q, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UCkuYGdVYLoR8oc1jpCZCN2smNfVqFwC8a7q95fJb8haB3MY2): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488336093 (258h15m44.919416224s) [noise=true , address=77.90.31.10:4543 , piece_id=UKQ4XH7DMUKKFNP5GOK3WCWEB4RQL5CDEIVHPK6NGJKUE6QZZJLA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hFnVoQD97rytjEVNtPo8QumC37Eq1RM9MeXBP6Bap9rhK73bX): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488374828 (258h15m44.919454959s) [noise=true , address=77.90.31.15:4707 , piece_id=BFIRHKUGRF32YW73P375IVAIVYH7K4YR6KUNOWQ4DHWAQOIG2GEA, seg_pos={0 0}, upload=268543]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wPoPpMVDQM4YDQzYbfLTh7aneNVXFisUY6iZCHXG1Lmkj7UrL): protocol: expected piece hash; context canceled; EOF
Aug 19 11:41:50.488383544 (258h15m44.919463675s) [seg_pos={0 0}, upload=268543]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:41:50.488434943 (258h15m44.919515074s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:41:50.488438590 (258h15m44.919518721s) [upload=268543]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:41:50.943637428 (258h15m45.374717549s) [upload=268543]: Done uploading segments...
Aug 19 11:41:50.943653790 (258h15m45.374733921s) [upload=268543]: Upload finished. err: <nil>
Duration: 6.234580951s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
6.786826492s
FAIL (2025-08-19 11:41:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.78684628s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X...................X..................X..........] duration:
2.207844073s
FAIL (2025-08-19 11:40:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 2.207864753s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [........................X..X............................X.X.] duration:
6.228676063s
FAIL (2025-08-19 11:40:48 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 11:39:36.677367650 (258h13m31.108447781s) [upload=268504]: Starting upload
Aug 19 11:39:36.677410651 (258h13m31.108490782s) [upload=268504]: Done starting upload
Aug 19 11:39:36.677527585 (258h13m31.108607726s) [upload=268504]: Uploading segments...
Aug 19 11:39:36.677637976 (258h13m31.108718107s) [upload=268504]: Got next segment. Inline: false
Aug 19 11:39:36.677675909 (258h13m31.10875605s) [upload=268504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:36.677682742 (258h13m31.108762913s) [upload=268504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:37.131823023 (258h13m31.562903154s) [seg_pos={0 0}, upload=268504]: Begin upload segment...
Aug 19 11:39:37.131872056 (258h13m31.562952187s) [seg_pos={0 0}, upload=268504]: Done begin upload segment.
Aug 19 11:39:37.131895201 (258h13m31.562975332s) [noise=true , address=77.90.31.12:4600 , piece_id=SUHNWV33NVI7FOKQJMZJCOE2I52QNOCMLN6UEQVV7T77PT72AUDA, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.131960947 (258h13m31.563041078s) [noise=true , address=104.36.82.60:4358 , piece_id=MN5TUPCYCH5GEVXMFDJYMAYHXBXHLSXS2SYRR4SML4EY3VWTDVYA, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.132306297 (258h13m31.563386428s) [noise=true , address=104.36.82.44:4892 , piece_id=VINJUWCMNYX2UDVBLUOXW5D6OM4F3I3H5L2D4HON3GWEWM5RYJFA, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.132534444 (258h13m31.563614575s) [noise=true , address=104.36.82.5:4841 , piece_id=AAIBWIRVWNSWB72WCWZYSPF3QKCN764AASMJXHYRUSIQJDVA5PYQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.132574931 (258h13m31.563655062s) [noise=true , address=104.36.82.23:4450 , piece_id=4RTKPUU77QU3BI62BZYYFRDPQ5NLMCWC4GB7ZGXOATKII6JELT6Q, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.132835130 (258h13m31.563915251s) [noise=true , address=77.90.31.17:4804 , piece_id=XYDSJQOXZ2GLKIP7KA4FFKKFT3CXP5YGWYUAWWEZLOUZHRP2LVHA, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.132994173 (258h13m31.564074304s) [noise=true , address=79.127.219.38:4033 , piece_id=RWVQ2FRE2K5H7YCQYDMS4VY4FTLBENFMFKF442UWCL2VSJHWOUBA, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.133093864 (258h13m31.564173995s) [noise=true , address=77.90.31.21:4897 , piece_id=CK53FTATVVVLR2WX7CVKENJGMJTIWEZNHRT2YP2BJH53SFETQLLQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.133361928 (258h13m31.564442059s) [noise=true , address=104.36.82.35:4600 , piece_id=OD5XVWP3PC6MO2SNUNFV5MRCMG57J5EOB72YHPUUGQEX7KZXN7XQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.133509219 (258h13m31.56458938s) [noise=true , address=45.91.116.5:4310 , piece_id=5DHAR2PCMAGUK2FQSR6ERRHJMDOXKFOV3CSS5ZLYMIZFOERMR6TQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.133612577 (258h13m31.564692708s) [noise=true , address=45.91.116.9:4271 , piece_id=KGB4UQP6MQDUTXV72MWKPS56D25K35CXCSKJSNUW2VLNTCTYO27A, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.133851534 (258h13m31.564931656s) [noise=true , address=77.90.31.18:4816 , piece_id=ME4OU6QG35GDMHQQIU5IHIKAQMNPR7746VGN2IKX4JQ3QS5XAGGQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.133995219 (258h13m31.56507536s) [noise=true , address=77.90.31.19:4868 , piece_id=AL2564LLAS5OFA5NMAHHZYUWAPHJ57FLZQGW6FCCTRSJLXS6RT3Q, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.134052088 (258h13m31.565132219s) [noise=true , address=77.90.31.11:4578 , piece_id=RFA4D24F32DHJ7YSEQRFXWICKMDWKDKGM2Z6XDLHIBGOCZAXESQQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.134883569 (258h13m31.5659637s) [noise=true , address=45.91.116.13:4163 , piece_id=KD3UNXRWIPJB3GPIZ2MWO7IVS3O2FPGFD6AAECWN7PPP4N4YFQ2Q, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.135506000 (258h13m31.566586131s) [noise=true , address=79.127.219.47:4060 , piece_id=DB7RT6BK24BXXWGAES7UNDSQFMML2FWKDKOVL6D45V3L77RKEIAQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.136399830 (258h13m31.567479962s) [noise=true , address=77.90.31.15:4702 , piece_id=TEZWGNCZUFOHK5LSTIT6HQYJNOELOBZW2PXRNJ2EPCZJPEZVNJOA, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.137213216 (258h13m31.568293347s) [noise=true , address=77.90.31.16:4756 , piece_id=3DUNXPJLSXMYYUSDJHK5F4G2U3QNQN5LWY6BURIQ2E3Q4FT4D5UQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:38.641954341 (258h13m33.073034472s) [upload=268504]: Next returned nil segment
Aug 19 11:39:38.641973247 (258h13m33.073053378s) [upload=268504]: Waiting for error group managing segments...
Aug 19 11:39:39.038893042 (258h13m33.469973173s) [noise=true , address=79.127.219.47:4060 , piece_id=DB7RT6BK24BXXWGAES7UNDSQFMML2FWKDKOVL6D45V3L77RKEIAQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.047156112 (258h13m33.478236243s) [noise=true , address=79.127.219.38:4033 , piece_id=RWVQ2FRE2K5H7YCQYDMS4VY4FTLBENFMFKF442UWCL2VSJHWOUBA, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.070792339 (258h13m33.50187247s) [noise=true , address=104.36.82.44:4892 , piece_id=VINJUWCMNYX2UDVBLUOXW5D6OM4F3I3H5L2D4HON3GWEWM5RYJFA, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.137441567 (258h13m33.568521688s) [noise=true , address=104.36.82.5:4841 , piece_id=AAIBWIRVWNSWB72WCWZYSPF3QKCN764AASMJXHYRUSIQJDVA5PYQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.141042437 (258h13m33.572122568s) [noise=true , address=104.36.82.23:4450 , piece_id=4RTKPUU77QU3BI62BZYYFRDPQ5NLMCWC4GB7ZGXOATKII6JELT6Q, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.163469379 (258h13m33.59454951s) [noise=true , address=77.90.31.12:4600 , piece_id=SUHNWV33NVI7FOKQJMZJCOE2I52QNOCMLN6UEQVV7T77PT72AUDA, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.180679048 (258h13m33.611759179s) [noise=true , address=77.90.31.11:4578 , piece_id=RFA4D24F32DHJ7YSEQRFXWICKMDWKDKGM2Z6XDLHIBGOCZAXESQQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.190314815 (258h13m33.621394966s) [noise=true , address=77.90.31.15:4702 , piece_id=TEZWGNCZUFOHK5LSTIT6HQYJNOELOBZW2PXRNJ2EPCZJPEZVNJOA, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.197638699 (258h13m33.62871883s) [noise=true , address=104.36.82.35:4600 , piece_id=OD5XVWP3PC6MO2SNUNFV5MRCMG57J5EOB72YHPUUGQEX7KZXN7XQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.260878805 (258h13m33.691958936s) [noise=true , address=45.91.116.5:4310 , piece_id=5DHAR2PCMAGUK2FQSR6ERRHJMDOXKFOV3CSS5ZLYMIZFOERMR6TQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.263993965 (258h13m33.695074096s) [noise=true , address=45.91.116.13:4163 , piece_id=KD3UNXRWIPJB3GPIZ2MWO7IVS3O2FPGFD6AAECWN7PPP4N4YFQ2Q, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.277296007 (258h13m33.708376138s) [noise=true , address=77.90.31.17:4804 , piece_id=XYDSJQOXZ2GLKIP7KA4FFKKFT3CXP5YGWYUAWWEZLOUZHRP2LVHA, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.282732370 (258h13m33.713812561s) [noise=true , address=77.90.31.18:4816 , piece_id=ME4OU6QG35GDMHQQIU5IHIKAQMNPR7746VGN2IKX4JQ3QS5XAGGQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.325843911 (258h13m33.756924042s) [noise=true , address=104.36.82.60:4358 , piece_id=MN5TUPCYCH5GEVXMFDJYMAYHXBXHLSXS2SYRR4SML4EY3VWTDVYA, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.325871193 (258h13m33.756951324s) [seg_pos={0 0}, upload=268504]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.325985452 (258h13m33.757065583s) [noise=true , address=45.91.116.9:4271 , piece_id=KGB4UQP6MQDUTXV72MWKPS56D25K35CXCSKJSNUW2VLNTCTYO27A, seg_pos={0 0}, upload=268504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KNFPrpe7hiwp59iE8P3x2ciFAPAMh9ghZR9oziWSi7UMLkPnb): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.326044104 (258h13m33.757124235s) [noise=true , address=77.90.31.16:4756 , piece_id=3DUNXPJLSXMYYUSDJHK5F4G2U3QNQN5LWY6BURIQ2E3Q4FT4D5UQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UaCjYcwJTUUrVNVJmJL4m2Gpcw9gcyGLDHySu1e3hmSkXYbtX): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.326088047 (258h13m33.757168178s) [noise=true , address=77.90.31.21:4897 , piece_id=CK53FTATVVVLR2WX7CVKENJGMJTIWEZNHRT2YP2BJH53SFETQLLQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.326135458 (258h13m33.757215589s) [noise=true , address=77.90.31.19:4868 , piece_id=AL2564LLAS5OFA5NMAHHZYUWAPHJ57FLZQGW6FCCTRSJLXS6RT3Q, seg_pos={0 0}, upload=268504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17DGGjPv2UkSCAH8ihb4U7CX2K5mYmPjumSSKc26sbcscrjQX1): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.326181597 (258h13m33.757261728s) [seg_pos={0 0}, upload=268504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.326254737 (258h13m33.757334868s) [upload=268504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.326258915 (258h13m33.757339046s) [upload=268504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.636748712 (258h13m34.067828843s) [upload=268504]: Done uploading segments...
Aug 19 11:39:39.636767047 (258h13m34.067847178s) [upload=268504]: Upload finished. err: <nil>
Duration: 6.228703435s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
7.421822086s
FAIL (2025-08-19 11:40:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.421857894s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
6.611329992s
FAIL (2025-08-19 11:40:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.611352915s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.........................X..X............................X.X] duration:
4.07304329s
FAIL (2025-08-19 11:39:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 19 11:39:36.677367650 (258h13m31.108447781s) [upload=268504]: Starting upload
Aug 19 11:39:36.677410651 (258h13m31.108490782s) [upload=268504]: Done starting upload
Aug 19 11:39:36.677527585 (258h13m31.108607726s) [upload=268504]: Uploading segments...
Aug 19 11:39:36.677637976 (258h13m31.108718107s) [upload=268504]: Got next segment. Inline: false
Aug 19 11:39:36.677675909 (258h13m31.10875605s) [upload=268504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:39:36.677682742 (258h13m31.108762913s) [upload=268504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:39:37.131823023 (258h13m31.562903154s) [seg_pos={0 0}, upload=268504]: Begin upload segment...
Aug 19 11:39:37.131872056 (258h13m31.562952187s) [seg_pos={0 0}, upload=268504]: Done begin upload segment.
Aug 19 11:39:37.131895201 (258h13m31.562975332s) [noise=true , address=77.90.31.12:4600 , piece_id=SUHNWV33NVI7FOKQJMZJCOE2I52QNOCMLN6UEQVV7T77PT72AUDA, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.131960947 (258h13m31.563041078s) [noise=true , address=104.36.82.60:4358 , piece_id=MN5TUPCYCH5GEVXMFDJYMAYHXBXHLSXS2SYRR4SML4EY3VWTDVYA, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.132306297 (258h13m31.563386428s) [noise=true , address=104.36.82.44:4892 , piece_id=VINJUWCMNYX2UDVBLUOXW5D6OM4F3I3H5L2D4HON3GWEWM5RYJFA, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.132534444 (258h13m31.563614575s) [noise=true , address=104.36.82.5:4841 , piece_id=AAIBWIRVWNSWB72WCWZYSPF3QKCN764AASMJXHYRUSIQJDVA5PYQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.132574931 (258h13m31.563655062s) [noise=true , address=104.36.82.23:4450 , piece_id=4RTKPUU77QU3BI62BZYYFRDPQ5NLMCWC4GB7ZGXOATKII6JELT6Q, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.132835130 (258h13m31.563915251s) [noise=true , address=77.90.31.17:4804 , piece_id=XYDSJQOXZ2GLKIP7KA4FFKKFT3CXP5YGWYUAWWEZLOUZHRP2LVHA, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.132994173 (258h13m31.564074304s) [noise=true , address=79.127.219.38:4033 , piece_id=RWVQ2FRE2K5H7YCQYDMS4VY4FTLBENFMFKF442UWCL2VSJHWOUBA, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.133093864 (258h13m31.564173995s) [noise=true , address=77.90.31.21:4897 , piece_id=CK53FTATVVVLR2WX7CVKENJGMJTIWEZNHRT2YP2BJH53SFETQLLQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.133361928 (258h13m31.564442059s) [noise=true , address=104.36.82.35:4600 , piece_id=OD5XVWP3PC6MO2SNUNFV5MRCMG57J5EOB72YHPUUGQEX7KZXN7XQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.133509219 (258h13m31.56458938s) [noise=true , address=45.91.116.5:4310 , piece_id=5DHAR2PCMAGUK2FQSR6ERRHJMDOXKFOV3CSS5ZLYMIZFOERMR6TQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.133612577 (258h13m31.564692708s) [noise=true , address=45.91.116.9:4271 , piece_id=KGB4UQP6MQDUTXV72MWKPS56D25K35CXCSKJSNUW2VLNTCTYO27A, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.133851534 (258h13m31.564931656s) [noise=true , address=77.90.31.18:4816 , piece_id=ME4OU6QG35GDMHQQIU5IHIKAQMNPR7746VGN2IKX4JQ3QS5XAGGQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.133995219 (258h13m31.56507536s) [noise=true , address=77.90.31.19:4868 , piece_id=AL2564LLAS5OFA5NMAHHZYUWAPHJ57FLZQGW6FCCTRSJLXS6RT3Q, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.134052088 (258h13m31.565132219s) [noise=true , address=77.90.31.11:4578 , piece_id=RFA4D24F32DHJ7YSEQRFXWICKMDWKDKGM2Z6XDLHIBGOCZAXESQQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.134883569 (258h13m31.5659637s) [noise=true , address=45.91.116.13:4163 , piece_id=KD3UNXRWIPJB3GPIZ2MWO7IVS3O2FPGFD6AAECWN7PPP4N4YFQ2Q, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.135506000 (258h13m31.566586131s) [noise=true , address=79.127.219.47:4060 , piece_id=DB7RT6BK24BXXWGAES7UNDSQFMML2FWKDKOVL6D45V3L77RKEIAQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.136399830 (258h13m31.567479962s) [noise=true , address=77.90.31.15:4702 , piece_id=TEZWGNCZUFOHK5LSTIT6HQYJNOELOBZW2PXRNJ2EPCZJPEZVNJOA, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:37.137213216 (258h13m31.568293347s) [noise=true , address=77.90.31.16:4756 , piece_id=3DUNXPJLSXMYYUSDJHK5F4G2U3QNQN5LWY6BURIQ2E3Q4FT4D5UQ, seg_pos={0 0}, upload=268504]: Uploading piece...
Aug 19 11:39:38.641954341 (258h13m33.073034472s) [upload=268504]: Next returned nil segment
Aug 19 11:39:38.641973247 (258h13m33.073053378s) [upload=268504]: Waiting for error group managing segments...
Aug 19 11:39:39.038893042 (258h13m33.469973173s) [noise=true , address=79.127.219.47:4060 , piece_id=DB7RT6BK24BXXWGAES7UNDSQFMML2FWKDKOVL6D45V3L77RKEIAQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.047156112 (258h13m33.478236243s) [noise=true , address=79.127.219.38:4033 , piece_id=RWVQ2FRE2K5H7YCQYDMS4VY4FTLBENFMFKF442UWCL2VSJHWOUBA, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.070792339 (258h13m33.50187247s) [noise=true , address=104.36.82.44:4892 , piece_id=VINJUWCMNYX2UDVBLUOXW5D6OM4F3I3H5L2D4HON3GWEWM5RYJFA, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.137441567 (258h13m33.568521688s) [noise=true , address=104.36.82.5:4841 , piece_id=AAIBWIRVWNSWB72WCWZYSPF3QKCN764AASMJXHYRUSIQJDVA5PYQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.141042437 (258h13m33.572122568s) [noise=true , address=104.36.82.23:4450 , piece_id=4RTKPUU77QU3BI62BZYYFRDPQ5NLMCWC4GB7ZGXOATKII6JELT6Q, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.163469379 (258h13m33.59454951s) [noise=true , address=77.90.31.12:4600 , piece_id=SUHNWV33NVI7FOKQJMZJCOE2I52QNOCMLN6UEQVV7T77PT72AUDA, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.180679048 (258h13m33.611759179s) [noise=true , address=77.90.31.11:4578 , piece_id=RFA4D24F32DHJ7YSEQRFXWICKMDWKDKGM2Z6XDLHIBGOCZAXESQQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.190314815 (258h13m33.621394966s) [noise=true , address=77.90.31.15:4702 , piece_id=TEZWGNCZUFOHK5LSTIT6HQYJNOELOBZW2PXRNJ2EPCZJPEZVNJOA, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.197638699 (258h13m33.62871883s) [noise=true , address=104.36.82.35:4600 , piece_id=OD5XVWP3PC6MO2SNUNFV5MRCMG57J5EOB72YHPUUGQEX7KZXN7XQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.260878805 (258h13m33.691958936s) [noise=true , address=45.91.116.5:4310 , piece_id=5DHAR2PCMAGUK2FQSR6ERRHJMDOXKFOV3CSS5ZLYMIZFOERMR6TQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.263993965 (258h13m33.695074096s) [noise=true , address=45.91.116.13:4163 , piece_id=KD3UNXRWIPJB3GPIZ2MWO7IVS3O2FPGFD6AAECWN7PPP4N4YFQ2Q, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.277296007 (258h13m33.708376138s) [noise=true , address=77.90.31.17:4804 , piece_id=XYDSJQOXZ2GLKIP7KA4FFKKFT3CXP5YGWYUAWWEZLOUZHRP2LVHA, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.282732370 (258h13m33.713812561s) [noise=true , address=77.90.31.18:4816 , piece_id=ME4OU6QG35GDMHQQIU5IHIKAQMNPR7746VGN2IKX4JQ3QS5XAGGQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.325843911 (258h13m33.756924042s) [noise=true , address=104.36.82.60:4358 , piece_id=MN5TUPCYCH5GEVXMFDJYMAYHXBXHLSXS2SYRR4SML4EY3VWTDVYA, seg_pos={0 0}, upload=268504]: Done uploading piece. err: <nil>
Aug 19 11:39:39.325871193 (258h13m33.756951324s) [seg_pos={0 0}, upload=268504]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:39:39.325985452 (258h13m33.757065583s) [noise=true , address=45.91.116.9:4271 , piece_id=KGB4UQP6MQDUTXV72MWKPS56D25K35CXCSKJSNUW2VLNTCTYO27A, seg_pos={0 0}, upload=268504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KNFPrpe7hiwp59iE8P3x2ciFAPAMh9ghZR9oziWSi7UMLkPnb): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.326044104 (258h13m33.757124235s) [noise=true , address=77.90.31.16:4756 , piece_id=3DUNXPJLSXMYYUSDJHK5F4G2U3QNQN5LWY6BURIQ2E3Q4FT4D5UQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UaCjYcwJTUUrVNVJmJL4m2Gpcw9gcyGLDHySu1e3hmSkXYbtX): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.326088047 (258h13m33.757168178s) [noise=true , address=77.90.31.21:4897 , piece_id=CK53FTATVVVLR2WX7CVKENJGMJTIWEZNHRT2YP2BJH53SFETQLLQ, seg_pos={0 0}, upload=268504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12tc8y4NueDCMnENN3Arf4ecmGAhobx4HGuCLpidZmiDFzbGu6x): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.326135458 (258h13m33.757215589s) [noise=true , address=77.90.31.19:4868 , piece_id=AL2564LLAS5OFA5NMAHHZYUWAPHJ57FLZQGW6FCCTRSJLXS6RT3Q, seg_pos={0 0}, upload=268504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17DGGjPv2UkSCAH8ihb4U7CX2K5mYmPjumSSKc26sbcscrjQX1): protocol: expected piece hash; context canceled; EOF
Aug 19 11:39:39.326181597 (258h13m33.757261728s) [seg_pos={0 0}, upload=268504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:39:39.326254737 (258h13m33.757334868s) [upload=268504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:39:39.326258915 (258h13m33.757339046s) [upload=268504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:39:39.636748712 (258h13m34.067828843s) [upload=268504]: Done uploading segments...
Aug 19 11:39:39.636767047 (258h13m34.067847178s) [upload=268504]: Upload finished. err: <nil>
Duration: 4.073062006s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
6.506280963s
FAIL (2025-08-19 11:39:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.50630581s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X...................X..................X.........] duration:
1.900206819s
FAIL (2025-08-19 11:39:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 1.900241365s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X...................X..................X........] duration:
1.872107271s
FAIL (2025-08-19 11:39:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 1.872137479s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
6.828190248s
FAIL (2025-08-19 11:38:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.82820723s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X..X............................X.] duration:
6.157861786s
FAIL (2025-08-19 11:38:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:37:24.548357018 (258h11m18.979437149s) [upload=268469]: Starting upload
Aug 19 11:37:24.548410629 (258h11m18.97949076s) [upload=268469]: Done starting upload
Aug 19 11:37:24.548480223 (258h11m18.979560354s) [upload=268469]: Uploading segments...
Aug 19 11:37:24.548592057 (258h11m18.979672178s) [upload=268469]: Got next segment. Inline: false
Aug 19 11:37:24.548618838 (258h11m18.979698959s) [upload=268469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:37:24.548623737 (258h11m18.979703868s) [upload=268469]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:37:25.036691908 (258h11m19.467772069s) [seg_pos={0 0}, upload=268469]: Begin upload segment...
Aug 19 11:37:25.036735081 (258h11m19.467815212s) [seg_pos={0 0}, upload=268469]: Done begin upload segment.
Aug 19 11:37:25.036754999 (258h11m19.46783513s) [noise=true , address=104.36.82.11:4116 , piece_id=2LH5CTBU7UWVAD7GGVYWAKE6A44XFGN235JCEU3OMRGNAFR6OWHQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.037115679 (258h11m19.46819581s) [noise=true , address=77.90.31.17:4784 , piece_id=XPUCFKST4JL326ML4E2ADWRLXFIGHPG3XJAQB2SZAKXHRN35O2NA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.037422656 (258h11m19.468502787s) [noise=true , address=104.36.82.5:4856 , piece_id=UBQIAKBOA7JI4I5H7LF7KVVB2VIELNJ53X4THXKHG5PSX7HSIMNQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.037676562 (258h11m19.468756683s) [noise=true , address=45.91.116.9:4268 , piece_id=LPTYPCMWVHO5THBBHJZLABN7GLOALA355SC2KGELIBZALHTA25UQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.037881294 (258h11m19.468961485s) [noise=true , address=77.90.31.12:4605 , piece_id=5UVSLXTMOM5LXZOGJUKH4RJ7VG2YUWWIXK5CPYW26ACHFBX74DSQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.038251311 (258h11m19.469331443s) [noise=true , address=104.36.82.60:4368 , piece_id=VMT2BMGLVDDS6YG7L4HMKLDLKGI6JRSDN2QCL3KCTJFNI77UZPUA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.038560754 (258h11m19.469640885s) [noise=true , address=79.127.201.215:4344 , piece_id=HY3MLUFR7EAQRG7AYKSNG45W62RCLCEVFKEKGHYA6GGDUGCNQ65Q, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.038862502 (258h11m19.469942623s) [noise=true , address=77.90.31.18:4833 , piece_id=OGW2RO75MYOF6JTQVIJCLNQHAZDI3QNRIUCYM7METL5M5TO5UMDA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.039147907 (258h11m19.470228038s) [noise=true , address=66.23.193.175:4554 , piece_id=UKC3EYVJP5P4UZLAUO5SCOCATA7BKCN3MLQ7NMS5E4K3GE6G4DNQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.039487507 (258h11m19.470567638s) [noise=true , address=104.36.82.7:4928 , piece_id=2JK5KS72AUOZBFUZLCDINJATPEQQN5TKBXR4M5RYGRSTTJQESITA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.039701747 (258h11m19.470781878s) [noise=true , address=77.90.31.21:4883 , piece_id=MLXZUSERQPSF5FVPZ6FV7AKZPVYUZ5IBTSWAZZMTR3XWPRSDMIUQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.039931257 (258h11m19.471011388s) [noise=true , address=104.36.82.6:4897 , piece_id=YZ7SBLGN3I5K2PRVWKRNBZAVBMKWNIOB63TR2OPNRTVZHBR2UNLQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.040164943 (258h11m19.471245074s) [noise=true , address=77.90.31.10:4528 , piece_id=ZK5JMV4MZSYPBZXMNYNAAZDYS23O7RDTUCTQZZP6PCFRHESWYMTA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.040430452 (258h11m19.471510573s) [noise=true , address=45.91.116.6:4983 , piece_id=OJGMQX3436EH2DADB26YPYKBF42F3DQRUFGX7EA2WJG5PK5GLJUA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.041860558 (258h11m19.472940689s) [noise=true , address=77.90.31.13:4660 , piece_id=USME2SUW2QYOVP7A6WLX6I6G6TQHPAZYH7FH5MBB6MGYOFDMUEBA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.042135554 (258h11m19.473215685s) [noise=true , address=104.36.82.23:4453 , piece_id=S6HMM4ZUVPVKDUCYRPWOUKBFGBFHNJPK4WYTFS6T2EOQWWXXEDFQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.042413466 (258h11m19.473493597s) [noise=true , address=45.91.116.13:4185 , piece_id=MYTP4MCCA7G77GHYL42KMH5F44IJ52E4V26OS55DSXORI2D4GMCQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.042647303 (258h11m19.473727434s) [noise=true , address=77.90.31.19:4852 , piece_id=HRO3JRHUL7KIVGLWOLX4AN33ICZWJURGA5EDCOCHVPW6GZPBFG6Q, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:26.178730509 (258h11m20.60981064s) [upload=268469]: Next returned nil segment
Aug 19 11:37:26.178747832 (258h11m20.609827963s) [upload=268469]: Waiting for error group managing segments...
Aug 19 11:37:26.468315648 (258h11m20.899395789s) [noise=true , address=66.23.193.175:4554 , piece_id=UKC3EYVJP5P4UZLAUO5SCOCATA7BKCN3MLQ7NMS5E4K3GE6G4DNQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:26.936830855 (258h11m21.367910986s) [noise=true , address=45.91.116.13:4185 , piece_id=MYTP4MCCA7G77GHYL42KMH5F44IJ52E4V26OS55DSXORI2D4GMCQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:26.942098154 (258h11m21.373178285s) [noise=true , address=77.90.31.12:4605 , piece_id=5UVSLXTMOM5LXZOGJUKH4RJ7VG2YUWWIXK5CPYW26ACHFBX74DSQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:26.960437925 (258h11m21.391518046s) [noise=true , address=45.91.116.6:4983 , piece_id=OJGMQX3436EH2DADB26YPYKBF42F3DQRUFGX7EA2WJG5PK5GLJUA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:26.965272756 (258h11m21.396352877s) [noise=true , address=104.36.82.6:4897 , piece_id=YZ7SBLGN3I5K2PRVWKRNBZAVBMKWNIOB63TR2OPNRTVZHBR2UNLQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:26.967888411 (258h11m21.398968542s) [noise=true , address=45.91.116.9:4268 , piece_id=LPTYPCMWVHO5THBBHJZLABN7GLOALA355SC2KGELIBZALHTA25UQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:26.969818665 (258h11m21.400898796s) [noise=true , address=104.36.82.7:4928 , piece_id=2JK5KS72AUOZBFUZLCDINJATPEQQN5TKBXR4M5RYGRSTTJQESITA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.001132802 (258h11m21.432212943s) [noise=true , address=79.127.201.215:4344 , piece_id=HY3MLUFR7EAQRG7AYKSNG45W62RCLCEVFKEKGHYA6GGDUGCNQ65Q, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.006611505 (258h11m21.437691626s) [noise=true , address=77.90.31.17:4784 , piece_id=XPUCFKST4JL326ML4E2ADWRLXFIGHPG3XJAQB2SZAKXHRN35O2NA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.009911669 (258h11m21.44099181s) [noise=true , address=104.36.82.60:4368 , piece_id=VMT2BMGLVDDS6YG7L4HMKLDLKGI6JRSDN2QCL3KCTJFNI77UZPUA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.014527842 (258h11m21.445607963s) [noise=true , address=77.90.31.10:4528 , piece_id=ZK5JMV4MZSYPBZXMNYNAAZDYS23O7RDTUCTQZZP6PCFRHESWYMTA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.032922559 (258h11m21.46400269s) [noise=true , address=104.36.82.11:4116 , piece_id=2LH5CTBU7UWVAD7GGVYWAKE6A44XFGN235JCEU3OMRGNAFR6OWHQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.156141561 (258h11m21.587221692s) [noise=true , address=77.90.31.18:4833 , piece_id=OGW2RO75MYOF6JTQVIJCLNQHAZDI3QNRIUCYM7METL5M5TO5UMDA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.236422982 (258h11m21.667503113s) [noise=true , address=104.36.82.5:4856 , piece_id=UBQIAKBOA7JI4I5H7LF7KVVB2VIELNJ53X4THXKHG5PSX7HSIMNQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.236451497 (258h11m21.667531628s) [seg_pos={0 0}, upload=268469]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:37:27.236583469 (258h11m21.6676636s) [noise=true , address=104.36.82.23:4453 , piece_id=S6HMM4ZUVPVKDUCYRPWOUKBFGBFHNJPK4WYTFS6T2EOQWWXXEDFQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ktniPbRibXzsTSNW9MbWWxymt9gZKU8sDgTjixc6nYzT9c5tJ): protocol: expected piece hash; context canceled; EOF
Aug 19 11:37:27.236685024 (258h11m21.667765155s) [noise=true , address=77.90.31.13:4660 , piece_id=USME2SUW2QYOVP7A6WLX6I6G6TQHPAZYH7FH5MBB6MGYOFDMUEBA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:37:27.236773303 (258h11m21.667853434s) [noise=true , address=77.90.31.21:4883 , piece_id=MLXZUSERQPSF5FVPZ6FV7AKZPVYUZ5IBTSWAZZMTR3XWPRSDMIUQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:191MKpEnoarS7sK4Gs63ZM8zGc5jevFX8VeqViP82duW33nJJz): protocol: expected piece hash; context canceled; EOF
Aug 19 11:37:27.236807107 (258h11m21.667887238s) [noise=true , address=77.90.31.19:4852 , piece_id=HRO3JRHUL7KIVGLWOLX4AN33ICZWJURGA5EDCOCHVPW6GZPBFG6Q, seg_pos={0 0}, upload=268469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UVCFqkZwuXQ28GdfQahRcC5jwfWhoanWdTs7Z1jdHkxVVDARi): protocol: write tcp 188.166.225.170:39320->77.90.31.19:4852: use of closed network connection; write tcp 188.166.225.170:39320->77.90.31.19:4852: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39320->77.90.31.19:4852: use of closed network connection
Aug 19 11:37:27.236819642 (258h11m21.667899773s) [seg_pos={0 0}, upload=268469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:37:27.236906117 (258h11m21.667986248s) [upload=268469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:37:27.236910565 (258h11m21.667990696s) [upload=268469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:37:27.678936297 (258h11m22.110016428s) [upload=268469]: Done uploading segments...
Aug 19 11:37:27.678950645 (258h11m22.110030766s) [upload=268469]: Upload finished. err: <nil>
Duration: 6.157883187s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X...................X..................X.......] duration:
2.10395307s
FAIL (2025-08-19 11:38:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 2.103977968s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
6.760063293s
FAIL (2025-08-19 11:37:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.760089222s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X..X............................X] duration:
4.595169487s
FAIL (2025-08-19 11:37:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: invalid range 0:4194304 (size:4194304)
======LOGS======
Aug 19 11:37:24.548357018 (258h11m18.979437149s) [upload=268469]: Starting upload
Aug 19 11:37:24.548410629 (258h11m18.97949076s) [upload=268469]: Done starting upload
Aug 19 11:37:24.548480223 (258h11m18.979560354s) [upload=268469]: Uploading segments...
Aug 19 11:37:24.548592057 (258h11m18.979672178s) [upload=268469]: Got next segment. Inline: false
Aug 19 11:37:24.548618838 (258h11m18.979698959s) [upload=268469]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 11:37:24.548623737 (258h11m18.979703868s) [upload=268469]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 11:37:25.036691908 (258h11m19.467772069s) [seg_pos={0 0}, upload=268469]: Begin upload segment...
Aug 19 11:37:25.036735081 (258h11m19.467815212s) [seg_pos={0 0}, upload=268469]: Done begin upload segment.
Aug 19 11:37:25.036754999 (258h11m19.46783513s) [noise=true , address=104.36.82.11:4116 , piece_id=2LH5CTBU7UWVAD7GGVYWAKE6A44XFGN235JCEU3OMRGNAFR6OWHQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.037115679 (258h11m19.46819581s) [noise=true , address=77.90.31.17:4784 , piece_id=XPUCFKST4JL326ML4E2ADWRLXFIGHPG3XJAQB2SZAKXHRN35O2NA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.037422656 (258h11m19.468502787s) [noise=true , address=104.36.82.5:4856 , piece_id=UBQIAKBOA7JI4I5H7LF7KVVB2VIELNJ53X4THXKHG5PSX7HSIMNQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.037676562 (258h11m19.468756683s) [noise=true , address=45.91.116.9:4268 , piece_id=LPTYPCMWVHO5THBBHJZLABN7GLOALA355SC2KGELIBZALHTA25UQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.037881294 (258h11m19.468961485s) [noise=true , address=77.90.31.12:4605 , piece_id=5UVSLXTMOM5LXZOGJUKH4RJ7VG2YUWWIXK5CPYW26ACHFBX74DSQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.038251311 (258h11m19.469331443s) [noise=true , address=104.36.82.60:4368 , piece_id=VMT2BMGLVDDS6YG7L4HMKLDLKGI6JRSDN2QCL3KCTJFNI77UZPUA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.038560754 (258h11m19.469640885s) [noise=true , address=79.127.201.215:4344 , piece_id=HY3MLUFR7EAQRG7AYKSNG45W62RCLCEVFKEKGHYA6GGDUGCNQ65Q, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.038862502 (258h11m19.469942623s) [noise=true , address=77.90.31.18:4833 , piece_id=OGW2RO75MYOF6JTQVIJCLNQHAZDI3QNRIUCYM7METL5M5TO5UMDA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.039147907 (258h11m19.470228038s) [noise=true , address=66.23.193.175:4554 , piece_id=UKC3EYVJP5P4UZLAUO5SCOCATA7BKCN3MLQ7NMS5E4K3GE6G4DNQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.039487507 (258h11m19.470567638s) [noise=true , address=104.36.82.7:4928 , piece_id=2JK5KS72AUOZBFUZLCDINJATPEQQN5TKBXR4M5RYGRSTTJQESITA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.039701747 (258h11m19.470781878s) [noise=true , address=77.90.31.21:4883 , piece_id=MLXZUSERQPSF5FVPZ6FV7AKZPVYUZ5IBTSWAZZMTR3XWPRSDMIUQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.039931257 (258h11m19.471011388s) [noise=true , address=104.36.82.6:4897 , piece_id=YZ7SBLGN3I5K2PRVWKRNBZAVBMKWNIOB63TR2OPNRTVZHBR2UNLQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.040164943 (258h11m19.471245074s) [noise=true , address=77.90.31.10:4528 , piece_id=ZK5JMV4MZSYPBZXMNYNAAZDYS23O7RDTUCTQZZP6PCFRHESWYMTA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.040430452 (258h11m19.471510573s) [noise=true , address=45.91.116.6:4983 , piece_id=OJGMQX3436EH2DADB26YPYKBF42F3DQRUFGX7EA2WJG5PK5GLJUA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.041860558 (258h11m19.472940689s) [noise=true , address=77.90.31.13:4660 , piece_id=USME2SUW2QYOVP7A6WLX6I6G6TQHPAZYH7FH5MBB6MGYOFDMUEBA, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.042135554 (258h11m19.473215685s) [noise=true , address=104.36.82.23:4453 , piece_id=S6HMM4ZUVPVKDUCYRPWOUKBFGBFHNJPK4WYTFS6T2EOQWWXXEDFQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.042413466 (258h11m19.473493597s) [noise=true , address=45.91.116.13:4185 , piece_id=MYTP4MCCA7G77GHYL42KMH5F44IJ52E4V26OS55DSXORI2D4GMCQ, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:25.042647303 (258h11m19.473727434s) [noise=true , address=77.90.31.19:4852 , piece_id=HRO3JRHUL7KIVGLWOLX4AN33ICZWJURGA5EDCOCHVPW6GZPBFG6Q, seg_pos={0 0}, upload=268469]: Uploading piece...
Aug 19 11:37:26.178730509 (258h11m20.60981064s) [upload=268469]: Next returned nil segment
Aug 19 11:37:26.178747832 (258h11m20.609827963s) [upload=268469]: Waiting for error group managing segments...
Aug 19 11:37:26.468315648 (258h11m20.899395789s) [noise=true , address=66.23.193.175:4554 , piece_id=UKC3EYVJP5P4UZLAUO5SCOCATA7BKCN3MLQ7NMS5E4K3GE6G4DNQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:26.936830855 (258h11m21.367910986s) [noise=true , address=45.91.116.13:4185 , piece_id=MYTP4MCCA7G77GHYL42KMH5F44IJ52E4V26OS55DSXORI2D4GMCQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:26.942098154 (258h11m21.373178285s) [noise=true , address=77.90.31.12:4605 , piece_id=5UVSLXTMOM5LXZOGJUKH4RJ7VG2YUWWIXK5CPYW26ACHFBX74DSQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:26.960437925 (258h11m21.391518046s) [noise=true , address=45.91.116.6:4983 , piece_id=OJGMQX3436EH2DADB26YPYKBF42F3DQRUFGX7EA2WJG5PK5GLJUA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:26.965272756 (258h11m21.396352877s) [noise=true , address=104.36.82.6:4897 , piece_id=YZ7SBLGN3I5K2PRVWKRNBZAVBMKWNIOB63TR2OPNRTVZHBR2UNLQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:26.967888411 (258h11m21.398968542s) [noise=true , address=45.91.116.9:4268 , piece_id=LPTYPCMWVHO5THBBHJZLABN7GLOALA355SC2KGELIBZALHTA25UQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:26.969818665 (258h11m21.400898796s) [noise=true , address=104.36.82.7:4928 , piece_id=2JK5KS72AUOZBFUZLCDINJATPEQQN5TKBXR4M5RYGRSTTJQESITA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.001132802 (258h11m21.432212943s) [noise=true , address=79.127.201.215:4344 , piece_id=HY3MLUFR7EAQRG7AYKSNG45W62RCLCEVFKEKGHYA6GGDUGCNQ65Q, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.006611505 (258h11m21.437691626s) [noise=true , address=77.90.31.17:4784 , piece_id=XPUCFKST4JL326ML4E2ADWRLXFIGHPG3XJAQB2SZAKXHRN35O2NA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.009911669 (258h11m21.44099181s) [noise=true , address=104.36.82.60:4368 , piece_id=VMT2BMGLVDDS6YG7L4HMKLDLKGI6JRSDN2QCL3KCTJFNI77UZPUA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.014527842 (258h11m21.445607963s) [noise=true , address=77.90.31.10:4528 , piece_id=ZK5JMV4MZSYPBZXMNYNAAZDYS23O7RDTUCTQZZP6PCFRHESWYMTA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.032922559 (258h11m21.46400269s) [noise=true , address=104.36.82.11:4116 , piece_id=2LH5CTBU7UWVAD7GGVYWAKE6A44XFGN235JCEU3OMRGNAFR6OWHQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.156141561 (258h11m21.587221692s) [noise=true , address=77.90.31.18:4833 , piece_id=OGW2RO75MYOF6JTQVIJCLNQHAZDI3QNRIUCYM7METL5M5TO5UMDA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.236422982 (258h11m21.667503113s) [noise=true , address=104.36.82.5:4856 , piece_id=UBQIAKBOA7JI4I5H7LF7KVVB2VIELNJ53X4THXKHG5PSX7HSIMNQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: <nil>
Aug 19 11:37:27.236451497 (258h11m21.667531628s) [seg_pos={0 0}, upload=268469]: Segment reached optimal threshold of 14 pieces.
Aug 19 11:37:27.236583469 (258h11m21.6676636s) [noise=true , address=104.36.82.23:4453 , piece_id=S6HMM4ZUVPVKDUCYRPWOUKBFGBFHNJPK4WYTFS6T2EOQWWXXEDFQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ktniPbRibXzsTSNW9MbWWxymt9gZKU8sDgTjixc6nYzT9c5tJ): protocol: expected piece hash; context canceled; EOF
Aug 19 11:37:27.236685024 (258h11m21.667765155s) [noise=true , address=77.90.31.13:4660 , piece_id=USME2SUW2QYOVP7A6WLX6I6G6TQHPAZYH7FH5MBB6MGYOFDMUEBA, seg_pos={0 0}, upload=268469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TpUo13NwY6M47BnPsnbZD1WRKpX4KRDhYs2m3WH8VBrupnkRG): protocol: expected piece hash; context canceled; EOF
Aug 19 11:37:27.236773303 (258h11m21.667853434s) [noise=true , address=77.90.31.21:4883 , piece_id=MLXZUSERQPSF5FVPZ6FV7AKZPVYUZ5IBTSWAZZMTR3XWPRSDMIUQ, seg_pos={0 0}, upload=268469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:191MKpEnoarS7sK4Gs63ZM8zGc5jevFX8VeqViP82duW33nJJz): protocol: expected piece hash; context canceled; EOF
Aug 19 11:37:27.236807107 (258h11m21.667887238s) [noise=true , address=77.90.31.19:4852 , piece_id=HRO3JRHUL7KIVGLWOLX4AN33ICZWJURGA5EDCOCHVPW6GZPBFG6Q, seg_pos={0 0}, upload=268469]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1UVCFqkZwuXQ28GdfQahRcC5jwfWhoanWdTs7Z1jdHkxVVDARi): protocol: write tcp 188.166.225.170:39320->77.90.31.19:4852: use of closed network connection; write tcp 188.166.225.170:39320->77.90.31.19:4852: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39320->77.90.31.19:4852: use of closed network connection
Aug 19 11:37:27.236819642 (258h11m21.667899773s) [seg_pos={0 0}, upload=268469]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 11:37:27.236906117 (258h11m21.667986248s) [upload=268469]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 11:37:27.236910565 (258h11m21.667990696s) [upload=268469]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 11:37:27.678936297 (258h11m22.110016428s) [upload=268469]: Done uploading segments...
Aug 19 11:37:27.678950645 (258h11m22.110030766s) [upload=268469]: Upload finished. err: <nil>
Duration: 4.595199725s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X...................X..................X......] duration:
1.82731279s
FAIL (2025-08-19 11:37:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 1.827346833s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.309476608s
FAIL (2025-08-19 11:37:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.309500625s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X...................X..................X.....] duration:
1.864940858s
FAIL (2025-08-19 11:36:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 1.864966556s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X..X............................] duration:
5.996878478s
FAIL (2025-08-19 11:36:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments... Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments... Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.996901322s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
7.333702805s
FAIL (2025-08-19 11:36:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.333792617s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X...................X..................X....] duration:
2.248064999s
FAIL (2025-08-19 11:36:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 2.248095377s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X..X...........................] duration:
6.364370826s
FAIL (2025-08-19 11:35:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments... Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments... Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.364398419s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
6.593703446s
FAIL (2025-08-19 11:35:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.593729046s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X..X..........................] duration:
6.225458428s
FAIL (2025-08-19 11:35:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments... Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments... Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.225480609s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X...................X..................X...] duration:
2.126979739s
FAIL (2025-08-19 11:35:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 2.127055223s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X..X.........................] duration:
6.36907727s
FAIL (2025-08-19 11:34:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 11:13:02.350167148 (257h46m56.781247279s) [upload=268051]: Starting upload Aug 19 11:13:02.350220850 (257h46m56.781300981s) [upload=268051]: Done starting upload Aug 19 11:13:02.350300823 (257h46m56.781380964s) [upload=268051]: Uploading segments... Aug 19 11:13:02.350427946 (257h46m56.781508087s) [upload=268051]: Got next segment. Inline: false Aug 19 11:13:02.350462212 (257h46m56.781542343s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:13:02.350467132 (257h46m56.781547263s) [upload=268051]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 11:13:02.564249157 (257h46m56.995329288s) [upload=268051]: Next segment err: metaclient: Too Many Requests Aug 19 11:13:02.564267602 (257h46m56.995347733s) [upload=268051]: Done uploading segments... Aug 19 11:13:02.564303270 (257h46m56.995383401s) [upload=268051]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.36910374s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
6.578288392s
FAIL (2025-08-19 11:34:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.578309142s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X...................X..................X..] duration:
1.951199276s
FAIL (2025-08-19 11:34:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: invalid range 0:1024 (size:1024) ======LOGS====== Aug 19 11:32:45.191708118 (258h6m39.622788239s) [upload=268393]: Starting upload Aug 19 11:32:45.191756440 (258h6m39.622836571s) [upload=268393]: Done starting upload Aug 19 11:32:45.191820172 (258h6m39.622900293s) [upload=268393]: Uploading segments... Aug 19 11:32:45.191863595 (258h6m39.622943726s) [upload=268393]: Got next segment. Inline: true Aug 19 11:32:45.191867612 (258h6m39.622947743s) [upload=268393]: Waiting for error group managing segments... Aug 19 11:32:45.191903131 (258h6m39.622983262s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 11:32:45.191907148 (258h6m39.622987279s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 11:32:45.191910104 (258h6m39.622990235s) [upload=268393]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 11:32:45.587982248 (258h6m40.019062379s) [upload=268393]: Done uploading segments... Aug 19 11:32:45.588001634 (258h6m40.019081766s) [upload=268393]: Upload finished. err: <nil>
Duration: 1.951213683s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|