Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X.............X.........................X............X] duration:
1.662948431s
FAIL (2025-08-28 00:37:43 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after fe730691d38d9abd872f1f34c42cde607fc4296e77380c5ea3707f40ce7a79af != before 37809bd7338f70962b7fddaf3069fed51aa43727adccb13dce8190df1b7f97ce ======LOGS====== Aug 28 00:37:42.105445027 (6h59m21.268045955s) [upload=7281]: Starting upload Aug 28 00:37:42.105500363 (6h59m21.268101291s) [upload=7281]: Done starting upload Aug 28 00:37:42.105554777 (6h59m21.268155715s) [upload=7281]: Uploading segments... Aug 28 00:37:42.105592109 (6h59m21.268193037s) [upload=7281]: Got next segment. Inline: true Aug 28 00:37:42.105596207 (6h59m21.268197145s) [upload=7281]: Waiting for error group managing segments... Aug 28 00:37:42.105632516 (6h59m21.268233444s) [upload=7281]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:37:42.105636924 (6h59m21.268237852s) [upload=7281]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:37:42.105640482 (6h59m21.26824142s) [upload=7281]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:37:42.383656120 (6h59m21.546257058s) [upload=7281]: Done uploading segments... Aug 28 00:37:42.383680276 (6h59m21.546281214s) [upload=7281]: Upload finished. err: <nil>
Duration: 1.662982315s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X.........X.............................X.................X] duration:
4.448267377s
FAIL (2025-08-28 00:37:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 28 00:37:26.749849319 (6h59m5.912450257s) [upload=7279]: Starting upload
Aug 28 00:37:26.749905266 (6h59m5.912506204s) [upload=7279]: Done starting upload
Aug 28 00:37:26.750013954 (6h59m5.912614892s) [upload=7279]: Uploading segments...
Aug 28 00:37:26.750141027 (6h59m5.912741965s) [upload=7279]: Got next segment. Inline: false
Aug 28 00:37:26.750175162 (6h59m5.9127761s) [upload=7279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:37:26.750179490 (6h59m5.912780428s) [upload=7279]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 00:37:27.220137017 (6h59m6.382737955s) [seg_pos={0 0}, upload=7279]: Begin upload segment...
Aug 28 00:37:27.220185530 (6h59m6.382786468s) [seg_pos={0 0}, upload=7279]: Done begin upload segment.
Aug 28 00:37:27.220208393 (6h59m6.382809331s) [noise=true , address=104.36.82.9:4013 , piece_id=W4TDOH7HTXNNNP3G56TIGOVPLRX4ZVDWW2IE67NBUVRK3VUOPJ6A, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.220260273 (6h59m6.382861211s) [noise=true , address=77.90.31.12:4595 , piece_id=73BZDDJRY6X2T7S3MB723IG7RWG6UCDWUTJP5LL5NIDSOSHA5PZA, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.220657734 (6h59m6.383258672s) [noise=true , address=77.90.31.17:4781 , piece_id=S7LLPD3RYEOCLCOD4KUGLZ2PYFK7LFTRWHVNRMLQOOALKZ6FQL4A, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.220835423 (6h59m6.383436361s) [noise=true , address=77.90.31.11:4580 , piece_id=M63DJ3STFQBRQZJ6ZMCQ45KXLK4XODMFCDTQF7ZTHFZTKUEPS3NQ, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.220990540 (6h59m6.383591478s) [noise=true , address=45.91.116.11:4139 , piece_id=DLTVASRYI6OD32ARBK45TM7CQD6QRXCUQOSP4MQ2PKAVG5XJUAPA, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.221191565 (6h59m6.383792563s) [noise=true , address=79.127.205.245:4251 , piece_id=45VFYMRG5ZUE5HSQSKC6S7BE4FC64BYLI5WHMZCWNLQ6B6VIJU6Q, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.221265927 (6h59m6.383866855s) [noise=true , address=104.36.82.10:4111 , piece_id=WY453FHJ5N5426B4ULRYTGVLHYPHYWL5UPDF623KUVZCF7ZNMXGA, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.221606789 (6h59m6.384207727s) [noise=true , address=79.127.205.246:4260 , piece_id=YAA7ZOH3AGZ5TG2AJHBXA2D5AEITUQPK4BSUR7HRHMNM3ZMC5ECQ, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.221660862 (6h59m6.384261801s) [noise=true , address=77.90.31.17:4776 , piece_id=GYPGG3UU6KT5HOCIXDSG4RQ54KQROIUCGR2CDFXWFISYSPZ5NKCA, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.221917424 (6h59m6.384518362s) [noise=true , address=77.90.31.16:4741 , piece_id=7263N6DFHS3VEM7L7XQ4KNTMHNS54E56PTWUOBYJPDRIVA2KBSCQ, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.222044126 (6h59m6.384645054s) [noise=true , address=77.90.31.14:4679 , piece_id=CHMNP5XBYGCEQ2PJIC2625GITVQH2SPO7ERKBML4LZAQJJBMULUA, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.222326627 (6h59m6.384927555s) [noise=true , address=45.91.116.4:4945 , piece_id=DLOJVWJCSZO3QZ4EM44FL64SSOO7DLW526DU5S5OK7IJ6J7LKEJQ, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.222550706 (6h59m6.385151644s) [noise=true , address=64.49.13.170:4721 , piece_id=BIVRRYABNW7XT4LJMQSDWIREHY53I6NPAVYN6U6NNMX7ITP3STPQ, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.223419167 (6h59m6.386020095s) [noise=true , address=104.36.82.35:4608 , piece_id=VVQXD7DDN6AGVHCID5RJHVAISVIEJ4QWL3PLMK7ZMDLFXPPJ7WDA, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.223693231 (6h59m6.386294159s) [noise=true , address=77.90.31.13:4644 , piece_id=GIG22V6OUOCOORGKI5I3J6F3GKJBMRENQY4ZEQJCIOW2HSTCW3WA, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.223945214 (6h59m6.386546152s) [noise=true , address=77.90.31.15:4717 , piece_id=TI2YAJZCTRL636BOVVWBJXTMVUTQBGMW3UXITYK7MVYKUUQN25EQ, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.224180724 (6h59m6.386781662s) [noise=true , address=77.90.31.21:4906 , piece_id=VFXKJDYWEMKEULCUJ4T3JB43NMYDUYIOFEX244HLSA2CHN6CJAGQ, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:27.224440502 (6h59m6.38704143s) [noise=true , address=104.36.82.23:4474 , piece_id=NYXVN544EELXJ3MPTVWGDCSIBN4PP27PY7W7FSFZGQ5AWZYOEDYA, seg_pos={0 0}, upload=7279]: Uploading piece...
Aug 28 00:37:28.366014284 (6h59m7.528615222s) [upload=7279]: Next returned nil segment
Aug 28 00:37:28.366031176 (6h59m7.528632114s) [upload=7279]: Waiting for error group managing segments...
Aug 28 00:37:28.669328468 (6h59m7.831929406s) [noise=true , address=79.127.205.246:4260 , piece_id=YAA7ZOH3AGZ5TG2AJHBXA2D5AEITUQPK4BSUR7HRHMNM3ZMC5ECQ, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:28.805860565 (6h59m7.968461503s) [noise=true , address=64.49.13.170:4721 , piece_id=BIVRRYABNW7XT4LJMQSDWIREHY53I6NPAVYN6U6NNMX7ITP3STPQ, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:28.864449899 (6h59m8.027050827s) [noise=true , address=79.127.205.245:4251 , piece_id=45VFYMRG5ZUE5HSQSKC6S7BE4FC64BYLI5WHMZCWNLQ6B6VIJU6Q, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:29.189868519 (6h59m8.352469457s) [noise=true , address=45.91.116.4:4945 , piece_id=DLOJVWJCSZO3QZ4EM44FL64SSOO7DLW526DU5S5OK7IJ6J7LKEJQ, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:29.195146758 (6h59m8.357747696s) [noise=true , address=45.91.116.11:4139 , piece_id=DLTVASRYI6OD32ARBK45TM7CQD6QRXCUQOSP4MQ2PKAVG5XJUAPA, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:29.209574974 (6h59m8.372175912s) [noise=true , address=77.90.31.11:4580 , piece_id=M63DJ3STFQBRQZJ6ZMCQ45KXLK4XODMFCDTQF7ZTHFZTKUEPS3NQ, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:29.218513958 (6h59m8.381114936s) [noise=true , address=77.90.31.13:4644 , piece_id=GIG22V6OUOCOORGKI5I3J6F3GKJBMRENQY4ZEQJCIOW2HSTCW3WA, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:29.235481603 (6h59m8.398082561s) [noise=true , address=77.90.31.14:4679 , piece_id=CHMNP5XBYGCEQ2PJIC2625GITVQH2SPO7ERKBML4LZAQJJBMULUA, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:29.235810873 (6h59m8.398411852s) [noise=true , address=104.36.82.35:4608 , piece_id=VVQXD7DDN6AGVHCID5RJHVAISVIEJ4QWL3PLMK7ZMDLFXPPJ7WDA, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:29.236445187 (6h59m8.399046115s) [noise=true , address=77.90.31.16:4741 , piece_id=7263N6DFHS3VEM7L7XQ4KNTMHNS54E56PTWUOBYJPDRIVA2KBSCQ, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:29.267977370 (6h59m8.430578318s) [noise=true , address=77.90.31.17:4776 , piece_id=GYPGG3UU6KT5HOCIXDSG4RQ54KQROIUCGR2CDFXWFISYSPZ5NKCA, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:29.350779852 (6h59m8.51338079s) [noise=true , address=77.90.31.12:4595 , piece_id=73BZDDJRY6X2T7S3MB723IG7RWG6UCDWUTJP5LL5NIDSOSHA5PZA, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:29.356561335 (6h59m8.519162273s) [noise=true , address=104.36.82.10:4111 , piece_id=WY453FHJ5N5426B4ULRYTGVLHYPHYWL5UPDF623KUVZCF7ZNMXGA, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:29.419729790 (6h59m8.582330718s) [noise=true , address=77.90.31.17:4781 , piece_id=S7LLPD3RYEOCLCOD4KUGLZ2PYFK7LFTRWHVNRMLQOOALKZ6FQL4A, seg_pos={0 0}, upload=7279]: Done uploading piece. err: <nil>
Aug 28 00:37:29.419756060 (6h59m8.582356998s) [seg_pos={0 0}, upload=7279]: Segment reached optimal threshold of 14 pieces.
Aug 28 00:37:29.419858857 (6h59m8.582459785s) [noise=true , address=77.90.31.21:4906 , piece_id=VFXKJDYWEMKEULCUJ4T3JB43NMYDUYIOFEX244HLSA2CHN6CJAGQ, seg_pos={0 0}, upload=7279]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HG7FfbxD7WJZxWS5CXYFuJgj8n5L7tMr1ZfrcyF6Lih2S67R9): protocol: expected piece hash; context canceled; EOF
Aug 28 00:37:29.419916547 (6h59m8.582517485s) [noise=true , address=104.36.82.9:4013 , piece_id=W4TDOH7HTXNNNP3G56TIGOVPLRX4ZVDWW2IE67NBUVRK3VUOPJ6A, seg_pos={0 0}, upload=7279]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127jXtnz4wJDoxR5x8ebMqRt94RvbxMZm4YzzZrabbVohZpF8eW): protocol: expected piece hash; context canceled; EOF
Aug 28 00:37:29.419961823 (6h59m8.582562751s) [noise=true , address=104.36.82.23:4474 , piece_id=NYXVN544EELXJ3MPTVWGDCSIBN4PP27PY7W7FSFZGQ5AWZYOEDYA, seg_pos={0 0}, upload=7279]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Fpshye6yGAo3yf71eVpxrCdvoRjpkGX9WEX8KCWYbvuhy5i9j): protocol: expected piece hash; context canceled; EOF
Aug 28 00:37:29.419993795 (6h59m8.582594733s) [noise=true , address=77.90.31.15:4717 , piece_id=TI2YAJZCTRL636BOVVWBJXTMVUTQBGMW3UXITYK7MVYKUUQN25EQ, seg_pos={0 0}, upload=7279]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ULANtxKNaJviAZFsmHjDQWjG4x2wfmjCwbQtHmn9LpnELmkPc): protocol: expected piece hash; context canceled; EOF
Aug 28 00:37:29.420015776 (6h59m8.582616714s) [seg_pos={0 0}, upload=7279]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 00:37:29.420073126 (6h59m8.582674064s) [upload=7279]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 00:37:29.420077185 (6h59m8.582678123s) [upload=7279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:37:29.741449159 (6h59m8.904050097s) [upload=7279]: Done uploading segments...
Aug 28 00:37:29.741467634 (6h59m8.904068572s) [upload=7279]: Upload finished. err: <nil>
Duration: 4.448287667s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.........X.............................X.................] duration:
5.80366456s
FAIL (2025-08-28 00:37:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.803687944s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.............X.........................X............] duration:
1.937972537s
FAIL (2025-08-28 00:36:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 1.937996153s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.........X.............................X................] duration:
5.870701208s
FAIL (2025-08-28 00:35:54 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.870721197s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.............X.........................X...........] duration:
2.074227692s
FAIL (2025-08-28 00:35:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 2.074248321s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.........X.............................X...............] duration:
6.292217785s
FAIL (2025-08-28 00:35:15 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.292245459s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.........X.............................X..............] duration:
6.231888172s
FAIL (2025-08-28 00:34:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.231915485s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.............X.........................X..........] duration:
2.253386589s
FAIL (2025-08-28 00:34:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 2.253407959s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.........X.............................X.............] duration:
6.08585046s
FAIL (2025-08-28 00:33:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.085872362s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.............X.........................X.........] duration:
2.058352628s
FAIL (2025-08-28 00:33:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 2.058384991s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.............X.........................X........] duration:
2.064243098s
FAIL (2025-08-28 00:33:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 2.064276161s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.........X.............................X............] duration:
6.219201759s
FAIL (2025-08-28 00:32:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.219229491s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.............X.........................X.......] duration:
2.072192931s
FAIL (2025-08-28 00:32:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 2.072218389s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.............X.........................X......] duration:
2.232597521s
FAIL (2025-08-28 00:32:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 2.232620133s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X.........X.............................X...........] duration:
6.293125039s
FAIL (2025-08-28 00:31:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.293144976s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.............X.........................X.....] duration:
2.257605991s
FAIL (2025-08-28 00:31:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 2.257634336s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.........X.............................X..........] duration:
6.112781207s
FAIL (2025-08-28 00:30:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.112810313s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.............X.........................X....] duration:
2.06989224s
FAIL (2025-08-28 00:30:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 2.069920333s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.............X.........................X...] duration:
2.106407645s
FAIL (2025-08-28 00:30:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 2.106505673s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X.........X.............................X.........] duration:
5.944254571s
FAIL (2025-08-28 00:29:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.944283689s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.........X.............................X........] duration:
6.216087866s
FAIL (2025-08-28 00:29:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.216119056s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.............X.........................X..] duration:
1.919922483s
FAIL (2025-08-28 00:29:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 1.919946798s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.........X.............................X.......] duration:
6.017697581s
FAIL (2025-08-28 00:28:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.017728269s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.............X.........................X.] duration:
1.926005491s
FAIL (2025-08-28 00:28:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 1.926029618s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.........X.............................X......] duration:
6.128026696s
FAIL (2025-08-28 00:28:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.128059859s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.............X.........................X] duration:
1.642165684s
FAIL (2025-08-28 00:28:12 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 152cc166d2e0c7be121a2ea8c5e8dc3b261b365fd49f3704257708555aadc7ac != before 903806892f51e4b63e647239fc4c1b4be58ee6317f6b59191d8271d08c0600ec ======LOGS====== Aug 28 00:28:11.586042984 (6h49m50.748643922s) [upload=7115]: Starting upload Aug 28 00:28:11.586087309 (6h49m50.748688247s) [upload=7115]: Done starting upload Aug 28 00:28:11.586138126 (6h49m50.748739054s) [upload=7115]: Uploading segments... Aug 28 00:28:11.586169426 (6h49m50.748770354s) [upload=7115]: Got next segment. Inline: true Aug 28 00:28:11.586173433 (6h49m50.748774361s) [upload=7115]: Waiting for error group managing segments... Aug 28 00:28:11.586206808 (6h49m50.748807746s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:28:11.586210615 (6h49m50.748811543s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 28 00:28:11.586213180 (6h49m50.748814118s) [upload=7115]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 28 00:28:11.865217826 (6h49m51.027818764s) [upload=7115]: Done uploading segments... Aug 28 00:28:11.865245600 (6h49m51.027846528s) [upload=7115]: Upload finished. err: <nil>
Duration: 1.642196754s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X.............X.........................] duration:
1.975596385s
FAIL (2025-08-28 00:27:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 28 00:08:39.946107615 (6h30m19.108708543s) [upload=6782]: Starting upload
Aug 28 00:08:39.946195383 (6h30m19.108796321s) [upload=6782]: Done starting upload
Aug 28 00:08:39.946359467 (6h30m19.108960405s) [upload=6782]: Uploading segments...
Aug 28 00:08:39.946441875 (6h30m19.109042813s) [upload=6782]: Got next segment. Inline: true
Aug 28 00:08:39.946451073 (6h30m19.109052001s) [upload=6782]: Waiting for error group managing segments...
Aug 28 00:08:39.946497401 (6h30m19.109098339s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:08:39.946524172 (6h30m19.10912511s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 00:08:39.946528090 (6h30m19.109129028s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:08:40.429352462 (6h30m19.5919534s) [upload=6782]: Done uploading segments...
Aug 28 00:08:40.429381938 (6h30m19.591982866s) [upload=6782]: Upload finished. err: <nil>
Duration: 1.975619179s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.........X.............................X.....] duration:
5.865465652s
FAIL (2025-08-28 00:27:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.865493577s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.........X.............................X....] duration:
5.978513774s
FAIL (2025-08-28 00:26:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.978539454s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.............X........................] duration:
1.999308373s
FAIL (2025-08-28 00:26:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 28 00:08:39.946107615 (6h30m19.108708543s) [upload=6782]: Starting upload
Aug 28 00:08:39.946195383 (6h30m19.108796321s) [upload=6782]: Done starting upload
Aug 28 00:08:39.946359467 (6h30m19.108960405s) [upload=6782]: Uploading segments...
Aug 28 00:08:39.946441875 (6h30m19.109042813s) [upload=6782]: Got next segment. Inline: true
Aug 28 00:08:39.946451073 (6h30m19.109052001s) [upload=6782]: Waiting for error group managing segments...
Aug 28 00:08:39.946497401 (6h30m19.109098339s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:08:39.946524172 (6h30m19.10912511s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 00:08:39.946528090 (6h30m19.109129028s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:08:40.429352462 (6h30m19.5919534s) [upload=6782]: Done uploading segments...
Aug 28 00:08:40.429381938 (6h30m19.591982866s) [upload=6782]: Upload finished. err: <nil>
Duration: 1.999335505s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.........X.............................X...] duration:
6.126709268s
FAIL (2025-08-28 00:26:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.126743203s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X.............X.......................] duration:
2.048661695s
FAIL (2025-08-28 00:25:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 28 00:08:39.946107615 (6h30m19.108708543s) [upload=6782]: Starting upload
Aug 28 00:08:39.946195383 (6h30m19.108796321s) [upload=6782]: Done starting upload
Aug 28 00:08:39.946359467 (6h30m19.108960405s) [upload=6782]: Uploading segments...
Aug 28 00:08:39.946441875 (6h30m19.109042813s) [upload=6782]: Got next segment. Inline: true
Aug 28 00:08:39.946451073 (6h30m19.109052001s) [upload=6782]: Waiting for error group managing segments...
Aug 28 00:08:39.946497401 (6h30m19.109098339s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:08:39.946524172 (6h30m19.10912511s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 00:08:39.946528090 (6h30m19.109129028s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:08:40.429352462 (6h30m19.5919534s) [upload=6782]: Done uploading segments...
Aug 28 00:08:40.429381938 (6h30m19.591982866s) [upload=6782]: Upload finished. err: <nil>
Duration: 2.048683438s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.........X.............................X..] duration:
5.993125553s
FAIL (2025-08-28 00:25:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.993154879s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X.........X.............................X.] duration:
6.426480206s
FAIL (2025-08-28 00:25:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.426507979s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.............X......................] duration:
2.115004165s
FAIL (2025-08-28 00:25:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 28 00:08:39.946107615 (6h30m19.108708543s) [upload=6782]: Starting upload
Aug 28 00:08:39.946195383 (6h30m19.108796321s) [upload=6782]: Done starting upload
Aug 28 00:08:39.946359467 (6h30m19.108960405s) [upload=6782]: Uploading segments...
Aug 28 00:08:39.946441875 (6h30m19.109042813s) [upload=6782]: Got next segment. Inline: true
Aug 28 00:08:39.946451073 (6h30m19.109052001s) [upload=6782]: Waiting for error group managing segments...
Aug 28 00:08:39.946497401 (6h30m19.109098339s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:08:39.946524172 (6h30m19.10912511s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 00:08:39.946528090 (6h30m19.109129028s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:08:40.429352462 (6h30m19.5919534s) [upload=6782]: Done uploading segments...
Aug 28 00:08:40.429381938 (6h30m19.591982866s) [upload=6782]: Upload finished. err: <nil>
Duration: 2.115037808s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X.............X.....................] duration:
2.00368098s
FAIL (2025-08-28 00:24:39 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 28 00:08:39.946107615 (6h30m19.108708543s) [upload=6782]: Starting upload
Aug 28 00:08:39.946195383 (6h30m19.108796321s) [upload=6782]: Done starting upload
Aug 28 00:08:39.946359467 (6h30m19.108960405s) [upload=6782]: Uploading segments...
Aug 28 00:08:39.946441875 (6h30m19.109042813s) [upload=6782]: Got next segment. Inline: true
Aug 28 00:08:39.946451073 (6h30m19.109052001s) [upload=6782]: Waiting for error group managing segments...
Aug 28 00:08:39.946497401 (6h30m19.109098339s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:08:39.946524172 (6h30m19.10912511s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 00:08:39.946528090 (6h30m19.109129028s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:08:40.429352462 (6h30m19.5919534s) [upload=6782]: Done uploading segments...
Aug 28 00:08:40.429381938 (6h30m19.591982866s) [upload=6782]: Upload finished. err: <nil>
Duration: 2.003720266s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X.........X.............................X] duration:
907.655122ms
FAIL (2025-08-28 00:24:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 00:24:16.569045040 (6h45m55.731645979s) [upload=7042]: Starting upload Aug 28 00:24:16.569101258 (6h45m55.731702196s) [upload=7042]: Done starting upload Aug 28 00:24:16.569189788 (6h45m55.731790716s) [upload=7042]: Uploading segments... Aug 28 00:24:16.569334815 (6h45m55.731935753s) [upload=7042]: Got next segment. Inline: false Aug 28 00:24:16.569391023 (6h45m55.731991961s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 28 00:24:16.569395922 (6h45m55.73199686s) [upload=7042]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 28 00:24:16.794839627 (6h45m55.957440626s) [upload=7042]: Next segment err: metaclient: Too Many Requests Aug 28 00:24:16.794867551 (6h45m55.957468529s) [upload=7042]: Done uploading segments... Aug 28 00:24:16.794887219 (6h45m55.957488177s) [upload=7042]: Upload finished. err: metaclient: Too Many Requests
Duration: 907.680741ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X.............X....................] duration:
1.894670874s
FAIL (2025-08-28 00:24:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 28 00:08:39.946107615 (6h30m19.108708543s) [upload=6782]: Starting upload
Aug 28 00:08:39.946195383 (6h30m19.108796321s) [upload=6782]: Done starting upload
Aug 28 00:08:39.946359467 (6h30m19.108960405s) [upload=6782]: Uploading segments...
Aug 28 00:08:39.946441875 (6h30m19.109042813s) [upload=6782]: Got next segment. Inline: true
Aug 28 00:08:39.946451073 (6h30m19.109052001s) [upload=6782]: Waiting for error group managing segments...
Aug 28 00:08:39.946497401 (6h30m19.109098339s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:08:39.946524172 (6h30m19.10912511s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 00:08:39.946528090 (6h30m19.109129028s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:08:40.429352462 (6h30m19.5919534s) [upload=6782]: Done uploading segments...
Aug 28 00:08:40.429381938 (6h30m19.591982866s) [upload=6782]: Upload finished. err: <nil>
Duration: 1.894690662s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X.........X.............................] duration:
6.140235529s
FAIL (2025-08-28 00:23:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 28 00:02:23.923155885 (6h24m3.085756823s) [upload=6670]: Starting upload
Aug 28 00:02:23.923199688 (6h24m3.085800627s) [upload=6670]: Done starting upload
Aug 28 00:02:23.923460819 (6h24m3.086061767s) [upload=6670]: Uploading segments...
Aug 28 00:02:23.923505423 (6h24m3.086106371s) [upload=6670]: Got next segment. Inline: false
Aug 28 00:02:23.923536153 (6h24m3.086137091s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:02:23.923540992 (6h24m3.08614193s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 00:02:24.426354873 (6h24m3.588955821s) [seg_pos={0 0}, upload=6670]: Begin upload segment...
Aug 28 00:02:24.426400620 (6h24m3.589001558s) [seg_pos={0 0}, upload=6670]: Done begin upload segment.
Aug 28 00:02:24.426424225 (6h24m3.589025173s) [noise=true , address=104.36.82.11:4126 , piece_id=LQQLXKQEMTHLRT5T6BUA5ZKR66DX6IPK6NFJSHK4UH3EFJCRWYNQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.426960422 (6h24m3.58956136s) [noise=true , address=104.36.82.23:4465 , piece_id=2OY74SADPQW3XQ3DQ5OGPGPIOMHPBHMLR5UCNHBI2AROEVS27XUQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.427334707 (6h24m3.589935645s) [noise=true , address=79.127.201.215:4349 , piece_id=EXX4WFDITVDHZO4OD2N2LJAHGAULHMW4ZG2KTWXOMMJC6SRWXG6A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.427673316 (6h24m3.590274254s) [noise=true , address=77.90.31.10:4534 , piece_id=RWGGQZVW5JMW3MVQXLIPHZSO24TBBLPBEADPECUEHJ5L6DDKKYXA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428056679 (6h24m3.590657617s) [noise=true , address=104.36.82.52:4088 , piece_id=Z66QHKACKMOCUR5G6HN6SS24NO6OPC4OXXAYNEX5OQUXTK6HUE2Q, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428497553 (6h24m3.591098491s) [noise=true , address=45.91.116.5:4308 , piece_id=AV3IRIYHRDEL3CEKUGQNSBPFYROFUHYESV6K3IECMVUTDHCKT5IA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428769784 (6h24m3.591370722s) [noise=true , address=104.36.82.10:4092 , piece_id=ZPLSKEV76BLLIW3JP46OIBROYXLC7VGPQBKSG6HNAOAPKYCD7FIA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429019251 (6h24m3.591620189s) [noise=true , address=77.90.31.15:4706 , piece_id=C3UR5IYTKKY4TFGA5ARS6TJ5EPOIEHXMXBD2CXCHSR7N3L5VVR3A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429237589 (6h24m3.591838527s) [noise=true , address=45.91.116.8:4055 , piece_id=GVS4B5Z7VTBFWOJRLHMNRYJXVO3ANTCAQQSFHGH4XS7T7ODWJ2LA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429539476 (6h24m3.592140414s) [noise=true , address=77.90.31.18:4831 , piece_id=UO7R4VDIIHZTCU2RRYLWDRTRGFP7DOBOFSR3ETFNMMFJ3YCWPCVA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.430067837 (6h24m3.592668785s) [noise=true , address=77.90.31.21:4905 , piece_id=QHA7YNE6X5MAMP6AOKWC5XL27LHUQSBSZOMEPENHZCNWCUAJWGIA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.430494484 (6h24m3.593095422s) [noise=true , address=104.36.82.21:4474 , piece_id=CKWLNR5RX3L7CV7SMASZLIO5LQ4QMITNBEV5RUTAPGXZJCR6NRVA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.431087939 (6h24m3.593688877s) [noise=true , address=64.49.13.137:4503 , piece_id=LVL7A6O3SKXLBFKIMNSTOATIFC3FW3CVDHCUTY7SLAPMIGLIRF4A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.431608284 (6h24m3.594209222s) [noise=true , address=77.90.31.12:4620 , piece_id=6CBBFVWQP2QJOF6DK2UHKYLV7S6JH2NBUYLOHZ5SJ4PU4SGQACEQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.432216939 (6h24m3.594817877s) [noise=true , address=45.91.116.9:4292 , piece_id=HSCCMYWV5U64B6NTLRVUVSSQJ6LIXNEMIHWZG2AREMRIZ35EXUMQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.432758175 (6h24m3.595359113s) [noise=true , address=104.36.82.45:4923 , piece_id=6VG5FMN2IURBCOEW4KDJQRTRHYNWTQNVV6HCNQGHAVQDELV2HX5Q, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.433421123 (6h24m3.596022061s) [noise=true , address=104.36.82.60:4372 , piece_id=LSBL5RLSSV4NADN7ZKGV3U7IJVGJJMGVCNXHABTLK7CHQBOFNGHQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.434005923 (6h24m3.596606861s) [noise=true , address=45.91.116.4:4950 , piece_id=VFD56IP7477BFT7IC66W3KNYHUABGJ22FZDLM6VIXD3CSFYI6G3A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:25.681012859 (6h24m4.843613787s) [upload=6670]: Next returned nil segment
Aug 28 00:02:25.681027897 (6h24m4.843628825s) [upload=6670]: Waiting for error group managing segments...
Aug 28 00:02:25.997730649 (6h24m5.160331587s) [noise=true , address=64.49.13.137:4503 , piece_id=LVL7A6O3SKXLBFKIMNSTOATIFC3FW3CVDHCUTY7SLAPMIGLIRF4A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.337587369 (6h24m5.500188317s) [noise=true , address=45.91.116.4:4950 , piece_id=VFD56IP7477BFT7IC66W3KNYHUABGJ22FZDLM6VIXD3CSFYI6G3A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.340075720 (6h24m5.502676658s) [noise=true , address=45.91.116.8:4055 , piece_id=GVS4B5Z7VTBFWOJRLHMNRYJXVO3ANTCAQQSFHGH4XS7T7ODWJ2LA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.447917764 (6h24m5.610518702s) [noise=true , address=104.36.82.60:4372 , piece_id=LSBL5RLSSV4NADN7ZKGV3U7IJVGJJMGVCNXHABTLK7CHQBOFNGHQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.465307006 (6h24m5.627907944s) [noise=true , address=104.36.82.11:4126 , piece_id=LQQLXKQEMTHLRT5T6BUA5ZKR66DX6IPK6NFJSHK4UH3EFJCRWYNQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.511372057 (6h24m5.673972995s) [noise=true , address=104.36.82.45:4923 , piece_id=6VG5FMN2IURBCOEW4KDJQRTRHYNWTQNVV6HCNQGHAVQDELV2HX5Q, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.546096849 (6h24m5.708697787s) [noise=true , address=77.90.31.10:4534 , piece_id=RWGGQZVW5JMW3MVQXLIPHZSO24TBBLPBEADPECUEHJ5L6DDKKYXA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.546637023 (6h24m5.709237961s) [noise=true , address=77.90.31.21:4905 , piece_id=QHA7YNE6X5MAMP6AOKWC5XL27LHUQSBSZOMEPENHZCNWCUAJWGIA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.583776435 (6h24m5.746377373s) [noise=true , address=104.36.82.52:4088 , piece_id=Z66QHKACKMOCUR5G6HN6SS24NO6OPC4OXXAYNEX5OQUXTK6HUE2Q, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.584868465 (6h24m5.747469413s) [noise=true , address=79.127.201.215:4349 , piece_id=EXX4WFDITVDHZO4OD2N2LJAHGAULHMW4ZG2KTWXOMMJC6SRWXG6A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.587202931 (6h24m5.749803869s) [noise=true , address=77.90.31.15:4706 , piece_id=C3UR5IYTKKY4TFGA5ARS6TJ5EPOIEHXMXBD2CXCHSR7N3L5VVR3A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.626825265 (6h24m5.789426203s) [noise=true , address=77.90.31.12:4620 , piece_id=6CBBFVWQP2QJOF6DK2UHKYLV7S6JH2NBUYLOHZ5SJ4PU4SGQACEQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.649643004 (6h24m5.812243942s) [noise=true , address=104.36.82.23:4465 , piece_id=2OY74SADPQW3XQ3DQ5OGPGPIOMHPBHMLR5UCNHBI2AROEVS27XUQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.651015610 (6h24m5.813616548s) [noise=true , address=45.91.116.9:4292 , piece_id=HSCCMYWV5U64B6NTLRVUVSSQJ6LIXNEMIHWZG2AREMRIZ35EXUMQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.651023525 (6h24m5.813624463s) [seg_pos={0 0}, upload=6670]: Segment reached optimal threshold of 14 pieces.
Aug 28 00:02:26.651139286 (6h24m5.813740224s) [noise=true , address=77.90.31.18:4831 , piece_id=UO7R4VDIIHZTCU2RRYLWDRTRGFP7DOBOFSR3ETFNMMFJ3YCWPCVA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651278823 (6h24m5.813879761s) [noise=true , address=104.36.82.10:4092 , piece_id=ZPLSKEV76BLLIW3JP46OIBROYXLC7VGPQBKSG6HNAOAPKYCD7FIA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128P9omT47U7tm1k4XdeUR5vd1VAqskCvyfjF6VDy1ncwMDoZm9): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651330502 (6h24m5.81393143s) [noise=true , address=104.36.82.21:4474 , piece_id=CKWLNR5RX3L7CV7SMASZLIO5LQ4QMITNBEV5RUTAPGXZJCR6NRVA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651408782 (6h24m5.81400972s) [noise=true , address=45.91.116.5:4308 , piece_id=AV3IRIYHRDEL3CEKUGQNSBPFYROFUHYESV6K3IECMVUTDHCKT5IA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArtdfDCemaBzgtSYdVnuvLYUmKc4pgGLQEjmP1K1Wn4eoKTp4): protocol: write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection; write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection
Aug 28 00:02:26.651417919 (6h24m5.814018857s) [seg_pos={0 0}, upload=6670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 00:02:26.651486902 (6h24m5.81408784s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 00:02:26.651491911 (6h24m5.814092849s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:02:27.020461705 (6h24m6.183062693s) [upload=6670]: Done uploading segments...
Aug 28 00:02:27.020488887 (6h24m6.183089855s) [upload=6670]: Upload finished. err: <nil>
Duration: 6.140267269s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X.............X...................] duration:
1.90885169s
FAIL (2025-08-28 00:23:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 28 00:08:39.946107615 (6h30m19.108708543s) [upload=6782]: Starting upload
Aug 28 00:08:39.946195383 (6h30m19.108796321s) [upload=6782]: Done starting upload
Aug 28 00:08:39.946359467 (6h30m19.108960405s) [upload=6782]: Uploading segments...
Aug 28 00:08:39.946441875 (6h30m19.109042813s) [upload=6782]: Got next segment. Inline: true
Aug 28 00:08:39.946451073 (6h30m19.109052001s) [upload=6782]: Waiting for error group managing segments...
Aug 28 00:08:39.946497401 (6h30m19.109098339s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:08:39.946524172 (6h30m19.10912511s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 00:08:39.946528090 (6h30m19.109129028s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:08:40.429352462 (6h30m19.5919534s) [upload=6782]: Done uploading segments...
Aug 28 00:08:40.429381938 (6h30m19.591982866s) [upload=6782]: Upload finished. err: <nil>
Duration: 1.908878552s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X.........X............................] duration:
5.882470228s
FAIL (2025-08-28 00:22:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 28 00:02:23.923155885 (6h24m3.085756823s) [upload=6670]: Starting upload
Aug 28 00:02:23.923199688 (6h24m3.085800627s) [upload=6670]: Done starting upload
Aug 28 00:02:23.923460819 (6h24m3.086061767s) [upload=6670]: Uploading segments...
Aug 28 00:02:23.923505423 (6h24m3.086106371s) [upload=6670]: Got next segment. Inline: false
Aug 28 00:02:23.923536153 (6h24m3.086137091s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:02:23.923540992 (6h24m3.08614193s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 00:02:24.426354873 (6h24m3.588955821s) [seg_pos={0 0}, upload=6670]: Begin upload segment...
Aug 28 00:02:24.426400620 (6h24m3.589001558s) [seg_pos={0 0}, upload=6670]: Done begin upload segment.
Aug 28 00:02:24.426424225 (6h24m3.589025173s) [noise=true , address=104.36.82.11:4126 , piece_id=LQQLXKQEMTHLRT5T6BUA5ZKR66DX6IPK6NFJSHK4UH3EFJCRWYNQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.426960422 (6h24m3.58956136s) [noise=true , address=104.36.82.23:4465 , piece_id=2OY74SADPQW3XQ3DQ5OGPGPIOMHPBHMLR5UCNHBI2AROEVS27XUQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.427334707 (6h24m3.589935645s) [noise=true , address=79.127.201.215:4349 , piece_id=EXX4WFDITVDHZO4OD2N2LJAHGAULHMW4ZG2KTWXOMMJC6SRWXG6A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.427673316 (6h24m3.590274254s) [noise=true , address=77.90.31.10:4534 , piece_id=RWGGQZVW5JMW3MVQXLIPHZSO24TBBLPBEADPECUEHJ5L6DDKKYXA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428056679 (6h24m3.590657617s) [noise=true , address=104.36.82.52:4088 , piece_id=Z66QHKACKMOCUR5G6HN6SS24NO6OPC4OXXAYNEX5OQUXTK6HUE2Q, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428497553 (6h24m3.591098491s) [noise=true , address=45.91.116.5:4308 , piece_id=AV3IRIYHRDEL3CEKUGQNSBPFYROFUHYESV6K3IECMVUTDHCKT5IA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428769784 (6h24m3.591370722s) [noise=true , address=104.36.82.10:4092 , piece_id=ZPLSKEV76BLLIW3JP46OIBROYXLC7VGPQBKSG6HNAOAPKYCD7FIA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429019251 (6h24m3.591620189s) [noise=true , address=77.90.31.15:4706 , piece_id=C3UR5IYTKKY4TFGA5ARS6TJ5EPOIEHXMXBD2CXCHSR7N3L5VVR3A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429237589 (6h24m3.591838527s) [noise=true , address=45.91.116.8:4055 , piece_id=GVS4B5Z7VTBFWOJRLHMNRYJXVO3ANTCAQQSFHGH4XS7T7ODWJ2LA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429539476 (6h24m3.592140414s) [noise=true , address=77.90.31.18:4831 , piece_id=UO7R4VDIIHZTCU2RRYLWDRTRGFP7DOBOFSR3ETFNMMFJ3YCWPCVA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.430067837 (6h24m3.592668785s) [noise=true , address=77.90.31.21:4905 , piece_id=QHA7YNE6X5MAMP6AOKWC5XL27LHUQSBSZOMEPENHZCNWCUAJWGIA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.430494484 (6h24m3.593095422s) [noise=true , address=104.36.82.21:4474 , piece_id=CKWLNR5RX3L7CV7SMASZLIO5LQ4QMITNBEV5RUTAPGXZJCR6NRVA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.431087939 (6h24m3.593688877s) [noise=true , address=64.49.13.137:4503 , piece_id=LVL7A6O3SKXLBFKIMNSTOATIFC3FW3CVDHCUTY7SLAPMIGLIRF4A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.431608284 (6h24m3.594209222s) [noise=true , address=77.90.31.12:4620 , piece_id=6CBBFVWQP2QJOF6DK2UHKYLV7S6JH2NBUYLOHZ5SJ4PU4SGQACEQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.432216939 (6h24m3.594817877s) [noise=true , address=45.91.116.9:4292 , piece_id=HSCCMYWV5U64B6NTLRVUVSSQJ6LIXNEMIHWZG2AREMRIZ35EXUMQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.432758175 (6h24m3.595359113s) [noise=true , address=104.36.82.45:4923 , piece_id=6VG5FMN2IURBCOEW4KDJQRTRHYNWTQNVV6HCNQGHAVQDELV2HX5Q, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.433421123 (6h24m3.596022061s) [noise=true , address=104.36.82.60:4372 , piece_id=LSBL5RLSSV4NADN7ZKGV3U7IJVGJJMGVCNXHABTLK7CHQBOFNGHQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.434005923 (6h24m3.596606861s) [noise=true , address=45.91.116.4:4950 , piece_id=VFD56IP7477BFT7IC66W3KNYHUABGJ22FZDLM6VIXD3CSFYI6G3A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:25.681012859 (6h24m4.843613787s) [upload=6670]: Next returned nil segment
Aug 28 00:02:25.681027897 (6h24m4.843628825s) [upload=6670]: Waiting for error group managing segments...
Aug 28 00:02:25.997730649 (6h24m5.160331587s) [noise=true , address=64.49.13.137:4503 , piece_id=LVL7A6O3SKXLBFKIMNSTOATIFC3FW3CVDHCUTY7SLAPMIGLIRF4A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.337587369 (6h24m5.500188317s) [noise=true , address=45.91.116.4:4950 , piece_id=VFD56IP7477BFT7IC66W3KNYHUABGJ22FZDLM6VIXD3CSFYI6G3A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.340075720 (6h24m5.502676658s) [noise=true , address=45.91.116.8:4055 , piece_id=GVS4B5Z7VTBFWOJRLHMNRYJXVO3ANTCAQQSFHGH4XS7T7ODWJ2LA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.447917764 (6h24m5.610518702s) [noise=true , address=104.36.82.60:4372 , piece_id=LSBL5RLSSV4NADN7ZKGV3U7IJVGJJMGVCNXHABTLK7CHQBOFNGHQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.465307006 (6h24m5.627907944s) [noise=true , address=104.36.82.11:4126 , piece_id=LQQLXKQEMTHLRT5T6BUA5ZKR66DX6IPK6NFJSHK4UH3EFJCRWYNQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.511372057 (6h24m5.673972995s) [noise=true , address=104.36.82.45:4923 , piece_id=6VG5FMN2IURBCOEW4KDJQRTRHYNWTQNVV6HCNQGHAVQDELV2HX5Q, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.546096849 (6h24m5.708697787s) [noise=true , address=77.90.31.10:4534 , piece_id=RWGGQZVW5JMW3MVQXLIPHZSO24TBBLPBEADPECUEHJ5L6DDKKYXA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.546637023 (6h24m5.709237961s) [noise=true , address=77.90.31.21:4905 , piece_id=QHA7YNE6X5MAMP6AOKWC5XL27LHUQSBSZOMEPENHZCNWCUAJWGIA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.583776435 (6h24m5.746377373s) [noise=true , address=104.36.82.52:4088 , piece_id=Z66QHKACKMOCUR5G6HN6SS24NO6OPC4OXXAYNEX5OQUXTK6HUE2Q, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.584868465 (6h24m5.747469413s) [noise=true , address=79.127.201.215:4349 , piece_id=EXX4WFDITVDHZO4OD2N2LJAHGAULHMW4ZG2KTWXOMMJC6SRWXG6A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.587202931 (6h24m5.749803869s) [noise=true , address=77.90.31.15:4706 , piece_id=C3UR5IYTKKY4TFGA5ARS6TJ5EPOIEHXMXBD2CXCHSR7N3L5VVR3A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.626825265 (6h24m5.789426203s) [noise=true , address=77.90.31.12:4620 , piece_id=6CBBFVWQP2QJOF6DK2UHKYLV7S6JH2NBUYLOHZ5SJ4PU4SGQACEQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.649643004 (6h24m5.812243942s) [noise=true , address=104.36.82.23:4465 , piece_id=2OY74SADPQW3XQ3DQ5OGPGPIOMHPBHMLR5UCNHBI2AROEVS27XUQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.651015610 (6h24m5.813616548s) [noise=true , address=45.91.116.9:4292 , piece_id=HSCCMYWV5U64B6NTLRVUVSSQJ6LIXNEMIHWZG2AREMRIZ35EXUMQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.651023525 (6h24m5.813624463s) [seg_pos={0 0}, upload=6670]: Segment reached optimal threshold of 14 pieces.
Aug 28 00:02:26.651139286 (6h24m5.813740224s) [noise=true , address=77.90.31.18:4831 , piece_id=UO7R4VDIIHZTCU2RRYLWDRTRGFP7DOBOFSR3ETFNMMFJ3YCWPCVA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651278823 (6h24m5.813879761s) [noise=true , address=104.36.82.10:4092 , piece_id=ZPLSKEV76BLLIW3JP46OIBROYXLC7VGPQBKSG6HNAOAPKYCD7FIA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128P9omT47U7tm1k4XdeUR5vd1VAqskCvyfjF6VDy1ncwMDoZm9): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651330502 (6h24m5.81393143s) [noise=true , address=104.36.82.21:4474 , piece_id=CKWLNR5RX3L7CV7SMASZLIO5LQ4QMITNBEV5RUTAPGXZJCR6NRVA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651408782 (6h24m5.81400972s) [noise=true , address=45.91.116.5:4308 , piece_id=AV3IRIYHRDEL3CEKUGQNSBPFYROFUHYESV6K3IECMVUTDHCKT5IA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArtdfDCemaBzgtSYdVnuvLYUmKc4pgGLQEjmP1K1Wn4eoKTp4): protocol: write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection; write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection
Aug 28 00:02:26.651417919 (6h24m5.814018857s) [seg_pos={0 0}, upload=6670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 00:02:26.651486902 (6h24m5.81408784s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 00:02:26.651491911 (6h24m5.814092849s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:02:27.020461705 (6h24m6.183062693s) [upload=6670]: Done uploading segments...
Aug 28 00:02:27.020488887 (6h24m6.183089855s) [upload=6670]: Upload finished. err: <nil>
Duration: 5.88249729s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X.............X..................] duration:
1.935804228s
FAIL (2025-08-28 00:22:08 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 28 00:08:39.946107615 (6h30m19.108708543s) [upload=6782]: Starting upload
Aug 28 00:08:39.946195383 (6h30m19.108796321s) [upload=6782]: Done starting upload
Aug 28 00:08:39.946359467 (6h30m19.108960405s) [upload=6782]: Uploading segments...
Aug 28 00:08:39.946441875 (6h30m19.109042813s) [upload=6782]: Got next segment. Inline: true
Aug 28 00:08:39.946451073 (6h30m19.109052001s) [upload=6782]: Waiting for error group managing segments...
Aug 28 00:08:39.946497401 (6h30m19.109098339s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:08:39.946524172 (6h30m19.10912511s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 00:08:39.946528090 (6h30m19.109129028s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:08:40.429352462 (6h30m19.5919534s) [upload=6782]: Done uploading segments...
Aug 28 00:08:40.429381938 (6h30m19.591982866s) [upload=6782]: Upload finished. err: <nil>
Duration: 1.935832923s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X.........X...........................] duration:
5.827240866s
FAIL (2025-08-28 00:21:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 28 00:02:23.923155885 (6h24m3.085756823s) [upload=6670]: Starting upload
Aug 28 00:02:23.923199688 (6h24m3.085800627s) [upload=6670]: Done starting upload
Aug 28 00:02:23.923460819 (6h24m3.086061767s) [upload=6670]: Uploading segments...
Aug 28 00:02:23.923505423 (6h24m3.086106371s) [upload=6670]: Got next segment. Inline: false
Aug 28 00:02:23.923536153 (6h24m3.086137091s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:02:23.923540992 (6h24m3.08614193s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 00:02:24.426354873 (6h24m3.588955821s) [seg_pos={0 0}, upload=6670]: Begin upload segment...
Aug 28 00:02:24.426400620 (6h24m3.589001558s) [seg_pos={0 0}, upload=6670]: Done begin upload segment.
Aug 28 00:02:24.426424225 (6h24m3.589025173s) [noise=true , address=104.36.82.11:4126 , piece_id=LQQLXKQEMTHLRT5T6BUA5ZKR66DX6IPK6NFJSHK4UH3EFJCRWYNQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.426960422 (6h24m3.58956136s) [noise=true , address=104.36.82.23:4465 , piece_id=2OY74SADPQW3XQ3DQ5OGPGPIOMHPBHMLR5UCNHBI2AROEVS27XUQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.427334707 (6h24m3.589935645s) [noise=true , address=79.127.201.215:4349 , piece_id=EXX4WFDITVDHZO4OD2N2LJAHGAULHMW4ZG2KTWXOMMJC6SRWXG6A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.427673316 (6h24m3.590274254s) [noise=true , address=77.90.31.10:4534 , piece_id=RWGGQZVW5JMW3MVQXLIPHZSO24TBBLPBEADPECUEHJ5L6DDKKYXA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428056679 (6h24m3.590657617s) [noise=true , address=104.36.82.52:4088 , piece_id=Z66QHKACKMOCUR5G6HN6SS24NO6OPC4OXXAYNEX5OQUXTK6HUE2Q, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428497553 (6h24m3.591098491s) [noise=true , address=45.91.116.5:4308 , piece_id=AV3IRIYHRDEL3CEKUGQNSBPFYROFUHYESV6K3IECMVUTDHCKT5IA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428769784 (6h24m3.591370722s) [noise=true , address=104.36.82.10:4092 , piece_id=ZPLSKEV76BLLIW3JP46OIBROYXLC7VGPQBKSG6HNAOAPKYCD7FIA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429019251 (6h24m3.591620189s) [noise=true , address=77.90.31.15:4706 , piece_id=C3UR5IYTKKY4TFGA5ARS6TJ5EPOIEHXMXBD2CXCHSR7N3L5VVR3A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429237589 (6h24m3.591838527s) [noise=true , address=45.91.116.8:4055 , piece_id=GVS4B5Z7VTBFWOJRLHMNRYJXVO3ANTCAQQSFHGH4XS7T7ODWJ2LA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429539476 (6h24m3.592140414s) [noise=true , address=77.90.31.18:4831 , piece_id=UO7R4VDIIHZTCU2RRYLWDRTRGFP7DOBOFSR3ETFNMMFJ3YCWPCVA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.430067837 (6h24m3.592668785s) [noise=true , address=77.90.31.21:4905 , piece_id=QHA7YNE6X5MAMP6AOKWC5XL27LHUQSBSZOMEPENHZCNWCUAJWGIA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.430494484 (6h24m3.593095422s) [noise=true , address=104.36.82.21:4474 , piece_id=CKWLNR5RX3L7CV7SMASZLIO5LQ4QMITNBEV5RUTAPGXZJCR6NRVA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.431087939 (6h24m3.593688877s) [noise=true , address=64.49.13.137:4503 , piece_id=LVL7A6O3SKXLBFKIMNSTOATIFC3FW3CVDHCUTY7SLAPMIGLIRF4A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.431608284 (6h24m3.594209222s) [noise=true , address=77.90.31.12:4620 , piece_id=6CBBFVWQP2QJOF6DK2UHKYLV7S6JH2NBUYLOHZ5SJ4PU4SGQACEQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.432216939 (6h24m3.594817877s) [noise=true , address=45.91.116.9:4292 , piece_id=HSCCMYWV5U64B6NTLRVUVSSQJ6LIXNEMIHWZG2AREMRIZ35EXUMQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.432758175 (6h24m3.595359113s) [noise=true , address=104.36.82.45:4923 , piece_id=6VG5FMN2IURBCOEW4KDJQRTRHYNWTQNVV6HCNQGHAVQDELV2HX5Q, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.433421123 (6h24m3.596022061s) [noise=true , address=104.36.82.60:4372 , piece_id=LSBL5RLSSV4NADN7ZKGV3U7IJVGJJMGVCNXHABTLK7CHQBOFNGHQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.434005923 (6h24m3.596606861s) [noise=true , address=45.91.116.4:4950 , piece_id=VFD56IP7477BFT7IC66W3KNYHUABGJ22FZDLM6VIXD3CSFYI6G3A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:25.681012859 (6h24m4.843613787s) [upload=6670]: Next returned nil segment
Aug 28 00:02:25.681027897 (6h24m4.843628825s) [upload=6670]: Waiting for error group managing segments...
Aug 28 00:02:25.997730649 (6h24m5.160331587s) [noise=true , address=64.49.13.137:4503 , piece_id=LVL7A6O3SKXLBFKIMNSTOATIFC3FW3CVDHCUTY7SLAPMIGLIRF4A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.337587369 (6h24m5.500188317s) [noise=true , address=45.91.116.4:4950 , piece_id=VFD56IP7477BFT7IC66W3KNYHUABGJ22FZDLM6VIXD3CSFYI6G3A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.340075720 (6h24m5.502676658s) [noise=true , address=45.91.116.8:4055 , piece_id=GVS4B5Z7VTBFWOJRLHMNRYJXVO3ANTCAQQSFHGH4XS7T7ODWJ2LA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.447917764 (6h24m5.610518702s) [noise=true , address=104.36.82.60:4372 , piece_id=LSBL5RLSSV4NADN7ZKGV3U7IJVGJJMGVCNXHABTLK7CHQBOFNGHQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.465307006 (6h24m5.627907944s) [noise=true , address=104.36.82.11:4126 , piece_id=LQQLXKQEMTHLRT5T6BUA5ZKR66DX6IPK6NFJSHK4UH3EFJCRWYNQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.511372057 (6h24m5.673972995s) [noise=true , address=104.36.82.45:4923 , piece_id=6VG5FMN2IURBCOEW4KDJQRTRHYNWTQNVV6HCNQGHAVQDELV2HX5Q, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.546096849 (6h24m5.708697787s) [noise=true , address=77.90.31.10:4534 , piece_id=RWGGQZVW5JMW3MVQXLIPHZSO24TBBLPBEADPECUEHJ5L6DDKKYXA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.546637023 (6h24m5.709237961s) [noise=true , address=77.90.31.21:4905 , piece_id=QHA7YNE6X5MAMP6AOKWC5XL27LHUQSBSZOMEPENHZCNWCUAJWGIA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.583776435 (6h24m5.746377373s) [noise=true , address=104.36.82.52:4088 , piece_id=Z66QHKACKMOCUR5G6HN6SS24NO6OPC4OXXAYNEX5OQUXTK6HUE2Q, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.584868465 (6h24m5.747469413s) [noise=true , address=79.127.201.215:4349 , piece_id=EXX4WFDITVDHZO4OD2N2LJAHGAULHMW4ZG2KTWXOMMJC6SRWXG6A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.587202931 (6h24m5.749803869s) [noise=true , address=77.90.31.15:4706 , piece_id=C3UR5IYTKKY4TFGA5ARS6TJ5EPOIEHXMXBD2CXCHSR7N3L5VVR3A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.626825265 (6h24m5.789426203s) [noise=true , address=77.90.31.12:4620 , piece_id=6CBBFVWQP2QJOF6DK2UHKYLV7S6JH2NBUYLOHZ5SJ4PU4SGQACEQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.649643004 (6h24m5.812243942s) [noise=true , address=104.36.82.23:4465 , piece_id=2OY74SADPQW3XQ3DQ5OGPGPIOMHPBHMLR5UCNHBI2AROEVS27XUQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.651015610 (6h24m5.813616548s) [noise=true , address=45.91.116.9:4292 , piece_id=HSCCMYWV5U64B6NTLRVUVSSQJ6LIXNEMIHWZG2AREMRIZ35EXUMQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.651023525 (6h24m5.813624463s) [seg_pos={0 0}, upload=6670]: Segment reached optimal threshold of 14 pieces.
Aug 28 00:02:26.651139286 (6h24m5.813740224s) [noise=true , address=77.90.31.18:4831 , piece_id=UO7R4VDIIHZTCU2RRYLWDRTRGFP7DOBOFSR3ETFNMMFJ3YCWPCVA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651278823 (6h24m5.813879761s) [noise=true , address=104.36.82.10:4092 , piece_id=ZPLSKEV76BLLIW3JP46OIBROYXLC7VGPQBKSG6HNAOAPKYCD7FIA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128P9omT47U7tm1k4XdeUR5vd1VAqskCvyfjF6VDy1ncwMDoZm9): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651330502 (6h24m5.81393143s) [noise=true , address=104.36.82.21:4474 , piece_id=CKWLNR5RX3L7CV7SMASZLIO5LQ4QMITNBEV5RUTAPGXZJCR6NRVA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651408782 (6h24m5.81400972s) [noise=true , address=45.91.116.5:4308 , piece_id=AV3IRIYHRDEL3CEKUGQNSBPFYROFUHYESV6K3IECMVUTDHCKT5IA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArtdfDCemaBzgtSYdVnuvLYUmKc4pgGLQEjmP1K1Wn4eoKTp4): protocol: write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection; write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection
Aug 28 00:02:26.651417919 (6h24m5.814018857s) [seg_pos={0 0}, upload=6670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 00:02:26.651486902 (6h24m5.81408784s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 00:02:26.651491911 (6h24m5.814092849s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:02:27.020461705 (6h24m6.183062693s) [upload=6670]: Done uploading segments...
Aug 28 00:02:27.020488887 (6h24m6.183089855s) [upload=6670]: Upload finished. err: <nil>
Duration: 5.827269009s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................X.............X.................] duration:
1.987211267s
FAIL (2025-08-28 00:20:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 28 00:08:39.946107615 (6h30m19.108708543s) [upload=6782]: Starting upload
Aug 28 00:08:39.946195383 (6h30m19.108796321s) [upload=6782]: Done starting upload
Aug 28 00:08:39.946359467 (6h30m19.108960405s) [upload=6782]: Uploading segments...
Aug 28 00:08:39.946441875 (6h30m19.109042813s) [upload=6782]: Got next segment. Inline: true
Aug 28 00:08:39.946451073 (6h30m19.109052001s) [upload=6782]: Waiting for error group managing segments...
Aug 28 00:08:39.946497401 (6h30m19.109098339s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:08:39.946524172 (6h30m19.10912511s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 00:08:39.946528090 (6h30m19.109129028s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:08:40.429352462 (6h30m19.5919534s) [upload=6782]: Done uploading segments...
Aug 28 00:08:40.429381938 (6h30m19.591982866s) [upload=6782]: Upload finished. err: <nil>
Duration: 1.98724467s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................X.............X................] duration:
2.026047119s
FAIL (2025-08-28 00:20:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 28 00:08:39.946107615 (6h30m19.108708543s) [upload=6782]: Starting upload
Aug 28 00:08:39.946195383 (6h30m19.108796321s) [upload=6782]: Done starting upload
Aug 28 00:08:39.946359467 (6h30m19.108960405s) [upload=6782]: Uploading segments...
Aug 28 00:08:39.946441875 (6h30m19.109042813s) [upload=6782]: Got next segment. Inline: true
Aug 28 00:08:39.946451073 (6h30m19.109052001s) [upload=6782]: Waiting for error group managing segments...
Aug 28 00:08:39.946497401 (6h30m19.109098339s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:08:39.946524172 (6h30m19.10912511s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 00:08:39.946528090 (6h30m19.109129028s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:08:40.429352462 (6h30m19.5919534s) [upload=6782]: Done uploading segments...
Aug 28 00:08:40.429381938 (6h30m19.591982866s) [upload=6782]: Upload finished. err: <nil>
Duration: 2.026075363s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X.........X..........................] duration:
6.154451821s
FAIL (2025-08-28 00:20:37 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 28 00:02:23.923155885 (6h24m3.085756823s) [upload=6670]: Starting upload
Aug 28 00:02:23.923199688 (6h24m3.085800627s) [upload=6670]: Done starting upload
Aug 28 00:02:23.923460819 (6h24m3.086061767s) [upload=6670]: Uploading segments...
Aug 28 00:02:23.923505423 (6h24m3.086106371s) [upload=6670]: Got next segment. Inline: false
Aug 28 00:02:23.923536153 (6h24m3.086137091s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:02:23.923540992 (6h24m3.08614193s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 00:02:24.426354873 (6h24m3.588955821s) [seg_pos={0 0}, upload=6670]: Begin upload segment...
Aug 28 00:02:24.426400620 (6h24m3.589001558s) [seg_pos={0 0}, upload=6670]: Done begin upload segment.
Aug 28 00:02:24.426424225 (6h24m3.589025173s) [noise=true , address=104.36.82.11:4126 , piece_id=LQQLXKQEMTHLRT5T6BUA5ZKR66DX6IPK6NFJSHK4UH3EFJCRWYNQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.426960422 (6h24m3.58956136s) [noise=true , address=104.36.82.23:4465 , piece_id=2OY74SADPQW3XQ3DQ5OGPGPIOMHPBHMLR5UCNHBI2AROEVS27XUQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.427334707 (6h24m3.589935645s) [noise=true , address=79.127.201.215:4349 , piece_id=EXX4WFDITVDHZO4OD2N2LJAHGAULHMW4ZG2KTWXOMMJC6SRWXG6A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.427673316 (6h24m3.590274254s) [noise=true , address=77.90.31.10:4534 , piece_id=RWGGQZVW5JMW3MVQXLIPHZSO24TBBLPBEADPECUEHJ5L6DDKKYXA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428056679 (6h24m3.590657617s) [noise=true , address=104.36.82.52:4088 , piece_id=Z66QHKACKMOCUR5G6HN6SS24NO6OPC4OXXAYNEX5OQUXTK6HUE2Q, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428497553 (6h24m3.591098491s) [noise=true , address=45.91.116.5:4308 , piece_id=AV3IRIYHRDEL3CEKUGQNSBPFYROFUHYESV6K3IECMVUTDHCKT5IA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428769784 (6h24m3.591370722s) [noise=true , address=104.36.82.10:4092 , piece_id=ZPLSKEV76BLLIW3JP46OIBROYXLC7VGPQBKSG6HNAOAPKYCD7FIA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429019251 (6h24m3.591620189s) [noise=true , address=77.90.31.15:4706 , piece_id=C3UR5IYTKKY4TFGA5ARS6TJ5EPOIEHXMXBD2CXCHSR7N3L5VVR3A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429237589 (6h24m3.591838527s) [noise=true , address=45.91.116.8:4055 , piece_id=GVS4B5Z7VTBFWOJRLHMNRYJXVO3ANTCAQQSFHGH4XS7T7ODWJ2LA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429539476 (6h24m3.592140414s) [noise=true , address=77.90.31.18:4831 , piece_id=UO7R4VDIIHZTCU2RRYLWDRTRGFP7DOBOFSR3ETFNMMFJ3YCWPCVA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.430067837 (6h24m3.592668785s) [noise=true , address=77.90.31.21:4905 , piece_id=QHA7YNE6X5MAMP6AOKWC5XL27LHUQSBSZOMEPENHZCNWCUAJWGIA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.430494484 (6h24m3.593095422s) [noise=true , address=104.36.82.21:4474 , piece_id=CKWLNR5RX3L7CV7SMASZLIO5LQ4QMITNBEV5RUTAPGXZJCR6NRVA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.431087939 (6h24m3.593688877s) [noise=true , address=64.49.13.137:4503 , piece_id=LVL7A6O3SKXLBFKIMNSTOATIFC3FW3CVDHCUTY7SLAPMIGLIRF4A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.431608284 (6h24m3.594209222s) [noise=true , address=77.90.31.12:4620 , piece_id=6CBBFVWQP2QJOF6DK2UHKYLV7S6JH2NBUYLOHZ5SJ4PU4SGQACEQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.432216939 (6h24m3.594817877s) [noise=true , address=45.91.116.9:4292 , piece_id=HSCCMYWV5U64B6NTLRVUVSSQJ6LIXNEMIHWZG2AREMRIZ35EXUMQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.432758175 (6h24m3.595359113s) [noise=true , address=104.36.82.45:4923 , piece_id=6VG5FMN2IURBCOEW4KDJQRTRHYNWTQNVV6HCNQGHAVQDELV2HX5Q, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.433421123 (6h24m3.596022061s) [noise=true , address=104.36.82.60:4372 , piece_id=LSBL5RLSSV4NADN7ZKGV3U7IJVGJJMGVCNXHABTLK7CHQBOFNGHQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.434005923 (6h24m3.596606861s) [noise=true , address=45.91.116.4:4950 , piece_id=VFD56IP7477BFT7IC66W3KNYHUABGJ22FZDLM6VIXD3CSFYI6G3A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:25.681012859 (6h24m4.843613787s) [upload=6670]: Next returned nil segment
Aug 28 00:02:25.681027897 (6h24m4.843628825s) [upload=6670]: Waiting for error group managing segments...
Aug 28 00:02:25.997730649 (6h24m5.160331587s) [noise=true , address=64.49.13.137:4503 , piece_id=LVL7A6O3SKXLBFKIMNSTOATIFC3FW3CVDHCUTY7SLAPMIGLIRF4A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.337587369 (6h24m5.500188317s) [noise=true , address=45.91.116.4:4950 , piece_id=VFD56IP7477BFT7IC66W3KNYHUABGJ22FZDLM6VIXD3CSFYI6G3A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.340075720 (6h24m5.502676658s) [noise=true , address=45.91.116.8:4055 , piece_id=GVS4B5Z7VTBFWOJRLHMNRYJXVO3ANTCAQQSFHGH4XS7T7ODWJ2LA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.447917764 (6h24m5.610518702s) [noise=true , address=104.36.82.60:4372 , piece_id=LSBL5RLSSV4NADN7ZKGV3U7IJVGJJMGVCNXHABTLK7CHQBOFNGHQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.465307006 (6h24m5.627907944s) [noise=true , address=104.36.82.11:4126 , piece_id=LQQLXKQEMTHLRT5T6BUA5ZKR66DX6IPK6NFJSHK4UH3EFJCRWYNQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.511372057 (6h24m5.673972995s) [noise=true , address=104.36.82.45:4923 , piece_id=6VG5FMN2IURBCOEW4KDJQRTRHYNWTQNVV6HCNQGHAVQDELV2HX5Q, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.546096849 (6h24m5.708697787s) [noise=true , address=77.90.31.10:4534 , piece_id=RWGGQZVW5JMW3MVQXLIPHZSO24TBBLPBEADPECUEHJ5L6DDKKYXA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.546637023 (6h24m5.709237961s) [noise=true , address=77.90.31.21:4905 , piece_id=QHA7YNE6X5MAMP6AOKWC5XL27LHUQSBSZOMEPENHZCNWCUAJWGIA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.583776435 (6h24m5.746377373s) [noise=true , address=104.36.82.52:4088 , piece_id=Z66QHKACKMOCUR5G6HN6SS24NO6OPC4OXXAYNEX5OQUXTK6HUE2Q, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.584868465 (6h24m5.747469413s) [noise=true , address=79.127.201.215:4349 , piece_id=EXX4WFDITVDHZO4OD2N2LJAHGAULHMW4ZG2KTWXOMMJC6SRWXG6A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.587202931 (6h24m5.749803869s) [noise=true , address=77.90.31.15:4706 , piece_id=C3UR5IYTKKY4TFGA5ARS6TJ5EPOIEHXMXBD2CXCHSR7N3L5VVR3A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.626825265 (6h24m5.789426203s) [noise=true , address=77.90.31.12:4620 , piece_id=6CBBFVWQP2QJOF6DK2UHKYLV7S6JH2NBUYLOHZ5SJ4PU4SGQACEQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.649643004 (6h24m5.812243942s) [noise=true , address=104.36.82.23:4465 , piece_id=2OY74SADPQW3XQ3DQ5OGPGPIOMHPBHMLR5UCNHBI2AROEVS27XUQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.651015610 (6h24m5.813616548s) [noise=true , address=45.91.116.9:4292 , piece_id=HSCCMYWV5U64B6NTLRVUVSSQJ6LIXNEMIHWZG2AREMRIZ35EXUMQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.651023525 (6h24m5.813624463s) [seg_pos={0 0}, upload=6670]: Segment reached optimal threshold of 14 pieces.
Aug 28 00:02:26.651139286 (6h24m5.813740224s) [noise=true , address=77.90.31.18:4831 , piece_id=UO7R4VDIIHZTCU2RRYLWDRTRGFP7DOBOFSR3ETFNMMFJ3YCWPCVA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651278823 (6h24m5.813879761s) [noise=true , address=104.36.82.10:4092 , piece_id=ZPLSKEV76BLLIW3JP46OIBROYXLC7VGPQBKSG6HNAOAPKYCD7FIA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128P9omT47U7tm1k4XdeUR5vd1VAqskCvyfjF6VDy1ncwMDoZm9): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651330502 (6h24m5.81393143s) [noise=true , address=104.36.82.21:4474 , piece_id=CKWLNR5RX3L7CV7SMASZLIO5LQ4QMITNBEV5RUTAPGXZJCR6NRVA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651408782 (6h24m5.81400972s) [noise=true , address=45.91.116.5:4308 , piece_id=AV3IRIYHRDEL3CEKUGQNSBPFYROFUHYESV6K3IECMVUTDHCKT5IA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArtdfDCemaBzgtSYdVnuvLYUmKc4pgGLQEjmP1K1Wn4eoKTp4): protocol: write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection; write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection
Aug 28 00:02:26.651417919 (6h24m5.814018857s) [seg_pos={0 0}, upload=6670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 00:02:26.651486902 (6h24m5.81408784s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 00:02:26.651491911 (6h24m5.814092849s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:02:27.020461705 (6h24m6.183062693s) [upload=6670]: Done uploading segments...
Aug 28 00:02:27.020488887 (6h24m6.183089855s) [upload=6670]: Upload finished. err: <nil>
Duration: 6.15447689s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X.........X.........................] duration:
5.939272474s
FAIL (2025-08-28 00:20:04 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 28 00:02:23.923155885 (6h24m3.085756823s) [upload=6670]: Starting upload
Aug 28 00:02:23.923199688 (6h24m3.085800627s) [upload=6670]: Done starting upload
Aug 28 00:02:23.923460819 (6h24m3.086061767s) [upload=6670]: Uploading segments...
Aug 28 00:02:23.923505423 (6h24m3.086106371s) [upload=6670]: Got next segment. Inline: false
Aug 28 00:02:23.923536153 (6h24m3.086137091s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:02:23.923540992 (6h24m3.08614193s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 28 00:02:24.426354873 (6h24m3.588955821s) [seg_pos={0 0}, upload=6670]: Begin upload segment...
Aug 28 00:02:24.426400620 (6h24m3.589001558s) [seg_pos={0 0}, upload=6670]: Done begin upload segment.
Aug 28 00:02:24.426424225 (6h24m3.589025173s) [noise=true , address=104.36.82.11:4126 , piece_id=LQQLXKQEMTHLRT5T6BUA5ZKR66DX6IPK6NFJSHK4UH3EFJCRWYNQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.426960422 (6h24m3.58956136s) [noise=true , address=104.36.82.23:4465 , piece_id=2OY74SADPQW3XQ3DQ5OGPGPIOMHPBHMLR5UCNHBI2AROEVS27XUQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.427334707 (6h24m3.589935645s) [noise=true , address=79.127.201.215:4349 , piece_id=EXX4WFDITVDHZO4OD2N2LJAHGAULHMW4ZG2KTWXOMMJC6SRWXG6A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.427673316 (6h24m3.590274254s) [noise=true , address=77.90.31.10:4534 , piece_id=RWGGQZVW5JMW3MVQXLIPHZSO24TBBLPBEADPECUEHJ5L6DDKKYXA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428056679 (6h24m3.590657617s) [noise=true , address=104.36.82.52:4088 , piece_id=Z66QHKACKMOCUR5G6HN6SS24NO6OPC4OXXAYNEX5OQUXTK6HUE2Q, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428497553 (6h24m3.591098491s) [noise=true , address=45.91.116.5:4308 , piece_id=AV3IRIYHRDEL3CEKUGQNSBPFYROFUHYESV6K3IECMVUTDHCKT5IA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.428769784 (6h24m3.591370722s) [noise=true , address=104.36.82.10:4092 , piece_id=ZPLSKEV76BLLIW3JP46OIBROYXLC7VGPQBKSG6HNAOAPKYCD7FIA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429019251 (6h24m3.591620189s) [noise=true , address=77.90.31.15:4706 , piece_id=C3UR5IYTKKY4TFGA5ARS6TJ5EPOIEHXMXBD2CXCHSR7N3L5VVR3A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429237589 (6h24m3.591838527s) [noise=true , address=45.91.116.8:4055 , piece_id=GVS4B5Z7VTBFWOJRLHMNRYJXVO3ANTCAQQSFHGH4XS7T7ODWJ2LA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.429539476 (6h24m3.592140414s) [noise=true , address=77.90.31.18:4831 , piece_id=UO7R4VDIIHZTCU2RRYLWDRTRGFP7DOBOFSR3ETFNMMFJ3YCWPCVA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.430067837 (6h24m3.592668785s) [noise=true , address=77.90.31.21:4905 , piece_id=QHA7YNE6X5MAMP6AOKWC5XL27LHUQSBSZOMEPENHZCNWCUAJWGIA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.430494484 (6h24m3.593095422s) [noise=true , address=104.36.82.21:4474 , piece_id=CKWLNR5RX3L7CV7SMASZLIO5LQ4QMITNBEV5RUTAPGXZJCR6NRVA, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.431087939 (6h24m3.593688877s) [noise=true , address=64.49.13.137:4503 , piece_id=LVL7A6O3SKXLBFKIMNSTOATIFC3FW3CVDHCUTY7SLAPMIGLIRF4A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.431608284 (6h24m3.594209222s) [noise=true , address=77.90.31.12:4620 , piece_id=6CBBFVWQP2QJOF6DK2UHKYLV7S6JH2NBUYLOHZ5SJ4PU4SGQACEQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.432216939 (6h24m3.594817877s) [noise=true , address=45.91.116.9:4292 , piece_id=HSCCMYWV5U64B6NTLRVUVSSQJ6LIXNEMIHWZG2AREMRIZ35EXUMQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.432758175 (6h24m3.595359113s) [noise=true , address=104.36.82.45:4923 , piece_id=6VG5FMN2IURBCOEW4KDJQRTRHYNWTQNVV6HCNQGHAVQDELV2HX5Q, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.433421123 (6h24m3.596022061s) [noise=true , address=104.36.82.60:4372 , piece_id=LSBL5RLSSV4NADN7ZKGV3U7IJVGJJMGVCNXHABTLK7CHQBOFNGHQ, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:24.434005923 (6h24m3.596606861s) [noise=true , address=45.91.116.4:4950 , piece_id=VFD56IP7477BFT7IC66W3KNYHUABGJ22FZDLM6VIXD3CSFYI6G3A, seg_pos={0 0}, upload=6670]: Uploading piece...
Aug 28 00:02:25.681012859 (6h24m4.843613787s) [upload=6670]: Next returned nil segment
Aug 28 00:02:25.681027897 (6h24m4.843628825s) [upload=6670]: Waiting for error group managing segments...
Aug 28 00:02:25.997730649 (6h24m5.160331587s) [noise=true , address=64.49.13.137:4503 , piece_id=LVL7A6O3SKXLBFKIMNSTOATIFC3FW3CVDHCUTY7SLAPMIGLIRF4A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.337587369 (6h24m5.500188317s) [noise=true , address=45.91.116.4:4950 , piece_id=VFD56IP7477BFT7IC66W3KNYHUABGJ22FZDLM6VIXD3CSFYI6G3A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.340075720 (6h24m5.502676658s) [noise=true , address=45.91.116.8:4055 , piece_id=GVS4B5Z7VTBFWOJRLHMNRYJXVO3ANTCAQQSFHGH4XS7T7ODWJ2LA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.447917764 (6h24m5.610518702s) [noise=true , address=104.36.82.60:4372 , piece_id=LSBL5RLSSV4NADN7ZKGV3U7IJVGJJMGVCNXHABTLK7CHQBOFNGHQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.465307006 (6h24m5.627907944s) [noise=true , address=104.36.82.11:4126 , piece_id=LQQLXKQEMTHLRT5T6BUA5ZKR66DX6IPK6NFJSHK4UH3EFJCRWYNQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.511372057 (6h24m5.673972995s) [noise=true , address=104.36.82.45:4923 , piece_id=6VG5FMN2IURBCOEW4KDJQRTRHYNWTQNVV6HCNQGHAVQDELV2HX5Q, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.546096849 (6h24m5.708697787s) [noise=true , address=77.90.31.10:4534 , piece_id=RWGGQZVW5JMW3MVQXLIPHZSO24TBBLPBEADPECUEHJ5L6DDKKYXA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.546637023 (6h24m5.709237961s) [noise=true , address=77.90.31.21:4905 , piece_id=QHA7YNE6X5MAMP6AOKWC5XL27LHUQSBSZOMEPENHZCNWCUAJWGIA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.583776435 (6h24m5.746377373s) [noise=true , address=104.36.82.52:4088 , piece_id=Z66QHKACKMOCUR5G6HN6SS24NO6OPC4OXXAYNEX5OQUXTK6HUE2Q, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.584868465 (6h24m5.747469413s) [noise=true , address=79.127.201.215:4349 , piece_id=EXX4WFDITVDHZO4OD2N2LJAHGAULHMW4ZG2KTWXOMMJC6SRWXG6A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.587202931 (6h24m5.749803869s) [noise=true , address=77.90.31.15:4706 , piece_id=C3UR5IYTKKY4TFGA5ARS6TJ5EPOIEHXMXBD2CXCHSR7N3L5VVR3A, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.626825265 (6h24m5.789426203s) [noise=true , address=77.90.31.12:4620 , piece_id=6CBBFVWQP2QJOF6DK2UHKYLV7S6JH2NBUYLOHZ5SJ4PU4SGQACEQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.649643004 (6h24m5.812243942s) [noise=true , address=104.36.82.23:4465 , piece_id=2OY74SADPQW3XQ3DQ5OGPGPIOMHPBHMLR5UCNHBI2AROEVS27XUQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.651015610 (6h24m5.813616548s) [noise=true , address=45.91.116.9:4292 , piece_id=HSCCMYWV5U64B6NTLRVUVSSQJ6LIXNEMIHWZG2AREMRIZ35EXUMQ, seg_pos={0 0}, upload=6670]: Done uploading piece. err: <nil>
Aug 28 00:02:26.651023525 (6h24m5.813624463s) [seg_pos={0 0}, upload=6670]: Segment reached optimal threshold of 14 pieces.
Aug 28 00:02:26.651139286 (6h24m5.813740224s) [noise=true , address=77.90.31.18:4831 , piece_id=UO7R4VDIIHZTCU2RRYLWDRTRGFP7DOBOFSR3ETFNMMFJ3YCWPCVA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1NenCLQMH3bdNj59r7KjQdMmwqe96gtBJdbj3faWuM2Ym3BDbA): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651278823 (6h24m5.813879761s) [noise=true , address=104.36.82.10:4092 , piece_id=ZPLSKEV76BLLIW3JP46OIBROYXLC7VGPQBKSG6HNAOAPKYCD7FIA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:128P9omT47U7tm1k4XdeUR5vd1VAqskCvyfjF6VDy1ncwMDoZm9): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651330502 (6h24m5.81393143s) [noise=true , address=104.36.82.21:4474 , piece_id=CKWLNR5RX3L7CV7SMASZLIO5LQ4QMITNBEV5RUTAPGXZJCR6NRVA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rL2DnjSgHP36Md3bCgy5padqTAhv3iQCeURbLMuuuMBxtUNZH): protocol: expected piece hash; context canceled; EOF
Aug 28 00:02:26.651408782 (6h24m5.81400972s) [noise=true , address=45.91.116.5:4308 , piece_id=AV3IRIYHRDEL3CEKUGQNSBPFYROFUHYESV6K3IECMVUTDHCKT5IA, seg_pos={0 0}, upload=6670]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ArtdfDCemaBzgtSYdVnuvLYUmKc4pgGLQEjmP1K1Wn4eoKTp4): protocol: write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection; write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:58226->45.91.116.5:4308: use of closed network connection
Aug 28 00:02:26.651417919 (6h24m5.814018857s) [seg_pos={0 0}, upload=6670]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 28 00:02:26.651486902 (6h24m5.81408784s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 28 00:02:26.651491911 (6h24m5.814092849s) [upload=6670]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:02:27.020461705 (6h24m6.183062693s) [upload=6670]: Done uploading segments...
Aug 28 00:02:27.020488887 (6h24m6.183089855s) [upload=6670]: Upload finished. err: <nil>
Duration: 5.939308674s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................X.............X...............] duration:
2.171190959s
FAIL (2025-08-28 00:19:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 28 00:08:39.946107615 (6h30m19.108708543s) [upload=6782]: Starting upload
Aug 28 00:08:39.946195383 (6h30m19.108796321s) [upload=6782]: Done starting upload
Aug 28 00:08:39.946359467 (6h30m19.108960405s) [upload=6782]: Uploading segments...
Aug 28 00:08:39.946441875 (6h30m19.109042813s) [upload=6782]: Got next segment. Inline: true
Aug 28 00:08:39.946451073 (6h30m19.109052001s) [upload=6782]: Waiting for error group managing segments...
Aug 28 00:08:39.946497401 (6h30m19.109098339s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:08:39.946524172 (6h30m19.10912511s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 00:08:39.946528090 (6h30m19.109129028s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:08:40.429352462 (6h30m19.5919534s) [upload=6782]: Done uploading segments...
Aug 28 00:08:40.429381938 (6h30m19.591982866s) [upload=6782]: Upload finished. err: <nil>
Duration: 2.171216558s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................X.............X..............] duration:
2.137389605s
FAIL (2025-08-28 00:19:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 28 00:08:39.946107615 (6h30m19.108708543s) [upload=6782]: Starting upload
Aug 28 00:08:39.946195383 (6h30m19.108796321s) [upload=6782]: Done starting upload
Aug 28 00:08:39.946359467 (6h30m19.108960405s) [upload=6782]: Uploading segments...
Aug 28 00:08:39.946441875 (6h30m19.109042813s) [upload=6782]: Got next segment. Inline: true
Aug 28 00:08:39.946451073 (6h30m19.109052001s) [upload=6782]: Waiting for error group managing segments...
Aug 28 00:08:39.946497401 (6h30m19.109098339s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 28 00:08:39.946524172 (6h30m19.10912511s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 28 00:08:39.946528090 (6h30m19.109129028s) [upload=6782]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 28 00:08:40.429352462 (6h30m19.5919534s) [upload=6782]: Done uploading segments...
Aug 28 00:08:40.429381938 (6h30m19.591982866s) [upload=6782]: Upload finished. err: <nil>
Duration: 2.137413772s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|