Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..X.....X...............X..X.......X.............X......X...] duration:
1.883130065s
FAIL (2025-08-21 04:45:42 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 04:43:58.261270899 (299h17m52.69235103s) [upload=311314]: Starting upload Aug 21 04:43:58.261319722 (299h17m52.692399853s) [upload=311314]: Done starting upload Aug 21 04:43:58.261395798 (299h17m52.692475969s) [upload=311314]: Uploading segments... Aug 21 04:43:58.261485630 (299h17m52.692565761s) [upload=311314]: Got next segment. Inline: true Aug 21 04:43:58.261492492 (299h17m52.692572623s) [upload=311314]: Waiting for error group managing segments... Aug 21 04:43:58.261549602 (299h17m52.692629783s) [upload=311314]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:43:58.261556866 (299h17m52.692637027s) [upload=311314]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:43:58.261560924 (299h17m52.692641085s) [upload=311314]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:43:58.538064179 (299h17m52.969144311s) [upload=311314]: Done uploading segments... Aug 21 04:43:58.538082745 (299h17m52.969162876s) [upload=311314]: Upload finished. err: <nil>
Duration: 1.883193196s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X....................X........] duration:
5.512417021s
FAIL (2025-08-21 04:45:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3b02c2fd9d84ba0f6aef52cf687115f1327b368c801c242529568a00806c3e80 != before 190a616c6a3fe0c9c6e512d4a48c0bc1e56495912ea4a436075f2ccfd579e22e
======LOGS======
Aug 21 04:39:09.895454268 (299h13m4.32653444s) [upload=311230]: Starting upload
Aug 21 04:39:09.895549170 (299h13m4.326629301s) [upload=311230]: Done starting upload
Aug 21 04:39:09.895598835 (299h13m4.326679016s) [upload=311230]: Uploading segments...
Aug 21 04:39:09.895944957 (299h13m4.327025129s) [upload=311230]: Got next segment. Inline: false
Aug 21 04:39:09.896015852 (299h13m4.327096034s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:39:09.896025411 (299h13m4.327105583s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 04:39:10.340804962 (299h13m4.771885093s) [seg_pos={0 0}, upload=311230]: Begin upload segment...
Aug 21 04:39:10.340867792 (299h13m4.771947923s) [seg_pos={0 0}, upload=311230]: Done begin upload segment.
Aug 21 04:39:10.340878973 (299h13m4.771959094s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.340890496 (299h13m4.771970617s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341241347 (299h13m4.772321468s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341282756 (299h13m4.772362877s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341603861 (299h13m4.772683992s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341896901 (299h13m4.772977032s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342133504 (299h13m4.773213635s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342431774 (299h13m4.773511906s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342697082 (299h13m4.773777213s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342960796 (299h13m4.774040927s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343188382 (299h13m4.774268513s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343409915 (299h13m4.774490036s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343784532 (299h13m4.774864654s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344009683 (299h13m4.775089814s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344213594 (299h13m4.775293725s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344463161 (299h13m4.775543292s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344826677 (299h13m4.775906808s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.345031438 (299h13m4.776111569s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:11.839421517 (299h13m6.270501648s) [upload=311230]: Next returned nil segment
Aug 21 04:39:11.839440394 (299h13m6.270520515s) [upload=311230]: Waiting for error group managing segments...
Aug 21 04:39:12.217548757 (299h13m6.648628888s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.250432746 (299h13m6.681512877s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.272847113 (299h13m6.703927244s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.274153573 (299h13m6.705233704s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.277750345 (299h13m6.708830466s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.278246494 (299h13m6.709326626s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.297265335 (299h13m6.728345466s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.303950806 (299h13m6.735030938s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.311795075 (299h13m6.742875206s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.323189167 (299h13m6.754269298s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.325878382 (299h13m6.756958513s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.330951820 (299h13m6.762031981s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.343944860 (299h13m6.775024981s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352859487 (299h13m6.783939618s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352874315 (299h13m6.783954446s) [seg_pos={0 0}, upload=311230]: Segment reached optimal threshold of 14 pieces.
Aug 21 04:39:12.352995728 (299h13m6.784075859s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353049470 (299h13m6.784129602s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353081672 (299h13m6.784161803s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15ASyGY7W2bUF5P7q7vS7rNhxBNG24ixU4ASAsGndm8RBLMiAF): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353123041 (299h13m6.784203172s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353136948 (299h13m6.784217079s) [seg_pos={0 0}, upload=311230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 04:39:12.353191702 (299h13m6.784271834s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 04:39:12.353195480 (299h13m6.784275611s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:39:12.794318184 (299h13m7.225398315s) [upload=311230]: Done uploading segments...
Aug 21 04:39:12.794337410 (299h13m7.225417541s) [upload=311230]: Upload finished. err: <nil>
Duration: 5.512444284s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...X.....X...............X..X.......X.............X......X..] duration:
1.859097591s
FAIL (2025-08-21 04:45:27 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 04:43:58.261270899 (299h17m52.69235103s) [upload=311314]: Starting upload Aug 21 04:43:58.261319722 (299h17m52.692399853s) [upload=311314]: Done starting upload Aug 21 04:43:58.261395798 (299h17m52.692475969s) [upload=311314]: Uploading segments... Aug 21 04:43:58.261485630 (299h17m52.692565761s) [upload=311314]: Got next segment. Inline: true Aug 21 04:43:58.261492492 (299h17m52.692572623s) [upload=311314]: Waiting for error group managing segments... Aug 21 04:43:58.261549602 (299h17m52.692629783s) [upload=311314]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:43:58.261556866 (299h17m52.692637027s) [upload=311314]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:43:58.261560924 (299h17m52.692641085s) [upload=311314]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:43:58.538064179 (299h17m52.969144311s) [upload=311314]: Done uploading segments... Aug 21 04:43:58.538082745 (299h17m52.969162876s) [upload=311314]: Upload finished. err: <nil>
Duration: 1.859131116s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X....................X.......] duration:
5.78099529s
FAIL (2025-08-21 04:44:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3b02c2fd9d84ba0f6aef52cf687115f1327b368c801c242529568a00806c3e80 != before 190a616c6a3fe0c9c6e512d4a48c0bc1e56495912ea4a436075f2ccfd579e22e
======LOGS======
Aug 21 04:39:09.895454268 (299h13m4.32653444s) [upload=311230]: Starting upload
Aug 21 04:39:09.895549170 (299h13m4.326629301s) [upload=311230]: Done starting upload
Aug 21 04:39:09.895598835 (299h13m4.326679016s) [upload=311230]: Uploading segments...
Aug 21 04:39:09.895944957 (299h13m4.327025129s) [upload=311230]: Got next segment. Inline: false
Aug 21 04:39:09.896015852 (299h13m4.327096034s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:39:09.896025411 (299h13m4.327105583s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 04:39:10.340804962 (299h13m4.771885093s) [seg_pos={0 0}, upload=311230]: Begin upload segment...
Aug 21 04:39:10.340867792 (299h13m4.771947923s) [seg_pos={0 0}, upload=311230]: Done begin upload segment.
Aug 21 04:39:10.340878973 (299h13m4.771959094s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.340890496 (299h13m4.771970617s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341241347 (299h13m4.772321468s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341282756 (299h13m4.772362877s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341603861 (299h13m4.772683992s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341896901 (299h13m4.772977032s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342133504 (299h13m4.773213635s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342431774 (299h13m4.773511906s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342697082 (299h13m4.773777213s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342960796 (299h13m4.774040927s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343188382 (299h13m4.774268513s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343409915 (299h13m4.774490036s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343784532 (299h13m4.774864654s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344009683 (299h13m4.775089814s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344213594 (299h13m4.775293725s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344463161 (299h13m4.775543292s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344826677 (299h13m4.775906808s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.345031438 (299h13m4.776111569s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:11.839421517 (299h13m6.270501648s) [upload=311230]: Next returned nil segment
Aug 21 04:39:11.839440394 (299h13m6.270520515s) [upload=311230]: Waiting for error group managing segments...
Aug 21 04:39:12.217548757 (299h13m6.648628888s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.250432746 (299h13m6.681512877s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.272847113 (299h13m6.703927244s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.274153573 (299h13m6.705233704s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.277750345 (299h13m6.708830466s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.278246494 (299h13m6.709326626s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.297265335 (299h13m6.728345466s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.303950806 (299h13m6.735030938s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.311795075 (299h13m6.742875206s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.323189167 (299h13m6.754269298s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.325878382 (299h13m6.756958513s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.330951820 (299h13m6.762031981s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.343944860 (299h13m6.775024981s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352859487 (299h13m6.783939618s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352874315 (299h13m6.783954446s) [seg_pos={0 0}, upload=311230]: Segment reached optimal threshold of 14 pieces.
Aug 21 04:39:12.352995728 (299h13m6.784075859s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353049470 (299h13m6.784129602s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353081672 (299h13m6.784161803s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15ASyGY7W2bUF5P7q7vS7rNhxBNG24ixU4ASAsGndm8RBLMiAF): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353123041 (299h13m6.784203172s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353136948 (299h13m6.784217079s) [seg_pos={0 0}, upload=311230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 04:39:12.353191702 (299h13m6.784271834s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 04:39:12.353195480 (299h13m6.784275611s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:39:12.794318184 (299h13m7.225398315s) [upload=311230]: Done uploading segments...
Aug 21 04:39:12.794337410 (299h13m7.225417541s) [upload=311230]: Upload finished. err: <nil>
Duration: 5.78101633s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [....X.....X...............X..X.......X.............X......X.] duration:
2.124128526s
FAIL (2025-08-21 04:44:27 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 04:43:58.261270899 (299h17m52.69235103s) [upload=311314]: Starting upload Aug 21 04:43:58.261319722 (299h17m52.692399853s) [upload=311314]: Done starting upload Aug 21 04:43:58.261395798 (299h17m52.692475969s) [upload=311314]: Uploading segments... Aug 21 04:43:58.261485630 (299h17m52.692565761s) [upload=311314]: Got next segment. Inline: true Aug 21 04:43:58.261492492 (299h17m52.692572623s) [upload=311314]: Waiting for error group managing segments... Aug 21 04:43:58.261549602 (299h17m52.692629783s) [upload=311314]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:43:58.261556866 (299h17m52.692637027s) [upload=311314]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:43:58.261560924 (299h17m52.692641085s) [upload=311314]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:43:58.538064179 (299h17m52.969144311s) [upload=311314]: Done uploading segments... Aug 21 04:43:58.538082745 (299h17m52.969162876s) [upload=311314]: Upload finished. err: <nil>
Duration: 2.124153764s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X....................X......] duration:
5.653494419s
FAIL (2025-08-21 04:44:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3b02c2fd9d84ba0f6aef52cf687115f1327b368c801c242529568a00806c3e80 != before 190a616c6a3fe0c9c6e512d4a48c0bc1e56495912ea4a436075f2ccfd579e22e
======LOGS======
Aug 21 04:39:09.895454268 (299h13m4.32653444s) [upload=311230]: Starting upload
Aug 21 04:39:09.895549170 (299h13m4.326629301s) [upload=311230]: Done starting upload
Aug 21 04:39:09.895598835 (299h13m4.326679016s) [upload=311230]: Uploading segments...
Aug 21 04:39:09.895944957 (299h13m4.327025129s) [upload=311230]: Got next segment. Inline: false
Aug 21 04:39:09.896015852 (299h13m4.327096034s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:39:09.896025411 (299h13m4.327105583s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 04:39:10.340804962 (299h13m4.771885093s) [seg_pos={0 0}, upload=311230]: Begin upload segment...
Aug 21 04:39:10.340867792 (299h13m4.771947923s) [seg_pos={0 0}, upload=311230]: Done begin upload segment.
Aug 21 04:39:10.340878973 (299h13m4.771959094s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.340890496 (299h13m4.771970617s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341241347 (299h13m4.772321468s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341282756 (299h13m4.772362877s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341603861 (299h13m4.772683992s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341896901 (299h13m4.772977032s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342133504 (299h13m4.773213635s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342431774 (299h13m4.773511906s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342697082 (299h13m4.773777213s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342960796 (299h13m4.774040927s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343188382 (299h13m4.774268513s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343409915 (299h13m4.774490036s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343784532 (299h13m4.774864654s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344009683 (299h13m4.775089814s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344213594 (299h13m4.775293725s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344463161 (299h13m4.775543292s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344826677 (299h13m4.775906808s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.345031438 (299h13m4.776111569s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:11.839421517 (299h13m6.270501648s) [upload=311230]: Next returned nil segment
Aug 21 04:39:11.839440394 (299h13m6.270520515s) [upload=311230]: Waiting for error group managing segments...
Aug 21 04:39:12.217548757 (299h13m6.648628888s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.250432746 (299h13m6.681512877s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.272847113 (299h13m6.703927244s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.274153573 (299h13m6.705233704s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.277750345 (299h13m6.708830466s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.278246494 (299h13m6.709326626s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.297265335 (299h13m6.728345466s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.303950806 (299h13m6.735030938s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.311795075 (299h13m6.742875206s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.323189167 (299h13m6.754269298s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.325878382 (299h13m6.756958513s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.330951820 (299h13m6.762031981s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.343944860 (299h13m6.775024981s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352859487 (299h13m6.783939618s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352874315 (299h13m6.783954446s) [seg_pos={0 0}, upload=311230]: Segment reached optimal threshold of 14 pieces.
Aug 21 04:39:12.352995728 (299h13m6.784075859s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353049470 (299h13m6.784129602s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353081672 (299h13m6.784161803s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15ASyGY7W2bUF5P7q7vS7rNhxBNG24ixU4ASAsGndm8RBLMiAF): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353123041 (299h13m6.784203172s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353136948 (299h13m6.784217079s) [seg_pos={0 0}, upload=311230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 04:39:12.353191702 (299h13m6.784271834s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 04:39:12.353195480 (299h13m6.784275611s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:39:12.794318184 (299h13m7.225398315s) [upload=311230]: Done uploading segments...
Aug 21 04:39:12.794337410 (299h13m7.225417541s) [upload=311230]: Upload finished. err: <nil>
Duration: 5.653517543s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.....X.....X...............X..X.......X.............X......X] duration:
1.373839793s
FAIL (2025-08-21 04:43:58 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 21 04:43:58.261270899 (299h17m52.69235103s) [upload=311314]: Starting upload Aug 21 04:43:58.261319722 (299h17m52.692399853s) [upload=311314]: Done starting upload Aug 21 04:43:58.261395798 (299h17m52.692475969s) [upload=311314]: Uploading segments... Aug 21 04:43:58.261485630 (299h17m52.692565761s) [upload=311314]: Got next segment. Inline: true Aug 21 04:43:58.261492492 (299h17m52.692572623s) [upload=311314]: Waiting for error group managing segments... Aug 21 04:43:58.261549602 (299h17m52.692629783s) [upload=311314]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:43:58.261556866 (299h17m52.692637027s) [upload=311314]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:43:58.261560924 (299h17m52.692641085s) [upload=311314]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:43:58.538064179 (299h17m52.969144311s) [upload=311314]: Done uploading segments... Aug 21 04:43:58.538082745 (299h17m52.969162876s) [upload=311314]: Upload finished. err: <nil>
Duration: 1.373868207s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X....................X.....] duration:
5.613761692s
FAIL (2025-08-21 04:43:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3b02c2fd9d84ba0f6aef52cf687115f1327b368c801c242529568a00806c3e80 != before 190a616c6a3fe0c9c6e512d4a48c0bc1e56495912ea4a436075f2ccfd579e22e
======LOGS======
Aug 21 04:39:09.895454268 (299h13m4.32653444s) [upload=311230]: Starting upload
Aug 21 04:39:09.895549170 (299h13m4.326629301s) [upload=311230]: Done starting upload
Aug 21 04:39:09.895598835 (299h13m4.326679016s) [upload=311230]: Uploading segments...
Aug 21 04:39:09.895944957 (299h13m4.327025129s) [upload=311230]: Got next segment. Inline: false
Aug 21 04:39:09.896015852 (299h13m4.327096034s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:39:09.896025411 (299h13m4.327105583s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 04:39:10.340804962 (299h13m4.771885093s) [seg_pos={0 0}, upload=311230]: Begin upload segment...
Aug 21 04:39:10.340867792 (299h13m4.771947923s) [seg_pos={0 0}, upload=311230]: Done begin upload segment.
Aug 21 04:39:10.340878973 (299h13m4.771959094s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.340890496 (299h13m4.771970617s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341241347 (299h13m4.772321468s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341282756 (299h13m4.772362877s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341603861 (299h13m4.772683992s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341896901 (299h13m4.772977032s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342133504 (299h13m4.773213635s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342431774 (299h13m4.773511906s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342697082 (299h13m4.773777213s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342960796 (299h13m4.774040927s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343188382 (299h13m4.774268513s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343409915 (299h13m4.774490036s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343784532 (299h13m4.774864654s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344009683 (299h13m4.775089814s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344213594 (299h13m4.775293725s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344463161 (299h13m4.775543292s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344826677 (299h13m4.775906808s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.345031438 (299h13m4.776111569s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:11.839421517 (299h13m6.270501648s) [upload=311230]: Next returned nil segment
Aug 21 04:39:11.839440394 (299h13m6.270520515s) [upload=311230]: Waiting for error group managing segments...
Aug 21 04:39:12.217548757 (299h13m6.648628888s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.250432746 (299h13m6.681512877s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.272847113 (299h13m6.703927244s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.274153573 (299h13m6.705233704s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.277750345 (299h13m6.708830466s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.278246494 (299h13m6.709326626s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.297265335 (299h13m6.728345466s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.303950806 (299h13m6.735030938s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.311795075 (299h13m6.742875206s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.323189167 (299h13m6.754269298s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.325878382 (299h13m6.756958513s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.330951820 (299h13m6.762031981s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.343944860 (299h13m6.775024981s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352859487 (299h13m6.783939618s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352874315 (299h13m6.783954446s) [seg_pos={0 0}, upload=311230]: Segment reached optimal threshold of 14 pieces.
Aug 21 04:39:12.352995728 (299h13m6.784075859s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353049470 (299h13m6.784129602s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353081672 (299h13m6.784161803s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15ASyGY7W2bUF5P7q7vS7rNhxBNG24ixU4ASAsGndm8RBLMiAF): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353123041 (299h13m6.784203172s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353136948 (299h13m6.784217079s) [seg_pos={0 0}, upload=311230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 04:39:12.353191702 (299h13m6.784271834s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 04:39:12.353195480 (299h13m6.784275611s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:39:12.794318184 (299h13m7.225398315s) [upload=311230]: Done uploading segments...
Aug 21 04:39:12.794337410 (299h13m7.225417541s) [upload=311230]: Upload finished. err: <nil>
Duration: 5.613790518s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [X.....X.....X...............X..X.......X.............X......] duration:
1.946340811s
FAIL (2025-08-21 04:43:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 04:40:11.422062822 (299h14m5.853142953s) [upload=311248]: Starting upload
Aug 21 04:40:11.422107547 (299h14m5.853187678s) [upload=311248]: Done starting upload
Aug 21 04:40:11.422162803 (299h14m5.853242934s) [upload=311248]: Uploading segments...
Aug 21 04:40:11.422264939 (299h14m5.85334507s) [upload=311248]: Got next segment. Inline: true
Aug 21 04:40:11.422270589 (299h14m5.85335072s) [upload=311248]: Waiting for error group managing segments...
Aug 21 04:40:11.422322409 (299h14m5.85340254s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:40:11.422327007 (299h14m5.853407138s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 04:40:11.422329443 (299h14m5.853409574s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:40:11.690009725 (299h14m6.121089856s) [upload=311248]: Done uploading segments...
Aug 21 04:40:11.690031115 (299h14m6.121111246s) [upload=311248]: Upload finished. err: <nil>
Duration: 1.946369546s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X....................X....] duration:
5.545907865s
FAIL (2025-08-21 04:43:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3b02c2fd9d84ba0f6aef52cf687115f1327b368c801c242529568a00806c3e80 != before 190a616c6a3fe0c9c6e512d4a48c0bc1e56495912ea4a436075f2ccfd579e22e
======LOGS======
Aug 21 04:39:09.895454268 (299h13m4.32653444s) [upload=311230]: Starting upload
Aug 21 04:39:09.895549170 (299h13m4.326629301s) [upload=311230]: Done starting upload
Aug 21 04:39:09.895598835 (299h13m4.326679016s) [upload=311230]: Uploading segments...
Aug 21 04:39:09.895944957 (299h13m4.327025129s) [upload=311230]: Got next segment. Inline: false
Aug 21 04:39:09.896015852 (299h13m4.327096034s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:39:09.896025411 (299h13m4.327105583s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 04:39:10.340804962 (299h13m4.771885093s) [seg_pos={0 0}, upload=311230]: Begin upload segment...
Aug 21 04:39:10.340867792 (299h13m4.771947923s) [seg_pos={0 0}, upload=311230]: Done begin upload segment.
Aug 21 04:39:10.340878973 (299h13m4.771959094s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.340890496 (299h13m4.771970617s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341241347 (299h13m4.772321468s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341282756 (299h13m4.772362877s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341603861 (299h13m4.772683992s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341896901 (299h13m4.772977032s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342133504 (299h13m4.773213635s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342431774 (299h13m4.773511906s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342697082 (299h13m4.773777213s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342960796 (299h13m4.774040927s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343188382 (299h13m4.774268513s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343409915 (299h13m4.774490036s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343784532 (299h13m4.774864654s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344009683 (299h13m4.775089814s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344213594 (299h13m4.775293725s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344463161 (299h13m4.775543292s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344826677 (299h13m4.775906808s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.345031438 (299h13m4.776111569s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:11.839421517 (299h13m6.270501648s) [upload=311230]: Next returned nil segment
Aug 21 04:39:11.839440394 (299h13m6.270520515s) [upload=311230]: Waiting for error group managing segments...
Aug 21 04:39:12.217548757 (299h13m6.648628888s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.250432746 (299h13m6.681512877s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.272847113 (299h13m6.703927244s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.274153573 (299h13m6.705233704s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.277750345 (299h13m6.708830466s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.278246494 (299h13m6.709326626s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.297265335 (299h13m6.728345466s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.303950806 (299h13m6.735030938s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.311795075 (299h13m6.742875206s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.323189167 (299h13m6.754269298s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.325878382 (299h13m6.756958513s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.330951820 (299h13m6.762031981s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.343944860 (299h13m6.775024981s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352859487 (299h13m6.783939618s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352874315 (299h13m6.783954446s) [seg_pos={0 0}, upload=311230]: Segment reached optimal threshold of 14 pieces.
Aug 21 04:39:12.352995728 (299h13m6.784075859s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353049470 (299h13m6.784129602s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353081672 (299h13m6.784161803s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15ASyGY7W2bUF5P7q7vS7rNhxBNG24ixU4ASAsGndm8RBLMiAF): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353123041 (299h13m6.784203172s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353136948 (299h13m6.784217079s) [seg_pos={0 0}, upload=311230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 04:39:12.353191702 (299h13m6.784271834s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 04:39:12.353195480 (299h13m6.784275611s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:39:12.794318184 (299h13m7.225398315s) [upload=311230]: Done uploading segments...
Aug 21 04:39:12.794337410 (299h13m7.225417541s) [upload=311230]: Upload finished. err: <nil>
Duration: 5.545933194s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.X.....X.....X...............X..X.......X.............X.....] duration:
1.813447305s
FAIL (2025-08-21 04:42:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 04:40:11.422062822 (299h14m5.853142953s) [upload=311248]: Starting upload
Aug 21 04:40:11.422107547 (299h14m5.853187678s) [upload=311248]: Done starting upload
Aug 21 04:40:11.422162803 (299h14m5.853242934s) [upload=311248]: Uploading segments...
Aug 21 04:40:11.422264939 (299h14m5.85334507s) [upload=311248]: Got next segment. Inline: true
Aug 21 04:40:11.422270589 (299h14m5.85335072s) [upload=311248]: Waiting for error group managing segments...
Aug 21 04:40:11.422322409 (299h14m5.85340254s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:40:11.422327007 (299h14m5.853407138s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 04:40:11.422329443 (299h14m5.853409574s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:40:11.690009725 (299h14m6.121089856s) [upload=311248]: Done uploading segments...
Aug 21 04:40:11.690031115 (299h14m6.121111246s) [upload=311248]: Upload finished. err: <nil>
Duration: 1.813481692s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X....................X...] duration:
5.919414711s
FAIL (2025-08-21 04:42:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3b02c2fd9d84ba0f6aef52cf687115f1327b368c801c242529568a00806c3e80 != before 190a616c6a3fe0c9c6e512d4a48c0bc1e56495912ea4a436075f2ccfd579e22e
======LOGS======
Aug 21 04:39:09.895454268 (299h13m4.32653444s) [upload=311230]: Starting upload
Aug 21 04:39:09.895549170 (299h13m4.326629301s) [upload=311230]: Done starting upload
Aug 21 04:39:09.895598835 (299h13m4.326679016s) [upload=311230]: Uploading segments...
Aug 21 04:39:09.895944957 (299h13m4.327025129s) [upload=311230]: Got next segment. Inline: false
Aug 21 04:39:09.896015852 (299h13m4.327096034s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:39:09.896025411 (299h13m4.327105583s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 04:39:10.340804962 (299h13m4.771885093s) [seg_pos={0 0}, upload=311230]: Begin upload segment...
Aug 21 04:39:10.340867792 (299h13m4.771947923s) [seg_pos={0 0}, upload=311230]: Done begin upload segment.
Aug 21 04:39:10.340878973 (299h13m4.771959094s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.340890496 (299h13m4.771970617s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341241347 (299h13m4.772321468s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341282756 (299h13m4.772362877s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341603861 (299h13m4.772683992s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341896901 (299h13m4.772977032s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342133504 (299h13m4.773213635s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342431774 (299h13m4.773511906s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342697082 (299h13m4.773777213s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342960796 (299h13m4.774040927s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343188382 (299h13m4.774268513s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343409915 (299h13m4.774490036s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343784532 (299h13m4.774864654s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344009683 (299h13m4.775089814s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344213594 (299h13m4.775293725s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344463161 (299h13m4.775543292s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344826677 (299h13m4.775906808s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.345031438 (299h13m4.776111569s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:11.839421517 (299h13m6.270501648s) [upload=311230]: Next returned nil segment
Aug 21 04:39:11.839440394 (299h13m6.270520515s) [upload=311230]: Waiting for error group managing segments...
Aug 21 04:39:12.217548757 (299h13m6.648628888s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.250432746 (299h13m6.681512877s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.272847113 (299h13m6.703927244s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.274153573 (299h13m6.705233704s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.277750345 (299h13m6.708830466s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.278246494 (299h13m6.709326626s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.297265335 (299h13m6.728345466s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.303950806 (299h13m6.735030938s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.311795075 (299h13m6.742875206s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.323189167 (299h13m6.754269298s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.325878382 (299h13m6.756958513s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.330951820 (299h13m6.762031981s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.343944860 (299h13m6.775024981s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352859487 (299h13m6.783939618s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352874315 (299h13m6.783954446s) [seg_pos={0 0}, upload=311230]: Segment reached optimal threshold of 14 pieces.
Aug 21 04:39:12.352995728 (299h13m6.784075859s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353049470 (299h13m6.784129602s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353081672 (299h13m6.784161803s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15ASyGY7W2bUF5P7q7vS7rNhxBNG24ixU4ASAsGndm8RBLMiAF): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353123041 (299h13m6.784203172s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353136948 (299h13m6.784217079s) [seg_pos={0 0}, upload=311230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 04:39:12.353191702 (299h13m6.784271834s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 04:39:12.353195480 (299h13m6.784275611s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:39:12.794318184 (299h13m7.225398315s) [upload=311230]: Done uploading segments...
Aug 21 04:39:12.794337410 (299h13m7.225417541s) [upload=311230]: Upload finished. err: <nil>
Duration: 5.919444228s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..X.....X.....X...............X..X.......X.............X....] duration:
1.985341254s
FAIL (2025-08-21 04:41:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 04:40:11.422062822 (299h14m5.853142953s) [upload=311248]: Starting upload
Aug 21 04:40:11.422107547 (299h14m5.853187678s) [upload=311248]: Done starting upload
Aug 21 04:40:11.422162803 (299h14m5.853242934s) [upload=311248]: Uploading segments...
Aug 21 04:40:11.422264939 (299h14m5.85334507s) [upload=311248]: Got next segment. Inline: true
Aug 21 04:40:11.422270589 (299h14m5.85335072s) [upload=311248]: Waiting for error group managing segments...
Aug 21 04:40:11.422322409 (299h14m5.85340254s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:40:11.422327007 (299h14m5.853407138s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 04:40:11.422329443 (299h14m5.853409574s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:40:11.690009725 (299h14m6.121089856s) [upload=311248]: Done uploading segments...
Aug 21 04:40:11.690031115 (299h14m6.121111246s) [upload=311248]: Upload finished. err: <nil>
Duration: 1.985363706s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X....................X..] duration:
5.564894026s
FAIL (2025-08-21 04:41:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3b02c2fd9d84ba0f6aef52cf687115f1327b368c801c242529568a00806c3e80 != before 190a616c6a3fe0c9c6e512d4a48c0bc1e56495912ea4a436075f2ccfd579e22e
======LOGS======
Aug 21 04:39:09.895454268 (299h13m4.32653444s) [upload=311230]: Starting upload
Aug 21 04:39:09.895549170 (299h13m4.326629301s) [upload=311230]: Done starting upload
Aug 21 04:39:09.895598835 (299h13m4.326679016s) [upload=311230]: Uploading segments...
Aug 21 04:39:09.895944957 (299h13m4.327025129s) [upload=311230]: Got next segment. Inline: false
Aug 21 04:39:09.896015852 (299h13m4.327096034s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:39:09.896025411 (299h13m4.327105583s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 04:39:10.340804962 (299h13m4.771885093s) [seg_pos={0 0}, upload=311230]: Begin upload segment...
Aug 21 04:39:10.340867792 (299h13m4.771947923s) [seg_pos={0 0}, upload=311230]: Done begin upload segment.
Aug 21 04:39:10.340878973 (299h13m4.771959094s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.340890496 (299h13m4.771970617s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341241347 (299h13m4.772321468s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341282756 (299h13m4.772362877s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341603861 (299h13m4.772683992s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341896901 (299h13m4.772977032s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342133504 (299h13m4.773213635s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342431774 (299h13m4.773511906s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342697082 (299h13m4.773777213s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342960796 (299h13m4.774040927s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343188382 (299h13m4.774268513s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343409915 (299h13m4.774490036s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343784532 (299h13m4.774864654s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344009683 (299h13m4.775089814s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344213594 (299h13m4.775293725s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344463161 (299h13m4.775543292s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344826677 (299h13m4.775906808s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.345031438 (299h13m4.776111569s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:11.839421517 (299h13m6.270501648s) [upload=311230]: Next returned nil segment
Aug 21 04:39:11.839440394 (299h13m6.270520515s) [upload=311230]: Waiting for error group managing segments...
Aug 21 04:39:12.217548757 (299h13m6.648628888s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.250432746 (299h13m6.681512877s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.272847113 (299h13m6.703927244s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.274153573 (299h13m6.705233704s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.277750345 (299h13m6.708830466s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.278246494 (299h13m6.709326626s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.297265335 (299h13m6.728345466s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.303950806 (299h13m6.735030938s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.311795075 (299h13m6.742875206s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.323189167 (299h13m6.754269298s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.325878382 (299h13m6.756958513s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.330951820 (299h13m6.762031981s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.343944860 (299h13m6.775024981s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352859487 (299h13m6.783939618s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352874315 (299h13m6.783954446s) [seg_pos={0 0}, upload=311230]: Segment reached optimal threshold of 14 pieces.
Aug 21 04:39:12.352995728 (299h13m6.784075859s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353049470 (299h13m6.784129602s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353081672 (299h13m6.784161803s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15ASyGY7W2bUF5P7q7vS7rNhxBNG24ixU4ASAsGndm8RBLMiAF): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353123041 (299h13m6.784203172s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353136948 (299h13m6.784217079s) [seg_pos={0 0}, upload=311230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 04:39:12.353191702 (299h13m6.784271834s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 04:39:12.353195480 (299h13m6.784275611s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:39:12.794318184 (299h13m7.225398315s) [upload=311230]: Done uploading segments...
Aug 21 04:39:12.794337410 (299h13m7.225417541s) [upload=311230]: Upload finished. err: <nil>
Duration: 5.564916489s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...X.....X.....X...............X..X.......X.............X...] duration:
2.016373871s
FAIL (2025-08-21 04:41:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 04:40:11.422062822 (299h14m5.853142953s) [upload=311248]: Starting upload
Aug 21 04:40:11.422107547 (299h14m5.853187678s) [upload=311248]: Done starting upload
Aug 21 04:40:11.422162803 (299h14m5.853242934s) [upload=311248]: Uploading segments...
Aug 21 04:40:11.422264939 (299h14m5.85334507s) [upload=311248]: Got next segment. Inline: true
Aug 21 04:40:11.422270589 (299h14m5.85335072s) [upload=311248]: Waiting for error group managing segments...
Aug 21 04:40:11.422322409 (299h14m5.85340254s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:40:11.422327007 (299h14m5.853407138s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 04:40:11.422329443 (299h14m5.853409574s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:40:11.690009725 (299h14m6.121089856s) [upload=311248]: Done uploading segments...
Aug 21 04:40:11.690031115 (299h14m6.121111246s) [upload=311248]: Upload finished. err: <nil>
Duration: 2.016392305s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [....X.....X.....X...............X..X.......X.............X..] duration:
1.834341644s
FAIL (2025-08-21 04:41:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 04:40:11.422062822 (299h14m5.853142953s) [upload=311248]: Starting upload
Aug 21 04:40:11.422107547 (299h14m5.853187678s) [upload=311248]: Done starting upload
Aug 21 04:40:11.422162803 (299h14m5.853242934s) [upload=311248]: Uploading segments...
Aug 21 04:40:11.422264939 (299h14m5.85334507s) [upload=311248]: Got next segment. Inline: true
Aug 21 04:40:11.422270589 (299h14m5.85335072s) [upload=311248]: Waiting for error group managing segments...
Aug 21 04:40:11.422322409 (299h14m5.85340254s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:40:11.422327007 (299h14m5.853407138s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 04:40:11.422329443 (299h14m5.853409574s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:40:11.690009725 (299h14m6.121089856s) [upload=311248]: Done uploading segments...
Aug 21 04:40:11.690031115 (299h14m6.121111246s) [upload=311248]: Upload finished. err: <nil>
Duration: 1.834371361s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.....X.....X.....X...............X..X.......X.............X.] duration:
2.045979146s
FAIL (2025-08-21 04:40:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 04:40:11.422062822 (299h14m5.853142953s) [upload=311248]: Starting upload
Aug 21 04:40:11.422107547 (299h14m5.853187678s) [upload=311248]: Done starting upload
Aug 21 04:40:11.422162803 (299h14m5.853242934s) [upload=311248]: Uploading segments...
Aug 21 04:40:11.422264939 (299h14m5.85334507s) [upload=311248]: Got next segment. Inline: true
Aug 21 04:40:11.422270589 (299h14m5.85335072s) [upload=311248]: Waiting for error group managing segments...
Aug 21 04:40:11.422322409 (299h14m5.85340254s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:40:11.422327007 (299h14m5.853407138s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 04:40:11.422329443 (299h14m5.853409574s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:40:11.690009725 (299h14m6.121089856s) [upload=311248]: Done uploading segments...
Aug 21 04:40:11.690031115 (299h14m6.121111246s) [upload=311248]: Upload finished. err: <nil>
Duration: 2.046014955s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X....................X.] duration:
5.492669508s
FAIL (2025-08-21 04:40:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3b02c2fd9d84ba0f6aef52cf687115f1327b368c801c242529568a00806c3e80 != before 190a616c6a3fe0c9c6e512d4a48c0bc1e56495912ea4a436075f2ccfd579e22e
======LOGS======
Aug 21 04:39:09.895454268 (299h13m4.32653444s) [upload=311230]: Starting upload
Aug 21 04:39:09.895549170 (299h13m4.326629301s) [upload=311230]: Done starting upload
Aug 21 04:39:09.895598835 (299h13m4.326679016s) [upload=311230]: Uploading segments...
Aug 21 04:39:09.895944957 (299h13m4.327025129s) [upload=311230]: Got next segment. Inline: false
Aug 21 04:39:09.896015852 (299h13m4.327096034s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:39:09.896025411 (299h13m4.327105583s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 04:39:10.340804962 (299h13m4.771885093s) [seg_pos={0 0}, upload=311230]: Begin upload segment...
Aug 21 04:39:10.340867792 (299h13m4.771947923s) [seg_pos={0 0}, upload=311230]: Done begin upload segment.
Aug 21 04:39:10.340878973 (299h13m4.771959094s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.340890496 (299h13m4.771970617s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341241347 (299h13m4.772321468s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341282756 (299h13m4.772362877s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341603861 (299h13m4.772683992s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341896901 (299h13m4.772977032s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342133504 (299h13m4.773213635s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342431774 (299h13m4.773511906s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342697082 (299h13m4.773777213s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342960796 (299h13m4.774040927s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343188382 (299h13m4.774268513s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343409915 (299h13m4.774490036s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343784532 (299h13m4.774864654s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344009683 (299h13m4.775089814s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344213594 (299h13m4.775293725s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344463161 (299h13m4.775543292s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344826677 (299h13m4.775906808s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.345031438 (299h13m4.776111569s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:11.839421517 (299h13m6.270501648s) [upload=311230]: Next returned nil segment
Aug 21 04:39:11.839440394 (299h13m6.270520515s) [upload=311230]: Waiting for error group managing segments...
Aug 21 04:39:12.217548757 (299h13m6.648628888s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.250432746 (299h13m6.681512877s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.272847113 (299h13m6.703927244s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.274153573 (299h13m6.705233704s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.277750345 (299h13m6.708830466s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.278246494 (299h13m6.709326626s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.297265335 (299h13m6.728345466s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.303950806 (299h13m6.735030938s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.311795075 (299h13m6.742875206s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.323189167 (299h13m6.754269298s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.325878382 (299h13m6.756958513s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.330951820 (299h13m6.762031981s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.343944860 (299h13m6.775024981s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352859487 (299h13m6.783939618s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352874315 (299h13m6.783954446s) [seg_pos={0 0}, upload=311230]: Segment reached optimal threshold of 14 pieces.
Aug 21 04:39:12.352995728 (299h13m6.784075859s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353049470 (299h13m6.784129602s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353081672 (299h13m6.784161803s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15ASyGY7W2bUF5P7q7vS7rNhxBNG24ixU4ASAsGndm8RBLMiAF): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353123041 (299h13m6.784203172s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353136948 (299h13m6.784217079s) [seg_pos={0 0}, upload=311230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 04:39:12.353191702 (299h13m6.784271834s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 04:39:12.353195480 (299h13m6.784275611s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:39:12.794318184 (299h13m7.225398315s) [upload=311230]: Done uploading segments...
Aug 21 04:39:12.794337410 (299h13m7.225417541s) [upload=311230]: Upload finished. err: <nil>
Duration: 5.492695888s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [......X.....X.....X...............X..X.......X.............X] duration:
1.56938435s
FAIL (2025-08-21 04:40:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 21 04:40:11.422062822 (299h14m5.853142953s) [upload=311248]: Starting upload
Aug 21 04:40:11.422107547 (299h14m5.853187678s) [upload=311248]: Done starting upload
Aug 21 04:40:11.422162803 (299h14m5.853242934s) [upload=311248]: Uploading segments...
Aug 21 04:40:11.422264939 (299h14m5.85334507s) [upload=311248]: Got next segment. Inline: true
Aug 21 04:40:11.422270589 (299h14m5.85335072s) [upload=311248]: Waiting for error group managing segments...
Aug 21 04:40:11.422322409 (299h14m5.85340254s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:40:11.422327007 (299h14m5.853407138s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 21 04:40:11.422329443 (299h14m5.853409574s) [upload=311248]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:40:11.690009725 (299h14m6.121089856s) [upload=311248]: Done uploading segments...
Aug 21 04:40:11.690031115 (299h14m6.121111246s) [upload=311248]: Upload finished. err: <nil>
Duration: 1.569412726s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.......X.....X.....X...............X..X.......X.............] duration:
1.821024743s
FAIL (2025-08-21 04:39:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.821047865s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X....................X] duration:
5.66863705s
FAIL (2025-08-21 04:39:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3b02c2fd9d84ba0f6aef52cf687115f1327b368c801c242529568a00806c3e80 != before 190a616c6a3fe0c9c6e512d4a48c0bc1e56495912ea4a436075f2ccfd579e22e
======LOGS======
Aug 21 04:39:09.895454268 (299h13m4.32653444s) [upload=311230]: Starting upload
Aug 21 04:39:09.895549170 (299h13m4.326629301s) [upload=311230]: Done starting upload
Aug 21 04:39:09.895598835 (299h13m4.326679016s) [upload=311230]: Uploading segments...
Aug 21 04:39:09.895944957 (299h13m4.327025129s) [upload=311230]: Got next segment. Inline: false
Aug 21 04:39:09.896015852 (299h13m4.327096034s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 21 04:39:09.896025411 (299h13m4.327105583s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 21 04:39:10.340804962 (299h13m4.771885093s) [seg_pos={0 0}, upload=311230]: Begin upload segment...
Aug 21 04:39:10.340867792 (299h13m4.771947923s) [seg_pos={0 0}, upload=311230]: Done begin upload segment.
Aug 21 04:39:10.340878973 (299h13m4.771959094s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.340890496 (299h13m4.771970617s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341241347 (299h13m4.772321468s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341282756 (299h13m4.772362877s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341603861 (299h13m4.772683992s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.341896901 (299h13m4.772977032s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342133504 (299h13m4.773213635s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342431774 (299h13m4.773511906s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342697082 (299h13m4.773777213s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.342960796 (299h13m4.774040927s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343188382 (299h13m4.774268513s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343409915 (299h13m4.774490036s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.343784532 (299h13m4.774864654s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344009683 (299h13m4.775089814s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344213594 (299h13m4.775293725s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344463161 (299h13m4.775543292s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.344826677 (299h13m4.775906808s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:10.345031438 (299h13m4.776111569s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Uploading piece...
Aug 21 04:39:11.839421517 (299h13m6.270501648s) [upload=311230]: Next returned nil segment
Aug 21 04:39:11.839440394 (299h13m6.270520515s) [upload=311230]: Waiting for error group managing segments...
Aug 21 04:39:12.217548757 (299h13m6.648628888s) [noise=true , address=79.127.219.51:4201 , piece_id=K7APTOTKL5TGFX5VUSUJDPQRSSM3YR7OYDUGEVSCWIDRBL6A2VOA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.250432746 (299h13m6.681512877s) [noise=true , address=77.90.31.19:4847 , piece_id=X7YSCHU3NI7UPAHMRWFGW7LLXZCZ6NMUOXMEN3OH5GW5UTTUL2XA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.272847113 (299h13m6.703927244s) [noise=true , address=79.127.219.48:4108 , piece_id=KTQ42XCCL3MMIAMYASQDBZC7VBUOXHFFJJHEH64FIOQJS2MX46GQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.274153573 (299h13m6.705233704s) [noise=true , address=77.90.31.10:4550 , piece_id=V4ETG34IXIV5TWV6HJ4B74OYPX3SK43ZF24KKX2WIEGHYHJV6D7A, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.277750345 (299h13m6.708830466s) [noise=true , address=104.36.82.19:4423 , piece_id=IYNWLU3VC6W33UKUMKKWIOU4E4K3RQSSIB3HJAAGNUVV5AFFCXNQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.278246494 (299h13m6.709326626s) [noise=true , address=77.90.31.16:4767 , piece_id=OPQYYTLFAPAGTTKVDAWBLPQKUT625XFJBUMRHYLGANN2AOLIVNJA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.297265335 (299h13m6.728345466s) [noise=true , address=45.91.116.8:4070 , piece_id=XA7FMBNSEW25XMCNFXTV2I6TCSXMB744QR7MLVMNY4QMV3LGMHMQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.303950806 (299h13m6.735030938s) [noise=true , address=77.90.31.21:4886 , piece_id=IEU3SVKOYEQYF5BWNQ6SWLQR56GGPFK4N63QVO6PWDLZ76UQKHYQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.311795075 (299h13m6.742875206s) [noise=true , address=104.36.82.19:4420 , piece_id=7UQSDPXNWTXDP5KLYN4477KISJREZGQGQH3LSS5HAC7QLNS7KQJQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.323189167 (299h13m6.754269298s) [noise=true , address=77.90.31.11:4563 , piece_id=OG67LSBLQST53VKQA77F7PHX66HB5HOK3L6PWV34E2E4GARSOCAA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.325878382 (299h13m6.756958513s) [noise=true , address=79.127.201.214:4322 , piece_id=67BQ6JQHFYNYHOMOXFAH3XLN5PVXLYU74TWUSK6HOXVDH54K6TNA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.330951820 (299h13m6.762031981s) [noise=true , address=104.36.82.5:4856 , piece_id=5DNKVZQR2S7HPWIGYPQWMHZYHWOQTXCB6ZYVZJBFUQ4LFR5MY7LQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.343944860 (299h13m6.775024981s) [noise=true , address=77.90.31.18:4828 , piece_id=IA2Q7VVQAUVAAW3QB47YRYWT5XEWEDBB6L4N4UT2OBDZORACKFQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352859487 (299h13m6.783939618s) [noise=true , address=45.91.116.12:4252 , piece_id=UN7FJH6737OLAWZV6W7RWUDOZ73G2XGUCYY2MFRTOVMHXTBXJIKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: <nil>
Aug 21 04:39:12.352874315 (299h13m6.783954446s) [seg_pos={0 0}, upload=311230]: Segment reached optimal threshold of 14 pieces.
Aug 21 04:39:12.352995728 (299h13m6.784075859s) [noise=true , address=104.36.82.60:4357 , piece_id=G5WVRKTT67KO23G6TAUZPJFAINP6JXEPS5VA6QC4D3RQIP6RGWQQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EmBobdmk16xm9girzx3asYwkhdCKKZCCPrBLwWTS4ujMdGmi): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353049470 (299h13m6.784129602s) [noise=true , address=104.36.82.37:4676 , piece_id=6JIHFYIZC4IHERI2LXTKEB2RJOTPAWY3FYDPQNMDXB5QAXQ75AWQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18yqKh7gMSrXWavfChEJRX7tV5rS9xTSo4SbmgPMtnYKfgbvF8): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353081672 (299h13m6.784161803s) [noise=true , address=77.90.31.17:4784 , piece_id=YIFSJQREUEHPRBFQQOPC6K5DW7XX2ULH3X36LQDQ27F6OXP4FSKA, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15ASyGY7W2bUF5P7q7vS7rNhxBNG24ixU4ASAsGndm8RBLMiAF): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353123041 (299h13m6.784203172s) [noise=true , address=104.36.82.50:4014 , piece_id=YU333HU5CTFEJGCDSS22PAMQ2BQLS4AZCTCU2NY6ASVDUOV2S7VQ, seg_pos={0 0}, upload=311230]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122mrzG2jkLjNdnrDVr6UMM2aw3wNNTaJMnNaUKdN8UwFUqLwVd): protocol: expected piece hash; context canceled; EOF
Aug 21 04:39:12.353136948 (299h13m6.784217079s) [seg_pos={0 0}, upload=311230]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 21 04:39:12.353191702 (299h13m6.784271834s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 21 04:39:12.353195480 (299h13m6.784275611s) [upload=311230]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 21 04:39:12.794318184 (299h13m7.225398315s) [upload=311230]: Done uploading segments...
Aug 21 04:39:12.794337410 (299h13m7.225417541s) [upload=311230]: Upload finished. err: <nil>
Duration: 5.668663431s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [........X.....X.....X...............X..X.......X............] duration:
1.811690173s
FAIL (2025-08-21 04:39:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.811708068s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [X........X.....X.....X...............X..X.......X...........] duration:
1.876121004s
FAIL (2025-08-21 04:38:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.876157564s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.541122707s
FAIL (2025-08-21 04:38:35 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.541193291s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.605532816s
FAIL (2025-08-21 04:38:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.605562463s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.X........X.....X.....X...............X..X.......X..........] duration:
1.824200079s
FAIL (2025-08-21 04:37:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.824226429s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.973805892s
FAIL (2025-08-21 04:36:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.973834648s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..X........X.....X.....X...............X..X.......X.........] duration:
1.866618983s
FAIL (2025-08-21 04:36:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.866641576s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...X........X.....X.....X...............X..X.......X........] duration:
1.823233389s
FAIL (2025-08-21 04:36:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.82325966s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [....X........X.....X.....X...............X..X.......X.......] duration:
1.896940157s
FAIL (2025-08-21 04:35:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.896967969s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.629854543s
FAIL (2025-08-21 04:35:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.629878838s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.624938416s
FAIL (2025-08-21 04:35:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.624979455s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.....X........X.....X.....X...............X..X.......X......] duration:
1.868309737s
FAIL (2025-08-21 04:35:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.868327912s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.817532141s
FAIL (2025-08-21 04:34:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.817559023s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [......X........X.....X.....X...............X..X.......X.....] duration:
1.984078696s
FAIL (2025-08-21 04:34:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.984114185s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.686393823s
FAIL (2025-08-21 04:34:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.68641752s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.......X........X.....X.....X...............X..X.......X....] duration:
1.805698467s
FAIL (2025-08-21 04:34:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.805728012s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.655286624s
FAIL (2025-08-21 04:33:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.655310962s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [........X........X.....X.....X...............X..X.......X...] duration:
1.927721316s
FAIL (2025-08-21 04:33:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.927748328s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.........X........X.....X.....X...............X..X.......X..] duration:
2.049166484s
FAIL (2025-08-21 04:32:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.049191221s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.607717371s
FAIL (2025-08-21 04:32:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.607778719s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..........X........X.....X.....X...............X..X.......X.] duration:
1.816412519s
FAIL (2025-08-21 04:31:55 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.816446385s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.731775607s
FAIL (2025-08-21 04:31:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.731829271s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...........X........X.....X.....X...............X..X.......X] duration:
871.63206ms
FAIL (2025-08-21 04:31:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:31:13.139362338 (299h5m7.570442469s) [upload=311092]: Starting upload Aug 21 04:31:13.139409498 (299h5m7.57048963s) [upload=311092]: Done starting upload Aug 21 04:31:13.139459935 (299h5m7.570540066s) [upload=311092]: Uploading segments... Aug 21 04:31:13.139523607 (299h5m7.570603738s) [upload=311092]: Got next segment. Inline: true Aug 21 04:31:13.139530800 (299h5m7.570610931s) [upload=311092]: Waiting for error group managing segments... Aug 21 04:31:13.139573001 (299h5m7.570653132s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:31:13.139577450 (299h5m7.570657581s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:31:13.139579944 (299h5m7.570660075s) [upload=311092]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:31:13.363382023 (299h5m7.794462165s) [upload=311092]: Done uploading segments... Aug 21 04:31:13.363440014 (299h5m7.794520145s) [upload=311092]: Upload finished. err: metaclient: Too Many Requests
Duration: 871.658161ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.761797661s
FAIL (2025-08-21 04:30:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.761824783s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [............X........X.....X.....X...............X..X.......] duration:
2.05893082s
FAIL (2025-08-21 04:30:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after b9477b9bbb5aad09ede8c937a8071785456d7e97115a8695cca2e60b25a307c6 != before 106db355426ed965d1076e5574d9a3e0b242ed2d4e1a6783070a63ee57c43675 ======LOGS====== Aug 21 04:24:36.140951257 (298h58m30.572031388s) [upload=310979]: Starting upload Aug 21 04:24:36.140995531 (298h58m30.572075652s) [upload=310979]: Done starting upload Aug 21 04:24:36.141071547 (298h58m30.572151668s) [upload=310979]: Uploading segments... Aug 21 04:24:36.141126352 (298h58m30.572206523s) [upload=310979]: Got next segment. Inline: true Aug 21 04:24:36.141132543 (298h58m30.572212684s) [upload=310979]: Waiting for error group managing segments... Aug 21 04:24:36.141229610 (298h58m30.572309741s) [upload=310979]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:36.141234208 (298h58m30.572314329s) [upload=310979]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:36.141237224 (298h58m30.572317355s) [upload=310979]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:36.413734124 (298h58m30.844814255s) [upload=310979]: Done uploading segments... Aug 21 04:24:36.413750545 (298h58m30.844830676s) [upload=310979]: Upload finished. err: <nil>
Duration: 2.058954515s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.782343237s
FAIL (2025-08-21 04:30:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.782368595s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.............X........X.....X.....X...............X..X......] duration:
1.819544979s
FAIL (2025-08-21 04:29:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after b9477b9bbb5aad09ede8c937a8071785456d7e97115a8695cca2e60b25a307c6 != before 106db355426ed965d1076e5574d9a3e0b242ed2d4e1a6783070a63ee57c43675 ======LOGS====== Aug 21 04:24:36.140951257 (298h58m30.572031388s) [upload=310979]: Starting upload Aug 21 04:24:36.140995531 (298h58m30.572075652s) [upload=310979]: Done starting upload Aug 21 04:24:36.141071547 (298h58m30.572151668s) [upload=310979]: Uploading segments... Aug 21 04:24:36.141126352 (298h58m30.572206523s) [upload=310979]: Got next segment. Inline: true Aug 21 04:24:36.141132543 (298h58m30.572212684s) [upload=310979]: Waiting for error group managing segments... Aug 21 04:24:36.141229610 (298h58m30.572309741s) [upload=310979]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:36.141234208 (298h58m30.572314329s) [upload=310979]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:36.141237224 (298h58m30.572317355s) [upload=310979]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:36.413734124 (298h58m30.844814255s) [upload=310979]: Done uploading segments... Aug 21 04:24:36.413750545 (298h58m30.844830676s) [upload=310979]: Upload finished. err: <nil>
Duration: 1.819578282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.822394716s
FAIL (2025-08-21 04:28:59 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 04:23:00.692432394 (298h56m55.123512525s) [upload=310947]: Starting upload Aug 21 04:23:00.692512868 (298h56m55.123592999s) [upload=310947]: Done starting upload Aug 21 04:23:00.692578454 (298h56m55.123658585s) [upload=310947]: Uploading segments... Aug 21 04:23:00.692707039 (298h56m55.12378717s) [upload=310947]: Got next segment. Inline: false Aug 21 04:23:00.692742788 (298h56m55.123822919s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:23:00.692747106 (298h56m55.123827237s) [upload=310947]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 21 04:23:00.967925225 (298h56m55.399005356s) [upload=310947]: Next segment err: metaclient: Too Many Requests Aug 21 04:23:00.967949832 (298h56m55.399029963s) [upload=310947]: Done uploading segments... Aug 21 04:23:00.967964440 (298h56m55.399044571s) [upload=310947]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.822414684s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [..............X........X.....X.....X...............X..X.....] duration:
2.000406193s
FAIL (2025-08-21 04:28:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after b9477b9bbb5aad09ede8c937a8071785456d7e97115a8695cca2e60b25a307c6 != before 106db355426ed965d1076e5574d9a3e0b242ed2d4e1a6783070a63ee57c43675 ======LOGS====== Aug 21 04:24:36.140951257 (298h58m30.572031388s) [upload=310979]: Starting upload Aug 21 04:24:36.140995531 (298h58m30.572075652s) [upload=310979]: Done starting upload Aug 21 04:24:36.141071547 (298h58m30.572151668s) [upload=310979]: Uploading segments... Aug 21 04:24:36.141126352 (298h58m30.572206523s) [upload=310979]: Got next segment. Inline: true Aug 21 04:24:36.141132543 (298h58m30.572212684s) [upload=310979]: Waiting for error group managing segments... Aug 21 04:24:36.141229610 (298h58m30.572309741s) [upload=310979]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 21 04:24:36.141234208 (298h58m30.572314329s) [upload=310979]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 21 04:24:36.141237224 (298h58m30.572317355s) [upload=310979]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 21 04:24:36.413734124 (298h58m30.844814255s) [upload=310979]: Done uploading segments... Aug 21 04:24:36.413750545 (298h58m30.844830676s) [upload=310979]: Upload finished. err: <nil>
Duration: 2.000432382s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|