Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.X...X.................X......................X.....X.X.....] duration:
2.047061747s
FAIL (2025-08-10 13:44:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 758d3cc31d332c31cb9384a27ff2f844d7fae21c5eb4507875896964e3ceb894 != before 64810cdb5d5b81810d8606313eabcb0da167c9d36245fe8aa71916b73bcce3c6 ======LOGS====== Aug 10 13:40:32.993680237 (44h14m27.424760368s) [upload=46177]: Starting upload Aug 10 13:40:32.993754398 (44h14m27.424834529s) [upload=46177]: Done starting upload Aug 10 13:40:32.993819113 (44h14m27.424899244s) [upload=46177]: Uploading segments... Aug 10 13:40:32.993853628 (44h14m27.424933759s) [upload=46177]: Got next segment. Inline: true Aug 10 13:40:32.993857796 (44h14m27.424937927s) [upload=46177]: Waiting for error group managing segments... Aug 10 13:40:32.993894997 (44h14m27.424975118s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:40:32.993899236 (44h14m27.424979367s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:40:32.993902212 (44h14m27.424982343s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:40:33.279121751 (44h14m27.710201882s) [upload=46177]: Done uploading segments... Aug 10 13:40:33.279140356 (44h14m27.710220487s) [upload=46177]: Upload finished. err: <nil>
Duration: 2.04708475s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X............................X.X.................X.........] duration:
5.636219035s
FAIL (2025-08-10 13:44:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 13:38:09.249377489 (44h12m3.68045762s) [upload=46132]: Starting upload
Aug 10 13:38:09.249458343 (44h12m3.680538525s) [upload=46132]: Done starting upload
Aug 10 13:38:09.249621675 (44h12m3.680701826s) [upload=46132]: Uploading segments...
Aug 10 13:38:09.249838891 (44h12m3.680919082s) [upload=46132]: Got next segment. Inline: false
Aug 10 13:38:09.249934895 (44h12m3.681015086s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 13:38:09.249942960 (44h12m3.681023181s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 13:38:09.697986657 (44h12m4.129066788s) [seg_pos={0 0}, upload=46132]: Begin upload segment...
Aug 10 13:38:09.698043205 (44h12m4.129123336s) [seg_pos={0 0}, upload=46132]: Done begin upload segment.
Aug 10 13:38:09.698062432 (44h12m4.129142564s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698086859 (44h12m4.12916699s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698450515 (44h12m4.129530646s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698466265 (44h12m4.129546386s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698765268 (44h12m4.129845399s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698770127 (44h12m4.129850248s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699022479 (44h12m4.13010261s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699043901 (44h12m4.130124032s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699280874 (44h12m4.130360995s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699305190 (44h12m4.130385321s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699544077 (44h12m4.130624208s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699607409 (44h12m4.13068754s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699890921 (44h12m4.130971062s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699917092 (44h12m4.130997223s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700149726 (44h12m4.131229857s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700379306 (44h12m4.131459427s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700609306 (44h12m4.131689437s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700840588 (44h12m4.131920709s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:10.861990960 (44h12m5.293071091s) [upload=46132]: Next returned nil segment
Aug 10 13:38:10.862008383 (44h12m5.293088514s) [upload=46132]: Waiting for error group managing segments...
Aug 10 13:38:11.158523746 (44h12m5.589603877s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.620684799 (44h12m6.05176492s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.648899274 (44h12m6.079979395s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.669273518 (44h12m6.100353649s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.671085465 (44h12m6.102165586s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.673240418 (44h12m6.104320539s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.678381714 (44h12m6.109461846s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.709604816 (44h12m6.140684947s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.720718781 (44h12m6.151798912s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.727166458 (44h12m6.158246589s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.729065361 (44h12m6.160145492s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730134898 (44h12m6.161215029s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730866336 (44h12m6.161946458s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811817155 (44h12m6.242897286s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811847913 (44h12m6.242928034s) [seg_pos={0 0}, upload=46132]: Segment reached optimal threshold of 14 pieces.
Aug 10 13:38:11.812057554 (44h12m6.243137685s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfZXtm2GymdBAaEBFaX9jeYbK3PveonNNskUq9cLmuW7vbuu5): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812092992 (44h12m6.243173123s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812152586 (44h12m6.243232727s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QgDye4pcKhsndRP7tCxM44KZkSyRnhp219u8JnRHXX7jRutPv): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812214605 (44h12m6.243294736s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection
Aug 10 13:38:11.812226588 (44h12m6.243306719s) [seg_pos={0 0}, upload=46132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 13:38:11.812290430 (44h12m6.243370561s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 13:38:11.812294888 (44h12m6.243375019s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 13:38:12.128200480 (44h12m6.559280611s) [upload=46132]: Done uploading segments...
Aug 10 13:38:12.128221510 (44h12m6.559301641s) [upload=46132]: Upload finished. err: <nil>
Duration: 5.636245985s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X............................X.X.................X........] duration:
5.692577982s
FAIL (2025-08-10 13:44:23 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 13:38:09.249377489 (44h12m3.68045762s) [upload=46132]: Starting upload
Aug 10 13:38:09.249458343 (44h12m3.680538525s) [upload=46132]: Done starting upload
Aug 10 13:38:09.249621675 (44h12m3.680701826s) [upload=46132]: Uploading segments...
Aug 10 13:38:09.249838891 (44h12m3.680919082s) [upload=46132]: Got next segment. Inline: false
Aug 10 13:38:09.249934895 (44h12m3.681015086s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 13:38:09.249942960 (44h12m3.681023181s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 13:38:09.697986657 (44h12m4.129066788s) [seg_pos={0 0}, upload=46132]: Begin upload segment...
Aug 10 13:38:09.698043205 (44h12m4.129123336s) [seg_pos={0 0}, upload=46132]: Done begin upload segment.
Aug 10 13:38:09.698062432 (44h12m4.129142564s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698086859 (44h12m4.12916699s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698450515 (44h12m4.129530646s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698466265 (44h12m4.129546386s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698765268 (44h12m4.129845399s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698770127 (44h12m4.129850248s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699022479 (44h12m4.13010261s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699043901 (44h12m4.130124032s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699280874 (44h12m4.130360995s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699305190 (44h12m4.130385321s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699544077 (44h12m4.130624208s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699607409 (44h12m4.13068754s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699890921 (44h12m4.130971062s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699917092 (44h12m4.130997223s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700149726 (44h12m4.131229857s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700379306 (44h12m4.131459427s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700609306 (44h12m4.131689437s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700840588 (44h12m4.131920709s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:10.861990960 (44h12m5.293071091s) [upload=46132]: Next returned nil segment
Aug 10 13:38:10.862008383 (44h12m5.293088514s) [upload=46132]: Waiting for error group managing segments...
Aug 10 13:38:11.158523746 (44h12m5.589603877s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.620684799 (44h12m6.05176492s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.648899274 (44h12m6.079979395s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.669273518 (44h12m6.100353649s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.671085465 (44h12m6.102165586s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.673240418 (44h12m6.104320539s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.678381714 (44h12m6.109461846s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.709604816 (44h12m6.140684947s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.720718781 (44h12m6.151798912s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.727166458 (44h12m6.158246589s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.729065361 (44h12m6.160145492s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730134898 (44h12m6.161215029s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730866336 (44h12m6.161946458s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811817155 (44h12m6.242897286s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811847913 (44h12m6.242928034s) [seg_pos={0 0}, upload=46132]: Segment reached optimal threshold of 14 pieces.
Aug 10 13:38:11.812057554 (44h12m6.243137685s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfZXtm2GymdBAaEBFaX9jeYbK3PveonNNskUq9cLmuW7vbuu5): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812092992 (44h12m6.243173123s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812152586 (44h12m6.243232727s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QgDye4pcKhsndRP7tCxM44KZkSyRnhp219u8JnRHXX7jRutPv): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812214605 (44h12m6.243294736s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection
Aug 10 13:38:11.812226588 (44h12m6.243306719s) [seg_pos={0 0}, upload=46132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 13:38:11.812290430 (44h12m6.243370561s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 13:38:11.812294888 (44h12m6.243375019s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 13:38:12.128200480 (44h12m6.559280611s) [upload=46132]: Done uploading segments...
Aug 10 13:38:12.128221510 (44h12m6.559301641s) [upload=46132]: Upload finished. err: <nil>
Duration: 5.692594973s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X............................X.X.................X.......] duration:
5.787475572s
FAIL (2025-08-10 13:44:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 13:38:09.249377489 (44h12m3.68045762s) [upload=46132]: Starting upload
Aug 10 13:38:09.249458343 (44h12m3.680538525s) [upload=46132]: Done starting upload
Aug 10 13:38:09.249621675 (44h12m3.680701826s) [upload=46132]: Uploading segments...
Aug 10 13:38:09.249838891 (44h12m3.680919082s) [upload=46132]: Got next segment. Inline: false
Aug 10 13:38:09.249934895 (44h12m3.681015086s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 13:38:09.249942960 (44h12m3.681023181s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 13:38:09.697986657 (44h12m4.129066788s) [seg_pos={0 0}, upload=46132]: Begin upload segment...
Aug 10 13:38:09.698043205 (44h12m4.129123336s) [seg_pos={0 0}, upload=46132]: Done begin upload segment.
Aug 10 13:38:09.698062432 (44h12m4.129142564s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698086859 (44h12m4.12916699s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698450515 (44h12m4.129530646s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698466265 (44h12m4.129546386s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698765268 (44h12m4.129845399s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698770127 (44h12m4.129850248s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699022479 (44h12m4.13010261s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699043901 (44h12m4.130124032s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699280874 (44h12m4.130360995s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699305190 (44h12m4.130385321s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699544077 (44h12m4.130624208s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699607409 (44h12m4.13068754s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699890921 (44h12m4.130971062s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699917092 (44h12m4.130997223s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700149726 (44h12m4.131229857s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700379306 (44h12m4.131459427s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700609306 (44h12m4.131689437s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700840588 (44h12m4.131920709s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:10.861990960 (44h12m5.293071091s) [upload=46132]: Next returned nil segment
Aug 10 13:38:10.862008383 (44h12m5.293088514s) [upload=46132]: Waiting for error group managing segments...
Aug 10 13:38:11.158523746 (44h12m5.589603877s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.620684799 (44h12m6.05176492s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.648899274 (44h12m6.079979395s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.669273518 (44h12m6.100353649s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.671085465 (44h12m6.102165586s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.673240418 (44h12m6.104320539s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.678381714 (44h12m6.109461846s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.709604816 (44h12m6.140684947s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.720718781 (44h12m6.151798912s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.727166458 (44h12m6.158246589s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.729065361 (44h12m6.160145492s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730134898 (44h12m6.161215029s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730866336 (44h12m6.161946458s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811817155 (44h12m6.242897286s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811847913 (44h12m6.242928034s) [seg_pos={0 0}, upload=46132]: Segment reached optimal threshold of 14 pieces.
Aug 10 13:38:11.812057554 (44h12m6.243137685s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfZXtm2GymdBAaEBFaX9jeYbK3PveonNNskUq9cLmuW7vbuu5): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812092992 (44h12m6.243173123s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812152586 (44h12m6.243232727s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QgDye4pcKhsndRP7tCxM44KZkSyRnhp219u8JnRHXX7jRutPv): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812214605 (44h12m6.243294736s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection
Aug 10 13:38:11.812226588 (44h12m6.243306719s) [seg_pos={0 0}, upload=46132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 13:38:11.812290430 (44h12m6.243370561s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 13:38:11.812294888 (44h12m6.243375019s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 13:38:12.128200480 (44h12m6.559280611s) [upload=46132]: Done uploading segments...
Aug 10 13:38:12.128221510 (44h12m6.559301641s) [upload=46132]: Upload finished. err: <nil>
Duration: 5.787501931s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [X.X...X.................X......................X.....X.X....] duration:
1.839075241s
FAIL (2025-08-10 13:44:00 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 758d3cc31d332c31cb9384a27ff2f844d7fae21c5eb4507875896964e3ceb894 != before 64810cdb5d5b81810d8606313eabcb0da167c9d36245fe8aa71916b73bcce3c6 ======LOGS====== Aug 10 13:40:32.993680237 (44h14m27.424760368s) [upload=46177]: Starting upload Aug 10 13:40:32.993754398 (44h14m27.424834529s) [upload=46177]: Done starting upload Aug 10 13:40:32.993819113 (44h14m27.424899244s) [upload=46177]: Uploading segments... Aug 10 13:40:32.993853628 (44h14m27.424933759s) [upload=46177]: Got next segment. Inline: true Aug 10 13:40:32.993857796 (44h14m27.424937927s) [upload=46177]: Waiting for error group managing segments... Aug 10 13:40:32.993894997 (44h14m27.424975118s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:40:32.993899236 (44h14m27.424979367s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:40:32.993902212 (44h14m27.424982343s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:40:33.279121751 (44h14m27.710201882s) [upload=46177]: Done uploading segments... Aug 10 13:40:33.279140356 (44h14m27.710220487s) [upload=46177]: Upload finished. err: <nil>
Duration: 1.839110257s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X............................X.X.................X......] duration:
5.959256194s
FAIL (2025-08-10 13:42:56 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 13:38:09.249377489 (44h12m3.68045762s) [upload=46132]: Starting upload
Aug 10 13:38:09.249458343 (44h12m3.680538525s) [upload=46132]: Done starting upload
Aug 10 13:38:09.249621675 (44h12m3.680701826s) [upload=46132]: Uploading segments...
Aug 10 13:38:09.249838891 (44h12m3.680919082s) [upload=46132]: Got next segment. Inline: false
Aug 10 13:38:09.249934895 (44h12m3.681015086s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 13:38:09.249942960 (44h12m3.681023181s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 13:38:09.697986657 (44h12m4.129066788s) [seg_pos={0 0}, upload=46132]: Begin upload segment...
Aug 10 13:38:09.698043205 (44h12m4.129123336s) [seg_pos={0 0}, upload=46132]: Done begin upload segment.
Aug 10 13:38:09.698062432 (44h12m4.129142564s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698086859 (44h12m4.12916699s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698450515 (44h12m4.129530646s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698466265 (44h12m4.129546386s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698765268 (44h12m4.129845399s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698770127 (44h12m4.129850248s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699022479 (44h12m4.13010261s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699043901 (44h12m4.130124032s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699280874 (44h12m4.130360995s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699305190 (44h12m4.130385321s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699544077 (44h12m4.130624208s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699607409 (44h12m4.13068754s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699890921 (44h12m4.130971062s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699917092 (44h12m4.130997223s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700149726 (44h12m4.131229857s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700379306 (44h12m4.131459427s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700609306 (44h12m4.131689437s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700840588 (44h12m4.131920709s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:10.861990960 (44h12m5.293071091s) [upload=46132]: Next returned nil segment
Aug 10 13:38:10.862008383 (44h12m5.293088514s) [upload=46132]: Waiting for error group managing segments...
Aug 10 13:38:11.158523746 (44h12m5.589603877s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.620684799 (44h12m6.05176492s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.648899274 (44h12m6.079979395s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.669273518 (44h12m6.100353649s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.671085465 (44h12m6.102165586s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.673240418 (44h12m6.104320539s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.678381714 (44h12m6.109461846s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.709604816 (44h12m6.140684947s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.720718781 (44h12m6.151798912s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.727166458 (44h12m6.158246589s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.729065361 (44h12m6.160145492s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730134898 (44h12m6.161215029s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730866336 (44h12m6.161946458s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811817155 (44h12m6.242897286s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811847913 (44h12m6.242928034s) [seg_pos={0 0}, upload=46132]: Segment reached optimal threshold of 14 pieces.
Aug 10 13:38:11.812057554 (44h12m6.243137685s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfZXtm2GymdBAaEBFaX9jeYbK3PveonNNskUq9cLmuW7vbuu5): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812092992 (44h12m6.243173123s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812152586 (44h12m6.243232727s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QgDye4pcKhsndRP7tCxM44KZkSyRnhp219u8JnRHXX7jRutPv): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812214605 (44h12m6.243294736s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection
Aug 10 13:38:11.812226588 (44h12m6.243306719s) [seg_pos={0 0}, upload=46132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 13:38:11.812290430 (44h12m6.243370561s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 13:38:11.812294888 (44h12m6.243375019s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 13:38:12.128200480 (44h12m6.559280611s) [upload=46132]: Done uploading segments...
Aug 10 13:38:12.128221510 (44h12m6.559301641s) [upload=46132]: Upload finished. err: <nil>
Duration: 5.959281011s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [.X.X...X.................X......................X.....X.X...] duration:
1.862789377s
FAIL (2025-08-10 13:42:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 758d3cc31d332c31cb9384a27ff2f844d7fae21c5eb4507875896964e3ceb894 != before 64810cdb5d5b81810d8606313eabcb0da167c9d36245fe8aa71916b73bcce3c6 ======LOGS====== Aug 10 13:40:32.993680237 (44h14m27.424760368s) [upload=46177]: Starting upload Aug 10 13:40:32.993754398 (44h14m27.424834529s) [upload=46177]: Done starting upload Aug 10 13:40:32.993819113 (44h14m27.424899244s) [upload=46177]: Uploading segments... Aug 10 13:40:32.993853628 (44h14m27.424933759s) [upload=46177]: Got next segment. Inline: true Aug 10 13:40:32.993857796 (44h14m27.424937927s) [upload=46177]: Waiting for error group managing segments... Aug 10 13:40:32.993894997 (44h14m27.424975118s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:40:32.993899236 (44h14m27.424979367s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:40:32.993902212 (44h14m27.424982343s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:40:33.279121751 (44h14m27.710201882s) [upload=46177]: Done uploading segments... Aug 10 13:40:33.279140356 (44h14m27.710220487s) [upload=46177]: Upload finished. err: <nil>
Duration: 1.862840695s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X............................X.X.................X.....] duration:
5.903371257s
FAIL (2025-08-10 13:42:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 13:38:09.249377489 (44h12m3.68045762s) [upload=46132]: Starting upload
Aug 10 13:38:09.249458343 (44h12m3.680538525s) [upload=46132]: Done starting upload
Aug 10 13:38:09.249621675 (44h12m3.680701826s) [upload=46132]: Uploading segments...
Aug 10 13:38:09.249838891 (44h12m3.680919082s) [upload=46132]: Got next segment. Inline: false
Aug 10 13:38:09.249934895 (44h12m3.681015086s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 13:38:09.249942960 (44h12m3.681023181s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 13:38:09.697986657 (44h12m4.129066788s) [seg_pos={0 0}, upload=46132]: Begin upload segment...
Aug 10 13:38:09.698043205 (44h12m4.129123336s) [seg_pos={0 0}, upload=46132]: Done begin upload segment.
Aug 10 13:38:09.698062432 (44h12m4.129142564s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698086859 (44h12m4.12916699s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698450515 (44h12m4.129530646s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698466265 (44h12m4.129546386s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698765268 (44h12m4.129845399s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698770127 (44h12m4.129850248s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699022479 (44h12m4.13010261s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699043901 (44h12m4.130124032s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699280874 (44h12m4.130360995s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699305190 (44h12m4.130385321s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699544077 (44h12m4.130624208s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699607409 (44h12m4.13068754s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699890921 (44h12m4.130971062s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699917092 (44h12m4.130997223s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700149726 (44h12m4.131229857s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700379306 (44h12m4.131459427s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700609306 (44h12m4.131689437s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700840588 (44h12m4.131920709s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:10.861990960 (44h12m5.293071091s) [upload=46132]: Next returned nil segment
Aug 10 13:38:10.862008383 (44h12m5.293088514s) [upload=46132]: Waiting for error group managing segments...
Aug 10 13:38:11.158523746 (44h12m5.589603877s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.620684799 (44h12m6.05176492s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.648899274 (44h12m6.079979395s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.669273518 (44h12m6.100353649s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.671085465 (44h12m6.102165586s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.673240418 (44h12m6.104320539s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.678381714 (44h12m6.109461846s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.709604816 (44h12m6.140684947s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.720718781 (44h12m6.151798912s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.727166458 (44h12m6.158246589s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.729065361 (44h12m6.160145492s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730134898 (44h12m6.161215029s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730866336 (44h12m6.161946458s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811817155 (44h12m6.242897286s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811847913 (44h12m6.242928034s) [seg_pos={0 0}, upload=46132]: Segment reached optimal threshold of 14 pieces.
Aug 10 13:38:11.812057554 (44h12m6.243137685s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfZXtm2GymdBAaEBFaX9jeYbK3PveonNNskUq9cLmuW7vbuu5): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812092992 (44h12m6.243173123s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812152586 (44h12m6.243232727s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QgDye4pcKhsndRP7tCxM44KZkSyRnhp219u8JnRHXX7jRutPv): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812214605 (44h12m6.243294736s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection
Aug 10 13:38:11.812226588 (44h12m6.243306719s) [seg_pos={0 0}, upload=46132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 13:38:11.812290430 (44h12m6.243370561s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 13:38:11.812294888 (44h12m6.243375019s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 13:38:12.128200480 (44h12m6.559280611s) [upload=46132]: Done uploading segments...
Aug 10 13:38:12.128221510 (44h12m6.559301641s) [upload=46132]: Upload finished. err: <nil>
Duration: 5.903398849s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [..X.X...X.................X......................X.....X.X..] duration:
1.974826344s
FAIL (2025-08-10 13:42:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 758d3cc31d332c31cb9384a27ff2f844d7fae21c5eb4507875896964e3ceb894 != before 64810cdb5d5b81810d8606313eabcb0da167c9d36245fe8aa71916b73bcce3c6 ======LOGS====== Aug 10 13:40:32.993680237 (44h14m27.424760368s) [upload=46177]: Starting upload Aug 10 13:40:32.993754398 (44h14m27.424834529s) [upload=46177]: Done starting upload Aug 10 13:40:32.993819113 (44h14m27.424899244s) [upload=46177]: Uploading segments... Aug 10 13:40:32.993853628 (44h14m27.424933759s) [upload=46177]: Got next segment. Inline: true Aug 10 13:40:32.993857796 (44h14m27.424937927s) [upload=46177]: Waiting for error group managing segments... Aug 10 13:40:32.993894997 (44h14m27.424975118s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:40:32.993899236 (44h14m27.424979367s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:40:32.993902212 (44h14m27.424982343s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:40:33.279121751 (44h14m27.710201882s) [upload=46177]: Done uploading segments... Aug 10 13:40:33.279140356 (44h14m27.710220487s) [upload=46177]: Upload finished. err: <nil>
Duration: 1.974874808s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [...X.X...X.................X......................X.....X.X.] duration:
2.054019359s
FAIL (2025-08-10 13:41:29 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 758d3cc31d332c31cb9384a27ff2f844d7fae21c5eb4507875896964e3ceb894 != before 64810cdb5d5b81810d8606313eabcb0da167c9d36245fe8aa71916b73bcce3c6 ======LOGS====== Aug 10 13:40:32.993680237 (44h14m27.424760368s) [upload=46177]: Starting upload Aug 10 13:40:32.993754398 (44h14m27.424834529s) [upload=46177]: Done starting upload Aug 10 13:40:32.993819113 (44h14m27.424899244s) [upload=46177]: Uploading segments... Aug 10 13:40:32.993853628 (44h14m27.424933759s) [upload=46177]: Got next segment. Inline: true Aug 10 13:40:32.993857796 (44h14m27.424937927s) [upload=46177]: Waiting for error group managing segments... Aug 10 13:40:32.993894997 (44h14m27.424975118s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:40:32.993899236 (44h14m27.424979367s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:40:32.993902212 (44h14m27.424982343s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:40:33.279121751 (44h14m27.710201882s) [upload=46177]: Done uploading segments... Aug 10 13:40:33.279140356 (44h14m27.710220487s) [upload=46177]: Upload finished. err: <nil>
Duration: 2.054042685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X............................X.X.................X....] duration:
5.91413911s
FAIL (2025-08-10 13:41:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 13:38:09.249377489 (44h12m3.68045762s) [upload=46132]: Starting upload
Aug 10 13:38:09.249458343 (44h12m3.680538525s) [upload=46132]: Done starting upload
Aug 10 13:38:09.249621675 (44h12m3.680701826s) [upload=46132]: Uploading segments...
Aug 10 13:38:09.249838891 (44h12m3.680919082s) [upload=46132]: Got next segment. Inline: false
Aug 10 13:38:09.249934895 (44h12m3.681015086s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 13:38:09.249942960 (44h12m3.681023181s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 13:38:09.697986657 (44h12m4.129066788s) [seg_pos={0 0}, upload=46132]: Begin upload segment...
Aug 10 13:38:09.698043205 (44h12m4.129123336s) [seg_pos={0 0}, upload=46132]: Done begin upload segment.
Aug 10 13:38:09.698062432 (44h12m4.129142564s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698086859 (44h12m4.12916699s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698450515 (44h12m4.129530646s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698466265 (44h12m4.129546386s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698765268 (44h12m4.129845399s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698770127 (44h12m4.129850248s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699022479 (44h12m4.13010261s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699043901 (44h12m4.130124032s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699280874 (44h12m4.130360995s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699305190 (44h12m4.130385321s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699544077 (44h12m4.130624208s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699607409 (44h12m4.13068754s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699890921 (44h12m4.130971062s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699917092 (44h12m4.130997223s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700149726 (44h12m4.131229857s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700379306 (44h12m4.131459427s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700609306 (44h12m4.131689437s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700840588 (44h12m4.131920709s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:10.861990960 (44h12m5.293071091s) [upload=46132]: Next returned nil segment
Aug 10 13:38:10.862008383 (44h12m5.293088514s) [upload=46132]: Waiting for error group managing segments...
Aug 10 13:38:11.158523746 (44h12m5.589603877s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.620684799 (44h12m6.05176492s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.648899274 (44h12m6.079979395s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.669273518 (44h12m6.100353649s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.671085465 (44h12m6.102165586s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.673240418 (44h12m6.104320539s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.678381714 (44h12m6.109461846s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.709604816 (44h12m6.140684947s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.720718781 (44h12m6.151798912s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.727166458 (44h12m6.158246589s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.729065361 (44h12m6.160145492s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730134898 (44h12m6.161215029s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730866336 (44h12m6.161946458s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811817155 (44h12m6.242897286s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811847913 (44h12m6.242928034s) [seg_pos={0 0}, upload=46132]: Segment reached optimal threshold of 14 pieces.
Aug 10 13:38:11.812057554 (44h12m6.243137685s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfZXtm2GymdBAaEBFaX9jeYbK3PveonNNskUq9cLmuW7vbuu5): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812092992 (44h12m6.243173123s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812152586 (44h12m6.243232727s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QgDye4pcKhsndRP7tCxM44KZkSyRnhp219u8JnRHXX7jRutPv): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812214605 (44h12m6.243294736s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection
Aug 10 13:38:11.812226588 (44h12m6.243306719s) [seg_pos={0 0}, upload=46132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 13:38:11.812290430 (44h12m6.243370561s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 13:38:11.812294888 (44h12m6.243375019s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 13:38:12.128200480 (44h12m6.559280611s) [upload=46132]: Done uploading segments...
Aug 10 13:38:12.128221510 (44h12m6.559301641s) [upload=46132]: Upload finished. err: <nil>
Duration: 5.914175621s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X......X............................X.X.................X...] duration:
6.195354065s
FAIL (2025-08-10 13:40:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 13:38:09.249377489 (44h12m3.68045762s) [upload=46132]: Starting upload
Aug 10 13:38:09.249458343 (44h12m3.680538525s) [upload=46132]: Done starting upload
Aug 10 13:38:09.249621675 (44h12m3.680701826s) [upload=46132]: Uploading segments...
Aug 10 13:38:09.249838891 (44h12m3.680919082s) [upload=46132]: Got next segment. Inline: false
Aug 10 13:38:09.249934895 (44h12m3.681015086s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 13:38:09.249942960 (44h12m3.681023181s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 13:38:09.697986657 (44h12m4.129066788s) [seg_pos={0 0}, upload=46132]: Begin upload segment...
Aug 10 13:38:09.698043205 (44h12m4.129123336s) [seg_pos={0 0}, upload=46132]: Done begin upload segment.
Aug 10 13:38:09.698062432 (44h12m4.129142564s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698086859 (44h12m4.12916699s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698450515 (44h12m4.129530646s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698466265 (44h12m4.129546386s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698765268 (44h12m4.129845399s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698770127 (44h12m4.129850248s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699022479 (44h12m4.13010261s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699043901 (44h12m4.130124032s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699280874 (44h12m4.130360995s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699305190 (44h12m4.130385321s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699544077 (44h12m4.130624208s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699607409 (44h12m4.13068754s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699890921 (44h12m4.130971062s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699917092 (44h12m4.130997223s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700149726 (44h12m4.131229857s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700379306 (44h12m4.131459427s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700609306 (44h12m4.131689437s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700840588 (44h12m4.131920709s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:10.861990960 (44h12m5.293071091s) [upload=46132]: Next returned nil segment
Aug 10 13:38:10.862008383 (44h12m5.293088514s) [upload=46132]: Waiting for error group managing segments...
Aug 10 13:38:11.158523746 (44h12m5.589603877s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.620684799 (44h12m6.05176492s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.648899274 (44h12m6.079979395s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.669273518 (44h12m6.100353649s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.671085465 (44h12m6.102165586s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.673240418 (44h12m6.104320539s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.678381714 (44h12m6.109461846s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.709604816 (44h12m6.140684947s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.720718781 (44h12m6.151798912s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.727166458 (44h12m6.158246589s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.729065361 (44h12m6.160145492s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730134898 (44h12m6.161215029s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730866336 (44h12m6.161946458s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811817155 (44h12m6.242897286s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811847913 (44h12m6.242928034s) [seg_pos={0 0}, upload=46132]: Segment reached optimal threshold of 14 pieces.
Aug 10 13:38:11.812057554 (44h12m6.243137685s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfZXtm2GymdBAaEBFaX9jeYbK3PveonNNskUq9cLmuW7vbuu5): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812092992 (44h12m6.243173123s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812152586 (44h12m6.243232727s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QgDye4pcKhsndRP7tCxM44KZkSyRnhp219u8JnRHXX7jRutPv): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812214605 (44h12m6.243294736s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection
Aug 10 13:38:11.812226588 (44h12m6.243306719s) [seg_pos={0 0}, upload=46132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 13:38:11.812290430 (44h12m6.243370561s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 13:38:11.812294888 (44h12m6.243375019s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 13:38:12.128200480 (44h12m6.559280611s) [upload=46132]: Done uploading segments...
Aug 10 13:38:12.128221510 (44h12m6.559301641s) [upload=46132]: Upload finished. err: <nil>
Duration: 6.195383892s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
7 out of 60 is failed (threshold=3) [....X.X...X.................X......................X.....X.X] duration:
1.632981481s
FAIL (2025-08-10 13:40:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 758d3cc31d332c31cb9384a27ff2f844d7fae21c5eb4507875896964e3ceb894 != before 64810cdb5d5b81810d8606313eabcb0da167c9d36245fe8aa71916b73bcce3c6 ======LOGS====== Aug 10 13:40:32.993680237 (44h14m27.424760368s) [upload=46177]: Starting upload Aug 10 13:40:32.993754398 (44h14m27.424834529s) [upload=46177]: Done starting upload Aug 10 13:40:32.993819113 (44h14m27.424899244s) [upload=46177]: Uploading segments... Aug 10 13:40:32.993853628 (44h14m27.424933759s) [upload=46177]: Got next segment. Inline: true Aug 10 13:40:32.993857796 (44h14m27.424937927s) [upload=46177]: Waiting for error group managing segments... Aug 10 13:40:32.993894997 (44h14m27.424975118s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:40:32.993899236 (44h14m27.424979367s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:40:32.993902212 (44h14m27.424982343s) [upload=46177]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:40:33.279121751 (44h14m27.710201882s) [upload=46177]: Done uploading segments... Aug 10 13:40:33.279140356 (44h14m27.710220487s) [upload=46177]: Upload finished. err: <nil>
Duration: 1.633009324s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [.....X.X...X.................X......................X.....X.] duration:
1.941701293s
FAIL (2025-08-10 13:40:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7fdce1696c5da5c2d741ac0c7477fc12a51236ca475bc7785ad1a7fdb53c5c92 != before fafdadf2fe9a2075b9fb2c57b0d6dbe3404da04f5a1ff756fc7b4347cd0b537d ======LOGS====== Aug 10 13:39:30.226373667 (44h13m24.657453788s) [upload=46155]: Starting upload Aug 10 13:39:30.226427709 (44h13m24.657507842s) [upload=46155]: Done starting upload Aug 10 13:39:30.226479308 (44h13m24.657559439s) [upload=46155]: Uploading segments... Aug 10 13:39:30.226519055 (44h13m24.657599206s) [upload=46155]: Got next segment. Inline: true Aug 10 13:39:30.226525447 (44h13m24.657605608s) [upload=46155]: Waiting for error group managing segments... Aug 10 13:39:30.226574631 (44h13m24.657654762s) [upload=46155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:39:30.226579601 (44h13m24.657659732s) [upload=46155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:39:30.226582135 (44h13m24.657662266s) [upload=46155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:39:30.518711757 (44h13m24.949791888s) [upload=46155]: Done uploading segments... Aug 10 13:39:30.518729089 (44h13m24.94980927s) [upload=46155]: Upload finished. err: <nil>
Duration: 1.94172545s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X......X............................X.X.................X..] duration:
5.800632518s
FAIL (2025-08-10 13:39:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 13:38:09.249377489 (44h12m3.68045762s) [upload=46132]: Starting upload
Aug 10 13:38:09.249458343 (44h12m3.680538525s) [upload=46132]: Done starting upload
Aug 10 13:38:09.249621675 (44h12m3.680701826s) [upload=46132]: Uploading segments...
Aug 10 13:38:09.249838891 (44h12m3.680919082s) [upload=46132]: Got next segment. Inline: false
Aug 10 13:38:09.249934895 (44h12m3.681015086s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 13:38:09.249942960 (44h12m3.681023181s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 13:38:09.697986657 (44h12m4.129066788s) [seg_pos={0 0}, upload=46132]: Begin upload segment...
Aug 10 13:38:09.698043205 (44h12m4.129123336s) [seg_pos={0 0}, upload=46132]: Done begin upload segment.
Aug 10 13:38:09.698062432 (44h12m4.129142564s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698086859 (44h12m4.12916699s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698450515 (44h12m4.129530646s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698466265 (44h12m4.129546386s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698765268 (44h12m4.129845399s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698770127 (44h12m4.129850248s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699022479 (44h12m4.13010261s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699043901 (44h12m4.130124032s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699280874 (44h12m4.130360995s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699305190 (44h12m4.130385321s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699544077 (44h12m4.130624208s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699607409 (44h12m4.13068754s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699890921 (44h12m4.130971062s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699917092 (44h12m4.130997223s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700149726 (44h12m4.131229857s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700379306 (44h12m4.131459427s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700609306 (44h12m4.131689437s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700840588 (44h12m4.131920709s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:10.861990960 (44h12m5.293071091s) [upload=46132]: Next returned nil segment
Aug 10 13:38:10.862008383 (44h12m5.293088514s) [upload=46132]: Waiting for error group managing segments...
Aug 10 13:38:11.158523746 (44h12m5.589603877s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.620684799 (44h12m6.05176492s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.648899274 (44h12m6.079979395s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.669273518 (44h12m6.100353649s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.671085465 (44h12m6.102165586s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.673240418 (44h12m6.104320539s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.678381714 (44h12m6.109461846s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.709604816 (44h12m6.140684947s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.720718781 (44h12m6.151798912s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.727166458 (44h12m6.158246589s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.729065361 (44h12m6.160145492s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730134898 (44h12m6.161215029s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730866336 (44h12m6.161946458s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811817155 (44h12m6.242897286s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811847913 (44h12m6.242928034s) [seg_pos={0 0}, upload=46132]: Segment reached optimal threshold of 14 pieces.
Aug 10 13:38:11.812057554 (44h12m6.243137685s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfZXtm2GymdBAaEBFaX9jeYbK3PveonNNskUq9cLmuW7vbuu5): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812092992 (44h12m6.243173123s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812152586 (44h12m6.243232727s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QgDye4pcKhsndRP7tCxM44KZkSyRnhp219u8JnRHXX7jRutPv): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812214605 (44h12m6.243294736s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection
Aug 10 13:38:11.812226588 (44h12m6.243306719s) [seg_pos={0 0}, upload=46132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 13:38:11.812290430 (44h12m6.243370561s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 13:38:11.812294888 (44h12m6.243375019s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 13:38:12.128200480 (44h12m6.559280611s) [upload=46132]: Done uploading segments...
Aug 10 13:38:12.128221510 (44h12m6.559301641s) [upload=46132]: Upload finished. err: <nil>
Duration: 5.800658588s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
6 out of 60 is failed (threshold=3) [......X.X...X.................X......................X.....X] duration:
1.605348897s
FAIL (2025-08-10 13:39:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 7fdce1696c5da5c2d741ac0c7477fc12a51236ca475bc7785ad1a7fdb53c5c92 != before fafdadf2fe9a2075b9fb2c57b0d6dbe3404da04f5a1ff756fc7b4347cd0b537d ======LOGS====== Aug 10 13:39:30.226373667 (44h13m24.657453788s) [upload=46155]: Starting upload Aug 10 13:39:30.226427709 (44h13m24.657507842s) [upload=46155]: Done starting upload Aug 10 13:39:30.226479308 (44h13m24.657559439s) [upload=46155]: Uploading segments... Aug 10 13:39:30.226519055 (44h13m24.657599206s) [upload=46155]: Got next segment. Inline: true Aug 10 13:39:30.226525447 (44h13m24.657605608s) [upload=46155]: Waiting for error group managing segments... Aug 10 13:39:30.226574631 (44h13m24.657654762s) [upload=46155]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:39:30.226579601 (44h13m24.657659732s) [upload=46155]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:39:30.226582135 (44h13m24.657662266s) [upload=46155]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:39:30.518711757 (44h13m24.949791888s) [upload=46155]: Done uploading segments... Aug 10 13:39:30.518729089 (44h13m24.94980927s) [upload=46155]: Upload finished. err: <nil>
Duration: 1.605403011s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.......X.X...X.................X......................X.....] duration:
2.022683483s
FAIL (2025-08-10 13:39:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 84b6bd657c8cf238e5ba141295d76e74a9e094f3b5f88916c8e86a58803c1b70 != before 29829e321041a55f90b8aa0483c3ed75a21f83e0124b948419022f9ef834cec4 ======LOGS====== Aug 10 13:35:48.227055900 (44h9m42.658136031s) [upload=46085]: Starting upload Aug 10 13:35:48.227098662 (44h9m42.658178783s) [upload=46085]: Done starting upload Aug 10 13:35:48.227161652 (44h9m42.658241783s) [upload=46085]: Uploading segments... Aug 10 13:35:48.227197130 (44h9m42.658277261s) [upload=46085]: Got next segment. Inline: true Aug 10 13:35:48.227201178 (44h9m42.658281309s) [upload=46085]: Waiting for error group managing segments... Aug 10 13:35:48.227233229 (44h9m42.658313351s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:35:48.227237447 (44h9m42.658317578s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:35:48.227240052 (44h9m42.658320183s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:35:48.685598957 (44h9m43.116679078s) [upload=46085]: Done uploading segments... Aug 10 13:35:48.685621049 (44h9m43.11670118s) [upload=46085]: Upload finished. err: <nil>
Duration: 2.022713992s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [X.X......X............................X.X.................X.] duration:
5.938309634s
FAIL (2025-08-10 13:39:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 13:38:09.249377489 (44h12m3.68045762s) [upload=46132]: Starting upload
Aug 10 13:38:09.249458343 (44h12m3.680538525s) [upload=46132]: Done starting upload
Aug 10 13:38:09.249621675 (44h12m3.680701826s) [upload=46132]: Uploading segments...
Aug 10 13:38:09.249838891 (44h12m3.680919082s) [upload=46132]: Got next segment. Inline: false
Aug 10 13:38:09.249934895 (44h12m3.681015086s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 13:38:09.249942960 (44h12m3.681023181s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 13:38:09.697986657 (44h12m4.129066788s) [seg_pos={0 0}, upload=46132]: Begin upload segment...
Aug 10 13:38:09.698043205 (44h12m4.129123336s) [seg_pos={0 0}, upload=46132]: Done begin upload segment.
Aug 10 13:38:09.698062432 (44h12m4.129142564s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698086859 (44h12m4.12916699s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698450515 (44h12m4.129530646s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698466265 (44h12m4.129546386s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698765268 (44h12m4.129845399s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698770127 (44h12m4.129850248s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699022479 (44h12m4.13010261s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699043901 (44h12m4.130124032s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699280874 (44h12m4.130360995s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699305190 (44h12m4.130385321s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699544077 (44h12m4.130624208s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699607409 (44h12m4.13068754s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699890921 (44h12m4.130971062s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699917092 (44h12m4.130997223s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700149726 (44h12m4.131229857s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700379306 (44h12m4.131459427s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700609306 (44h12m4.131689437s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700840588 (44h12m4.131920709s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:10.861990960 (44h12m5.293071091s) [upload=46132]: Next returned nil segment
Aug 10 13:38:10.862008383 (44h12m5.293088514s) [upload=46132]: Waiting for error group managing segments...
Aug 10 13:38:11.158523746 (44h12m5.589603877s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.620684799 (44h12m6.05176492s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.648899274 (44h12m6.079979395s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.669273518 (44h12m6.100353649s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.671085465 (44h12m6.102165586s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.673240418 (44h12m6.104320539s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.678381714 (44h12m6.109461846s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.709604816 (44h12m6.140684947s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.720718781 (44h12m6.151798912s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.727166458 (44h12m6.158246589s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.729065361 (44h12m6.160145492s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730134898 (44h12m6.161215029s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730866336 (44h12m6.161946458s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811817155 (44h12m6.242897286s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811847913 (44h12m6.242928034s) [seg_pos={0 0}, upload=46132]: Segment reached optimal threshold of 14 pieces.
Aug 10 13:38:11.812057554 (44h12m6.243137685s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfZXtm2GymdBAaEBFaX9jeYbK3PveonNNskUq9cLmuW7vbuu5): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812092992 (44h12m6.243173123s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812152586 (44h12m6.243232727s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QgDye4pcKhsndRP7tCxM44KZkSyRnhp219u8JnRHXX7jRutPv): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812214605 (44h12m6.243294736s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection
Aug 10 13:38:11.812226588 (44h12m6.243306719s) [seg_pos={0 0}, upload=46132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 13:38:11.812290430 (44h12m6.243370561s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 13:38:11.812294888 (44h12m6.243375019s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 13:38:12.128200480 (44h12m6.559280611s) [upload=46132]: Done uploading segments...
Aug 10 13:38:12.128221510 (44h12m6.559301641s) [upload=46132]: Upload finished. err: <nil>
Duration: 5.938348589s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [........X.X...X.................X......................X....] duration:
2.02660743s
FAIL (2025-08-10 13:38:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 84b6bd657c8cf238e5ba141295d76e74a9e094f3b5f88916c8e86a58803c1b70 != before 29829e321041a55f90b8aa0483c3ed75a21f83e0124b948419022f9ef834cec4 ======LOGS====== Aug 10 13:35:48.227055900 (44h9m42.658136031s) [upload=46085]: Starting upload Aug 10 13:35:48.227098662 (44h9m42.658178783s) [upload=46085]: Done starting upload Aug 10 13:35:48.227161652 (44h9m42.658241783s) [upload=46085]: Uploading segments... Aug 10 13:35:48.227197130 (44h9m42.658277261s) [upload=46085]: Got next segment. Inline: true Aug 10 13:35:48.227201178 (44h9m42.658281309s) [upload=46085]: Waiting for error group managing segments... Aug 10 13:35:48.227233229 (44h9m42.658313351s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:35:48.227237447 (44h9m42.658317578s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:35:48.227240052 (44h9m42.658320183s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:35:48.685598957 (44h9m43.116679078s) [upload=46085]: Done uploading segments... Aug 10 13:35:48.685621049 (44h9m43.11670118s) [upload=46085]: Upload finished. err: <nil>
Duration: 2.026649901s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.X.X......X............................X.X.................X] duration:
3.984587075s
FAIL (2025-08-10 13:38:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 13:38:09.249377489 (44h12m3.68045762s) [upload=46132]: Starting upload
Aug 10 13:38:09.249458343 (44h12m3.680538525s) [upload=46132]: Done starting upload
Aug 10 13:38:09.249621675 (44h12m3.680701826s) [upload=46132]: Uploading segments...
Aug 10 13:38:09.249838891 (44h12m3.680919082s) [upload=46132]: Got next segment. Inline: false
Aug 10 13:38:09.249934895 (44h12m3.681015086s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 13:38:09.249942960 (44h12m3.681023181s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 13:38:09.697986657 (44h12m4.129066788s) [seg_pos={0 0}, upload=46132]: Begin upload segment...
Aug 10 13:38:09.698043205 (44h12m4.129123336s) [seg_pos={0 0}, upload=46132]: Done begin upload segment.
Aug 10 13:38:09.698062432 (44h12m4.129142564s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698086859 (44h12m4.12916699s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698450515 (44h12m4.129530646s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698466265 (44h12m4.129546386s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698765268 (44h12m4.129845399s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.698770127 (44h12m4.129850248s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699022479 (44h12m4.13010261s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699043901 (44h12m4.130124032s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699280874 (44h12m4.130360995s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699305190 (44h12m4.130385321s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699544077 (44h12m4.130624208s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699607409 (44h12m4.13068754s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699890921 (44h12m4.130971062s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.699917092 (44h12m4.130997223s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700149726 (44h12m4.131229857s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700379306 (44h12m4.131459427s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700609306 (44h12m4.131689437s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:09.700840588 (44h12m4.131920709s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Uploading piece...
Aug 10 13:38:10.861990960 (44h12m5.293071091s) [upload=46132]: Next returned nil segment
Aug 10 13:38:10.862008383 (44h12m5.293088514s) [upload=46132]: Waiting for error group managing segments...
Aug 10 13:38:11.158523746 (44h12m5.589603877s) [noise=true , address=64.49.13.137:4495 , piece_id=533GAX3Z5TQHATEHFX3232SJTRL7BFIYWJWDIRXWAB2KCHH4WH5Q, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.620684799 (44h12m6.05176492s) [noise=true , address=45.91.116.6:4004 , piece_id=NGWPJCN4UXFDDHGTZUCUTAWV2ZQ3SM564OK45FCGZTZD3KQZBAVQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.648899274 (44h12m6.079979395s) [noise=true , address=104.36.82.44:4872 , piece_id=A2JJZQPJ4I6JIUSTKYM3NNTC6PMLZLRH2OHPNQN5DXH7U56ORVFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.669273518 (44h12m6.100353649s) [noise=true , address=104.36.82.11:4122 , piece_id=7YCIOLLMHKNQWOTZLVSDPDONRQ4AIMAJDVJVFVKVFA5C7ON4U37A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.671085465 (44h12m6.102165586s) [noise=true , address=104.36.82.62:4439 , piece_id=Q3F4KHFRIMFOZR2DP3WPNCMVLU6BZTWLVPBSFBMN2CJRT3MYTRGA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.673240418 (44h12m6.104320539s) [noise=true , address=104.36.82.19:4433 , piece_id=QEZPYKVAUYILHCZ5ZMZM2SXW32TKLRDY26F3YQE6UCP2G3LUNCDQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.678381714 (44h12m6.109461846s) [noise=true , address=104.36.82.39:4741 , piece_id=LO72PJHT4W3KYS3Z6KTSBLHB7DCOQ22BRIAK7URMX7LEFFLTIEOQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.709604816 (44h12m6.140684947s) [noise=true , address=104.36.82.41:4777 , piece_id=RDFS6K2GQDRF5Z7JJOBNGCLCFWCYTUSA4LDUK7TGV64CRVBPSHLQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.720718781 (44h12m6.151798912s) [noise=true , address=104.36.82.12:4175 , piece_id=UYQKT3QFS3MCMUYDVRI55TWOIWOSLJ6GAGOSV5IZCF6F7LLIHDMA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.727166458 (44h12m6.158246589s) [noise=true , address=104.36.82.3:4798 , piece_id=VBOZ4YXXXCOT472WRVWLN75RCJ7C6WSOLQBHH6XJ3TF2GD6UCMUA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.729065361 (44h12m6.160145492s) [noise=true , address=104.36.82.46:4484 , piece_id=VP4GLBIJ6CNH2ID73GGSR5QZQYVIN3RF26PJAIQ5GHEETUX7UROA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730134898 (44h12m6.161215029s) [noise=true , address=45.91.116.9:4288 , piece_id=ARJP5SHXE4P2LKUZPQTX2QILBIOIOE4Y37B2TJMDUDVC25KF6RWA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.730866336 (44h12m6.161946458s) [noise=true , address=104.36.82.61:4405 , piece_id=PK7VE2ZLDRL2BYQTN5SALAWKU3LBQ2ZJPQCD32TQIOA6PAT7LWFQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811817155 (44h12m6.242897286s) [noise=true , address=104.36.82.60:4357 , piece_id=LNZT2V3JGKF7HVGCGCRXB3YFLWX6OUEOJBHWTDTVONVYRDN7QIUQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: <nil>
Aug 10 13:38:11.811847913 (44h12m6.242928034s) [seg_pos={0 0}, upload=46132]: Segment reached optimal threshold of 14 pieces.
Aug 10 13:38:11.812057554 (44h12m6.243137685s) [noise=true , address=104.36.82.17:4341 , piece_id=OGKEQ4PSBAJZWMSWUDWXCRWS2W7M77QYO4W7JJMXQPJE62RQBRSQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1BfZXtm2GymdBAaEBFaX9jeYbK3PveonNNskUq9cLmuW7vbuu5): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812092992 (44h12m6.243173123s) [noise=true , address=104.36.82.44:4897 , piece_id=4675U6RVXPZSXO7KN6J6UG2FRBZG42GKN55GZVFIQ6YRLXBNR7NA, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xZEzok8AN2SUW6wups5Qug2TndRgrwkK2XMFvXfRyZcXFZRbU): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812152586 (44h12m6.243232727s) [noise=true , address=104.36.82.37:4677 , piece_id=A2IJY2FM2HO476WYV7YH3IIBGILPVBGEIYOIWH6E7DN2OBQWOQHQ, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QgDye4pcKhsndRP7tCxM44KZkSyRnhp219u8JnRHXX7jRutPv): protocol: expected piece hash; context canceled; EOF
Aug 10 13:38:11.812214605 (44h12m6.243294736s) [noise=true , address=104.36.82.23:4448 , piece_id=U2R4DNNGYFZRJKTP745BQFBZZ37CLITRXOCRQMWKN26EDSTHHO5A, seg_pos={0 0}, upload=46132]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JfhuZrWmNr3sBwxV9DKCs3CNQmeGEYnNN1PLwNtAE1dN4J77i): protocol: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35988->104.36.82.23:4448: use of closed network connection
Aug 10 13:38:11.812226588 (44h12m6.243306719s) [seg_pos={0 0}, upload=46132]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 13:38:11.812290430 (44h12m6.243370561s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 13:38:11.812294888 (44h12m6.243375019s) [upload=46132]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 13:38:12.128200480 (44h12m6.559280611s) [upload=46132]: Done uploading segments...
Aug 10 13:38:12.128221510 (44h12m6.559301641s) [upload=46132]: Upload finished. err: <nil>
Duration: 3.984618565s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.........X.X...X.................X......................X...] duration:
1.875835295s
FAIL (2025-08-10 13:37:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 84b6bd657c8cf238e5ba141295d76e74a9e094f3b5f88916c8e86a58803c1b70 != before 29829e321041a55f90b8aa0483c3ed75a21f83e0124b948419022f9ef834cec4 ======LOGS====== Aug 10 13:35:48.227055900 (44h9m42.658136031s) [upload=46085]: Starting upload Aug 10 13:35:48.227098662 (44h9m42.658178783s) [upload=46085]: Done starting upload Aug 10 13:35:48.227161652 (44h9m42.658241783s) [upload=46085]: Uploading segments... Aug 10 13:35:48.227197130 (44h9m42.658277261s) [upload=46085]: Got next segment. Inline: true Aug 10 13:35:48.227201178 (44h9m42.658281309s) [upload=46085]: Waiting for error group managing segments... Aug 10 13:35:48.227233229 (44h9m42.658313351s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:35:48.227237447 (44h9m42.658317578s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:35:48.227240052 (44h9m42.658320183s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:35:48.685598957 (44h9m43.116679078s) [upload=46085]: Done uploading segments... Aug 10 13:35:48.685621049 (44h9m43.11670118s) [upload=46085]: Upload finished. err: <nil>
Duration: 1.875947159s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.X......X............................X.X.................] duration:
6.184772168s
FAIL (2025-08-10 13:37:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.184795462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..........X.X...X.................X......................X..] duration:
1.833485253s
FAIL (2025-08-10 13:36:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 84b6bd657c8cf238e5ba141295d76e74a9e094f3b5f88916c8e86a58803c1b70 != before 29829e321041a55f90b8aa0483c3ed75a21f83e0124b948419022f9ef834cec4 ======LOGS====== Aug 10 13:35:48.227055900 (44h9m42.658136031s) [upload=46085]: Starting upload Aug 10 13:35:48.227098662 (44h9m42.658178783s) [upload=46085]: Done starting upload Aug 10 13:35:48.227161652 (44h9m42.658241783s) [upload=46085]: Uploading segments... Aug 10 13:35:48.227197130 (44h9m42.658277261s) [upload=46085]: Got next segment. Inline: true Aug 10 13:35:48.227201178 (44h9m42.658281309s) [upload=46085]: Waiting for error group managing segments... Aug 10 13:35:48.227233229 (44h9m42.658313351s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:35:48.227237447 (44h9m42.658317578s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:35:48.227240052 (44h9m42.658320183s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:35:48.685598957 (44h9m43.116679078s) [upload=46085]: Done uploading segments... Aug 10 13:35:48.685621049 (44h9m43.11670118s) [upload=46085]: Upload finished. err: <nil>
Duration: 1.833509269s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...........X.X...X.................X......................X.] duration:
1.999107941s
FAIL (2025-08-10 13:36:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 84b6bd657c8cf238e5ba141295d76e74a9e094f3b5f88916c8e86a58803c1b70 != before 29829e321041a55f90b8aa0483c3ed75a21f83e0124b948419022f9ef834cec4 ======LOGS====== Aug 10 13:35:48.227055900 (44h9m42.658136031s) [upload=46085]: Starting upload Aug 10 13:35:48.227098662 (44h9m42.658178783s) [upload=46085]: Done starting upload Aug 10 13:35:48.227161652 (44h9m42.658241783s) [upload=46085]: Uploading segments... Aug 10 13:35:48.227197130 (44h9m42.658277261s) [upload=46085]: Got next segment. Inline: true Aug 10 13:35:48.227201178 (44h9m42.658281309s) [upload=46085]: Waiting for error group managing segments... Aug 10 13:35:48.227233229 (44h9m42.658313351s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:35:48.227237447 (44h9m42.658317578s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:35:48.227240052 (44h9m42.658320183s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:35:48.685598957 (44h9m43.116679078s) [upload=46085]: Done uploading segments... Aug 10 13:35:48.685621049 (44h9m43.11670118s) [upload=46085]: Upload finished. err: <nil>
Duration: 1.999133721s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X.X......X............................X.X................] duration:
5.693001315s
FAIL (2025-08-10 13:36:08 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.693042944s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [............X.X...X.................X......................X] duration:
1.787507379s
FAIL (2025-08-10 13:35:49 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 84b6bd657c8cf238e5ba141295d76e74a9e094f3b5f88916c8e86a58803c1b70 != before 29829e321041a55f90b8aa0483c3ed75a21f83e0124b948419022f9ef834cec4 ======LOGS====== Aug 10 13:35:48.227055900 (44h9m42.658136031s) [upload=46085]: Starting upload Aug 10 13:35:48.227098662 (44h9m42.658178783s) [upload=46085]: Done starting upload Aug 10 13:35:48.227161652 (44h9m42.658241783s) [upload=46085]: Uploading segments... Aug 10 13:35:48.227197130 (44h9m42.658277261s) [upload=46085]: Got next segment. Inline: true Aug 10 13:35:48.227201178 (44h9m42.658281309s) [upload=46085]: Waiting for error group managing segments... Aug 10 13:35:48.227233229 (44h9m42.658313351s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:35:48.227237447 (44h9m42.658317578s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:35:48.227240052 (44h9m42.658320183s) [upload=46085]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:35:48.685598957 (44h9m43.116679078s) [upload=46085]: Done uploading segments... Aug 10 13:35:48.685621049 (44h9m43.11670118s) [upload=46085]: Upload finished. err: <nil>
Duration: 1.787532328s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....X.X......X............................X.X...............] duration:
5.817086538s
FAIL (2025-08-10 13:35:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.817112457s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.X...X.................X......................] duration:
1.827394777s
FAIL (2025-08-10 13:34:57 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 1.827414445s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....X.X......X............................X.X..............] duration:
5.751593102s
FAIL (2025-08-10 13:34:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.75161775s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.X...X.................X.....................] duration:
1.83511451s
FAIL (2025-08-10 13:33:49 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 1.835148586s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......X.X......X............................X.X.............] duration:
6.181926601s
FAIL (2025-08-10 13:33:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.18200982s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X.X...X.................X....................] duration:
1.950602983s
FAIL (2025-08-10 13:33:05 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 1.950632098s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......X.X......X............................X.X............] duration:
5.643306541s
FAIL (2025-08-10 13:32:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.643332972s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........X.X......X............................X.X...........] duration:
5.913694693s
FAIL (2025-08-10 13:32:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.91371402s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X.X...X.................X...................] duration:
1.870167179s
FAIL (2025-08-10 13:32:01 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 1.870196406s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........X.X......X............................X.X..........] duration:
5.723422901s
FAIL (2025-08-10 13:31:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.723445033s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..........X.X......X............................X.X.........] duration:
5.867338637s
FAIL (2025-08-10 13:31:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.867387262s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X.X...X.................X..................] duration:
1.847143559s
FAIL (2025-08-10 13:30:47 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 1.847161974s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X.X...X.................X.................] duration:
1.868238811s
FAIL (2025-08-10 13:30:22 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 1.868268158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X.X...X.................X................] duration:
1.925212062s
FAIL (2025-08-10 13:30:02 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 1.925241408s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X.X......X............................X.X........] duration:
5.910430248s
FAIL (2025-08-10 13:29:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.910455366s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X.X...X.................X...............] duration:
2.035920227s
FAIL (2025-08-10 13:29:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 2.035951076s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X.X......X............................X.X.......] duration:
5.784052161s
FAIL (2025-08-10 13:29:01 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.784068262s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X.X...X.................X..............] duration:
1.924308475s
FAIL (2025-08-10 13:28:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 1.924333433s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X.X......X............................X.X......] duration:
5.856135228s
FAIL (2025-08-10 13:28:22 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.856155829s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................X.X...X.................X.............] duration:
1.907540971s
FAIL (2025-08-10 13:27:59 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 1.907572632s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......................X.X...X.................X............] duration:
2.293535174s
FAIL (2025-08-10 13:27:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 2.293561403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X.X......X............................X.X.....] duration:
5.601404395s
FAIL (2025-08-10 13:27:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 13:22:48.512911780 (43h56m42.943991911s) [upload=45863]: Starting upload Aug 10 13:22:48.512964892 (43h56m42.944045023s) [upload=45863]: Done starting upload Aug 10 13:22:48.513082065 (43h56m42.944162197s) [upload=45863]: Uploading segments... Aug 10 13:22:48.513197417 (43h56m42.944277538s) [upload=45863]: Got next segment. Inline: false Aug 10 13:22:48.513232063 (43h56m42.944312194s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:22:48.513236752 (43h56m42.944316883s) [upload=45863]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 13:22:48.726835998 (43h56m43.157916119s) [upload=45863]: Next segment err: metaclient: Too Many Requests Aug 10 13:22:48.726859253 (43h56m43.157939384s) [upload=45863]: Done uploading segments... Aug 10 13:22:48.726890813 (43h56m43.157970944s) [upload=45863]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.601425485s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........................X.X...X.................X...........] duration:
1.829751039s
FAIL (2025-08-10 13:26:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 1.829776047s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X........................X.X...X.................X..........] duration:
1.946836798s
FAIL (2025-08-10 13:26:18 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 10 13:18:52.339701358 (43h52m46.770781479s) [upload=45794]: Starting upload Aug 10 13:18:52.339741113 (43h52m46.770821234s) [upload=45794]: Done starting upload Aug 10 13:18:52.339792552 (43h52m46.770872683s) [upload=45794]: Uploading segments... Aug 10 13:18:52.339836416 (43h52m46.770916547s) [upload=45794]: Got next segment. Inline: true Aug 10 13:18:52.339840414 (43h52m46.770920545s) [upload=45794]: Waiting for error group managing segments... Aug 10 13:18:52.339897012 (43h52m46.770977143s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 13:18:52.339901841 (43h52m46.770981962s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 13:18:52.339904406 (43h52m46.770984537s) [upload=45794]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 13:18:52.607429673 (43h52m47.038509794s) [upload=45794]: Done uploading segments... Aug 10 13:18:52.607445694 (43h52m47.038525825s) [upload=45794]: Upload finished. err: <nil>
Duration: 1.946886643s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|