Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X..X.....X...........................X............] duration: 1.912365536s FAIL (2025-08-21 06:00:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.912400803s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.045603365s FAIL (2025-08-21 05:59:43 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.045635245s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X.............X.....................................] duration: 5.584282353s FAIL (2025-08-21 05:59:36 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.584309144s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........X..X.....X...........................X...........] duration: 1.812723301s FAIL (2025-08-21 05:59:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.812743669s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X........X.............X....................................] duration: 5.677592528s FAIL (2025-08-21 05:59:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.677618809s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.131588928s FAIL (2025-08-21 05:58:43 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.13161668s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............X..X.....X...........................X..........] duration: 2.01467407s FAIL (2025-08-21 05:58:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.014709317s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X........X.............X...................................] duration: 5.82587325s FAIL (2025-08-21 05:57:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.825913868s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.667884577s FAIL (2025-08-21 05:57:56 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.66791212s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............X..X.....X...........................X.........] duration: 2.020060127s FAIL (2025-08-21 05:57:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.020086317s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X........X.............X..................................] duration: 5.780591214s FAIL (2025-08-21 05:57:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.780642692s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X........X.............X.................................] duration: 5.726260489s FAIL (2025-08-21 05:57:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.726284635s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.70255018s FAIL (2025-08-21 05:56:57 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.702574578s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X........X.............X................................] duration: 5.720481049s FAIL (2025-08-21 05:56:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.720513793s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............X..X.....X...........................X........] duration: 1.844117242s FAIL (2025-08-21 05:56:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.844136419s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.922870042s FAIL (2025-08-21 05:56:28 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.922904047s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............X..X.....X...........................X.......] duration: 1.824385849s FAIL (2025-08-21 05:56:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.82442347s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X........X.............X...............................] duration: 5.548091423s FAIL (2025-08-21 05:55:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.54811622s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.891332173s FAIL (2025-08-21 05:55:18 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.891361028s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [................X..X.....X...........................X......] duration: 1.844282598s FAIL (2025-08-21 05:54:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.844320831s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.................X..X.....X...........................X.....] duration: 2.058297479s FAIL (2025-08-21 05:54:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.05832312s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X........X.............X..............................] duration: 5.581763109s FAIL (2025-08-21 05:54:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.581797083s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.815512761s FAIL (2025-08-21 05:54:08 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.815540434s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..................X..X.....X...........................X....] duration: 1.820473493s FAIL (2025-08-21 05:54:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.820499743s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X........X.............X.............................] duration: 5.677331549s FAIL (2025-08-21 05:53:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.677358561s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.75516344s FAIL (2025-08-21 05:53:18 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.755192104s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...................X..X.....X...........................X...] duration: 1.827207867s FAIL (2025-08-21 05:53:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.827235361s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X........X.............X............................] duration: 5.741063449s FAIL (2025-08-21 05:53:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.741086983s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....................X..X.....X...........................X..] duration: 2.010777735s FAIL (2025-08-21 05:52:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 2.010803644s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.710825304s FAIL (2025-08-21 05:52:30 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.710846957s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....................X..X.....X...........................X.] duration: 1.831608648s FAIL (2025-08-21 05:52:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.831637555s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X........X.............X...........................] duration: 5.791628125s FAIL (2025-08-21 05:52:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.791655778s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........X........X.............X..........................] duration: 5.539485235s FAIL (2025-08-21 05:51:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.539517006s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......................X..X.....X...........................X] duration: 855.358926ms FAIL (2025-08-21 05:51:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 21 05:51:29.641170105 (300h25m24.072250226s) [upload=312507]: Starting upload Aug 21 05:51:29.641218719 (300h25m24.07229885s) [upload=312507]: Done starting upload Aug 21 05:51:29.641271419 (300h25m24.07235155s) [upload=312507]: Uploading segments... Aug 21 05:51:29.641302519 (300h25m24.07238264s) [upload=312507]: Got next segment. Inline: true Aug 21 05:51:29.641305855 (300h25m24.072385986s) [upload=312507]: Waiting for error group managing segments... Aug 21 05:51:29.641339309 (300h25m24.07241944s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:51:29.641343136 (300h25m24.072423267s) [upload=312507]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:51:29.641345691 (300h25m24.072425822s) [upload=312507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:51:29.853250117 (300h25m24.284330248s) [upload=312507]: Done uploading segments... Aug 21 05:51:29.853272861 (300h25m24.284353052s) [upload=312507]: Upload finished. err: metaclient: Too Many Requests Duration:* 855.373493ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.644217347s FAIL (2025-08-21 05:51:18 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.64424536s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X..X.....X...........................] duration: 1.856366581s FAIL (2025-08-21 05:51:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.856691462s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X........X.............X.........................] duration: 5.662528134s FAIL (2025-08-21 05:50:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.66255702s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X..X.....X..........................] duration: 1.992828404s FAIL (2025-08-21 05:50:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.992895963s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.756304394s FAIL (2025-08-21 05:50:25 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.75633315s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X........X.............X........................] duration: 5.621258209s FAIL (2025-08-21 05:50:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.621281723s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X..X.....X.........................] duration: 1.837968577s FAIL (2025-08-21 05:50:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.838002292s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.775709359s FAIL (2025-08-21 05:49:55 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.775773964s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.761466464s FAIL (2025-08-21 05:49:35 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.761496002s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X..X.....X........................] duration: 1.925807196s FAIL (2025-08-21 05:49:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.92583533s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X........X.............X.......................] duration: 5.550005483s FAIL (2025-08-21 05:49:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.55003534s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.944716107s FAIL (2025-08-21 05:49:10 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.944744251s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.993323072s FAIL (2025-08-21 05:48:28 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.993352849s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X..X.....X.......................] duration: 1.890946046s FAIL (2025-08-21 05:48:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.89097487s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X........X.............X......................] duration: 5.728032799s FAIL (2025-08-21 05:48:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.728060543s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X........X.............X.....................] duration: 5.702737701s FAIL (2025-08-21 05:47:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.702767096s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)