Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.587878029s FAIL (2025-08-21 05:47:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.587901974s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [X...........................X..X.....X......................] duration: 1.819161019s FAIL (2025-08-21 05:47:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.819192701s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................X........X.............X....................] duration: 5.554318367s FAIL (2025-08-21 05:47:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.554347904s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.X...........................X..X.....X.....................] duration: 1.819806736s FAIL (2025-08-21 05:46:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.819843326s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.803905495s FAIL (2025-08-21 05:46:16 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.803931774s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..X...........................X..X.....X....................] duration: 2.060312769s FAIL (2025-08-21 05:46:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 2.060341393s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................X........X.............X...................] duration: 5.765806626s FAIL (2025-08-21 05:45:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.765825982s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.070301901s FAIL (2025-08-21 05:45:53 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.070337859s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................X........X.............X..................] duration: 5.967569658s FAIL (2025-08-21 05:45:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.967598272s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...X...........................X..X.....X...................] duration: 1.88220044s FAIL (2025-08-21 05:45:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.882275924s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.991325019s FAIL (2025-08-21 05:45:01 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.991405403s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................X........X.............X.................] duration: 5.653413432s FAIL (2025-08-21 05:44:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.653434544s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....X...........................X..X.....X..................] duration: 1.870368731s FAIL (2025-08-21 05:44:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.87039486s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.65150319s FAIL (2025-08-21 05:44:16 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.651532496s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................X........X.............X................] duration: 5.897839426s FAIL (2025-08-21 05:44:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.8978626s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....X...........................X..X.....X.................] duration: 2.062798803s FAIL (2025-08-21 05:44:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 2.062819563s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................X........X.............X...............] duration: 5.681737209s FAIL (2025-08-21 05:43:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.681760053s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......X...........................X..X.....X................] duration: 2.078198851s FAIL (2025-08-21 05:43:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 2.078231254s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.666839263s FAIL (2025-08-21 05:43:03 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.666864941s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................X........X.............X..............] duration: 5.60114855s FAIL (2025-08-21 05:42:50 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.601186451s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X...........................X..X.....X...............] duration: 1.867612838s FAIL (2025-08-21 05:42:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.867653006s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X...........................X..X.....X..............] duration: 1.911009863s FAIL (2025-08-21 05:41:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.911030372s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.772396258s FAIL (2025-08-21 05:41:50 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.772421504s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................X........X.............X.............] duration: 5.481701713s FAIL (2025-08-21 05:41:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.481728355s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................X........X.............X............] duration: 5.671027038s FAIL (2025-08-21 05:41:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.671059188s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.620976399s FAIL (2025-08-21 05:41:10 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.621021375s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........X...........................X..X.....X.............] duration: 1.868718293s FAIL (2025-08-21 05:41:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.868747279s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........X...........................X..X.....X............] duration: 1.900976526s FAIL (2025-08-21 05:40:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.90100411s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................X........X.............X...........] duration: 5.699261157s FAIL (2025-08-21 05:40:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.699290974s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.851245741s FAIL (2025-08-21 05:40:13 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.851270187s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X........X.............X..........] duration: 5.765248112s FAIL (2025-08-21 05:39:54 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.765272549s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........X...........................X..X.....X...........] duration: 1.870630588s FAIL (2025-08-21 05:39:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.870659754s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............X...........................X..X.....X..........] duration: 2.196161894s FAIL (2025-08-21 05:39:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 2.196191471s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.725636723s FAIL (2025-08-21 05:39:10 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.725663825s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................X........X.............X.........] duration: 5.98216421s FAIL (2025-08-21 05:39:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.98219574s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.737974529s FAIL (2025-08-21 05:38:54 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.738002052s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............X...........................X..X.....X.........] duration: 2.013033603s FAIL (2025-08-21 05:38:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 2.013081283s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.554879599s FAIL (2025-08-21 05:38:31 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.554907592s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................X........X.............X........] duration: 5.77927409s FAIL (2025-08-21 05:38:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.779294109s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.878038606s FAIL (2025-08-21 05:38:08 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.878064165s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................X........X.............X.......] duration: 7.254893184s FAIL (2025-08-21 05:37:56 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 7.254920475s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............X...........................X..X.....X........] duration: 2.021090175s FAIL (2025-08-21 05:37:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 2.021137667s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.713935034s FAIL (2025-08-21 05:37:26 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.713965843s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................X........X.............X......] duration: 5.678236759s FAIL (2025-08-21 05:37:12 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.678263128s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.625939482s FAIL (2025-08-21 05:36:54 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.625972977s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............X...........................X..X.....X.......] duration: 1.90851765s FAIL (2025-08-21 05:36:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after db493a3d0a7f3536c90d94351a64fc73dad3a6b583f37453e751438d50c34624 != before d5a7b4d3f6bdf00b1a0561fbe26c428a74b4e0dcff8bc543ec23fe32efd19f5d ======LOGS====== Aug 21 05:31:25.771632862 (300h5m20.202712993s) [upload=312142]: Starting upload Aug 21 05:31:25.771676326 (300h5m20.202756457s) [upload=312142]: Done starting upload Aug 21 05:31:25.771725550 (300h5m20.202805681s) [upload=312142]: Uploading segments... Aug 21 05:31:25.771757411 (300h5m20.202837542s) [upload=312142]: Got next segment. Inline: true Aug 21 05:31:25.771761348 (300h5m20.202841479s) [upload=312142]: Waiting for error group managing segments... Aug 21 05:31:25.771791536 (300h5m20.202871667s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:31:25.771795463 (300h5m20.202875584s) [upload=312142]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 21 05:31:25.771798499 (300h5m20.20287863s) [upload=312142]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:31:27.089469072 (300h5m21.520549223s) [upload=312142]: Done uploading segments... Aug 21 05:31:27.089489952 (300h5m21.520570083s) [upload=312142]: Upload finished. err: <nil> Duration:* 1.908549992s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................X........X.............X.....] duration: 5.534140043s FAIL (2025-08-21 05:36:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.534189358s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X........X.............X....] duration: 5.689837193s FAIL (2025-08-21 05:36:23 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 21 05:33:59.258571027 (300h7m53.689651158s) [upload=312189]: Starting upload Aug 21 05:33:59.258620962 (300h7m53.689701083s) [upload=312189]: Done starting upload Aug 21 05:33:59.258717777 (300h7m53.689797908s) [upload=312189]: Uploading segments... Aug 21 05:33:59.258848618 (300h7m53.689928739s) [upload=312189]: Got next segment. Inline: false Aug 21 05:33:59.259240016 (300h7m53.690320147s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 21 05:33:59.259247862 (300h7m53.690327993s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 21 05:33:59.717523631 (300h7m54.148603822s) [seg_pos={0 0}, upload=312189]: Begin upload segment... Aug 21 05:33:59.717587663 (300h7m54.148667804s) [seg_pos={0 0}, upload=312189]: Done begin upload segment. Aug 21 05:33:59.717620957 (300h7m54.148701118s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717640064 (300h7m54.148720205s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.717759863 (300h7m54.148840034s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718514166 (300h7m54.149594307s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718672789 (300h7m54.14975294s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.718938037 (300h7m54.150018188s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.719420230 (300h7m54.150500361s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722170462 (300h7m54.153250593s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722377588 (300h7m54.153457729s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722605594 (300h7m54.153685735s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.722920296 (300h7m54.154000437s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723030427 (300h7m54.154110568s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723448697 (300h7m54.154528828s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723477051 (300h7m54.154557182s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723483114 (300h7m54.154563245s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723487282 (300h7m54.154567413s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723491890 (300h7m54.154572021s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:33:59.723702724 (300h7m54.154782865s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Uploading piece... Aug 21 05:34:00.856696849 (300h7m55.28777698s) [upload=312189]: Next returned nil segment Aug 21 05:34:00.856716326 (300h7m55.287796457s) [upload=312189]: Waiting for error group managing segments... Aug 21 05:34:01.142354361 (300h7m55.573434492s) [noise=true , address=79.127.205.246:4288 , piece_id=WBG36H6N2FHT2WVVLF4JSXXWPBI5KLVSTEJ4SLRVNKT7FA2HSSZQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.180779383 (300h7m55.611859515s) [noise=true , address=79.127.205.234:4609 , piece_id=VZ4W6XWDPX5NIKT6QJREPMUKAA3ZHTOCMF5OLQ2AG4QROFSODJRA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.604454297 (300h7m56.035534428s) [noise=true , address=77.90.31.21:4884 , piece_id=O3QD2HDNC445MA3RB7QEPWCMPPBA2P65ODYZW4MKMOECBNKIGESQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.615816969 (300h7m56.0468971s) [noise=true , address=77.90.31.15:4727 , piece_id=4XJEYKKX24VMDAMHIR2J4YQVVDAXJF76IDUWV73Q6EKRWXPD4WWA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.627783065 (300h7m56.058863196s) [noise=true , address=77.90.31.17:4788 , piece_id=KFMGVBU67LAZZCOHGMEEKSG4XNAUTL3XE6PH6F6WHO4SF6U53DTQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.636339236 (300h7m56.067419367s) [noise=true , address=104.36.82.18:4392 , piece_id=VYJGTAQHLQUWCLPCY6BWMG6VUHULSZ7Q3BINKL7EMU2FJADFDFSA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.645253262 (300h7m56.076333393s) [noise=true , address=77.90.31.11:4581 , piece_id=LMGWW5S5RWIMNECBPSZXWMQBRRHLWFEHFBOTEHAOHTWDFCTJQ4QQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.669526536 (300h7m56.100606667s) [noise=true , address=77.90.31.18:4815 , piece_id=66UVP6EB3BAGWLJL63PWDPFF5GBPDKWR7DOJVJ4B5PZPFRMQ67MQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.684731379 (300h7m56.11581151s) [noise=true , address=77.90.31.19:4873 , piece_id=PQ3FSJ2TP7PJYMQI476UUGM4D7HIWKDHE7U6R2JBJACMTB4C44JQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.690813827 (300h7m56.121893958s) [noise=true , address=77.90.31.13:4656 , piece_id=AMNKGLACBNL76TH2H5TNFPSIA2XQ7FJM2ES6HMEPBAPIXOKQNBBA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.691763003 (300h7m56.122843134s) [noise=true , address=77.90.31.16:4767 , piece_id=5ISJDBEE7DRSUB53755IHRRV23NCOZG6IIAUAUDIHJD6GYRSS45Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.702118838 (300h7m56.133198969s) [noise=true , address=45.91.116.9:4277 , piece_id=PWEZQTI2Q5JBVMQM5D4AGXZXCIGJE64MDV4OBK4AAZXKMHNMEJKQ, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.713908186 (300h7m56.144988317s) [noise=true , address=104.36.82.23:4445 , piece_id=TISV5BF3P37LG7PXRX2UVTBF4RDWYCZEDJAPXAIIXOHSMX4RZTNA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720895103 (300h7m56.151975235s) [noise=true , address=104.36.82.5:4847 , piece_id=U275YHEP24BIRI3NGEYE7ICAUSTW67RAQJBLIEJZENO2DIL345LA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: <nil> Aug 21 05:34:01.720921173 (300h7m56.152001304s) [seg_pos={0 0}, upload=312189]: Segment reached optimal threshold of 14 pieces. Aug 21 05:34:01.721035914 (300h7m56.152116045s) [noise=true , address=45.91.116.14:4219 , piece_id=BUSINUVMPSKMQXIYXVRVDX2YAMLNSJUZNKYTYBJGFAPI7SYXHR3Q, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gdoFPze5qLmQfouMyko8R8UNhFcNDMgawCWWySyQ8kdrfUXPr): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721065380 (300h7m56.152145521s) [noise=true , address=104.36.82.40:4957 , piece_id=IZ5RICPIOUGE5IMI432E3XP5UUSKPZODBYYHWU43M6CI7QHEHOGA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129iWqwdULbj7gs2Rd5xjEQn1Mgp6EDVZyFpSaoAZraRwCveyQn): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721092241 (300h7m56.152172373s) [noise=true , address=45.91.116.12:4235 , piece_id=XIICRMKY3JJVDYFCCOFAXGF5WGTIYR42OUWGTQM5D5E7TSGTOFOA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zJ9RVdURVEzMruVa7LYGiPmGX4JdTemxSDwYUEbt8bA6U73WB): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721130584 (300h7m56.152210716s) [noise=true , address=104.36.82.60:4367 , piece_id=YCCJW4CXZA2GULIYCWNNXDW2CLYV4HX7KSVTSGAMYFMANVAOTDZA, seg_pos={0 0}, upload=312189]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK): protocol: expected piece hash; context canceled; EOF Aug 21 05:34:01.721141725 (300h7m56.152221856s) [seg_pos={0 0}, upload=312189]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 21 05:34:01.721213243 (300h7m56.152293374s) [upload=312189]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 21 05:34:01.721217400 (300h7m56.152297531s) [upload=312189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 21 05:34:02.023292106 (300h7m56.454372237s) [upload=312189]: Done uploading segments... Aug 21 05:34:02.023317093 (300h7m56.454397224s) [upload=312189]: Upload finished. err: <nil> Duration: 5.689867009s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.68241441s FAIL (2025-08-21 05:36:21 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.682448035s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.874832532s FAIL (2025-08-21 05:35:58 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 5.874859656s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)