Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.931414533s FAIL (2025-08-14 09:17:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.931435893s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................................X..X...........X..] duration: 1.846307259s FAIL (2025-08-14 09:17:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.846330714s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.046524931s FAIL (2025-08-14 09:16:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.046552524s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X.........X....XX.........................................] duration: 5.541648878s FAIL (2025-08-14 09:16:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.541672964s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X.........X....XX........................................] duration: 5.742482806s FAIL (2025-08-14 09:16:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.742509717s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................................X..X...........X.] duration: 1.924090793s FAIL (2025-08-14 09:16:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.924121904s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................................X..X...........X] duration: 1.588296796s FAIL (2025-08-14 09:15:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.588322426s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.461701748s FAIL (2025-08-14 09:15:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.461725052s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X.........X....XX.......................................] duration: 5.542672635s FAIL (2025-08-14 09:15:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.542701831s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X............................................X..X...........] duration: 1.837894487s FAIL (2025-08-14 09:14:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 09:06:18.331728314 (135h40m12.762808445s) [upload=141124]: Starting upload Aug 14 09:06:18.331774552 (135h40m12.762854683s) [upload=141124]: Done starting upload Aug 14 09:06:18.331829598 (135h40m12.762909729s) [upload=141124]: Uploading segments... Aug 14 09:06:18.331888370 (135h40m12.762968501s) [upload=141124]: Got next segment. Inline: true Aug 14 09:06:18.331891777 (135h40m12.762971908s) [upload=141124]: Waiting for error group managing segments... Aug 14 09:06:18.331929589 (135h40m12.76300971s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:06:18.331934067 (135h40m12.763014198s) [upload=141124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:06:18.331936872 (135h40m12.763017003s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:06:18.622093599 (135h40m13.05317373s) [upload=141124]: Done uploading segments... Aug 14 09:06:18.622111313 (135h40m13.053191444s) [upload=141124]: Upload finished. err: <nil> Duration:* 1.837921069s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X.........X....XX......................................] duration: 5.417600035s FAIL (2025-08-14 09:14:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.417631265s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 6.351444764s FAIL (2025-08-14 09:14:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.351471535s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X............................................X..X..........] duration: 2.050017881s FAIL (2025-08-14 09:14:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 09:06:18.331728314 (135h40m12.762808445s) [upload=141124]: Starting upload Aug 14 09:06:18.331774552 (135h40m12.762854683s) [upload=141124]: Done starting upload Aug 14 09:06:18.331829598 (135h40m12.762909729s) [upload=141124]: Uploading segments... Aug 14 09:06:18.331888370 (135h40m12.762968501s) [upload=141124]: Got next segment. Inline: true Aug 14 09:06:18.331891777 (135h40m12.762971908s) [upload=141124]: Waiting for error group managing segments... Aug 14 09:06:18.331929589 (135h40m12.76300971s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:06:18.331934067 (135h40m12.763014198s) [upload=141124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:06:18.331936872 (135h40m12.763017003s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:06:18.622093599 (135h40m13.05317373s) [upload=141124]: Done uploading segments... Aug 14 09:06:18.622111313 (135h40m13.053191444s) [upload=141124]: Upload finished. err: <nil> Duration:* 2.05004362s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X.........X....XX.....................................] duration: 5.632662766s FAIL (2025-08-14 09:13:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.632690178s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.876798871s FAIL (2025-08-14 09:13:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.876822706s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X............................................X..X.........] duration: 1.922346787s FAIL (2025-08-14 09:13:12 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 09:06:18.331728314 (135h40m12.762808445s) [upload=141124]: Starting upload Aug 14 09:06:18.331774552 (135h40m12.762854683s) [upload=141124]: Done starting upload Aug 14 09:06:18.331829598 (135h40m12.762909729s) [upload=141124]: Uploading segments... Aug 14 09:06:18.331888370 (135h40m12.762968501s) [upload=141124]: Got next segment. Inline: true Aug 14 09:06:18.331891777 (135h40m12.762971908s) [upload=141124]: Waiting for error group managing segments... Aug 14 09:06:18.331929589 (135h40m12.76300971s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:06:18.331934067 (135h40m12.763014198s) [upload=141124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:06:18.331936872 (135h40m12.763017003s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:06:18.622093599 (135h40m13.05317373s) [upload=141124]: Done uploading segments... Aug 14 09:06:18.622111313 (135h40m13.053191444s) [upload=141124]: Upload finished. err: <nil> Duration:* 1.922465053s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X.........X....XX....................................] duration: 5.51451469s FAIL (2025-08-14 09:13:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.514540698s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.......X.........X....XX...................................] duration: 5.931054862s FAIL (2025-08-14 09:12:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.93107912s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 6.013759015s FAIL (2025-08-14 09:12:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.013782511s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X............................................X..X........] duration: 1.849742581s FAIL (2025-08-14 09:12:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 09:06:18.331728314 (135h40m12.762808445s) [upload=141124]: Starting upload Aug 14 09:06:18.331774552 (135h40m12.762854683s) [upload=141124]: Done starting upload Aug 14 09:06:18.331829598 (135h40m12.762909729s) [upload=141124]: Uploading segments... Aug 14 09:06:18.331888370 (135h40m12.762968501s) [upload=141124]: Got next segment. Inline: true Aug 14 09:06:18.331891777 (135h40m12.762971908s) [upload=141124]: Waiting for error group managing segments... Aug 14 09:06:18.331929589 (135h40m12.76300971s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:06:18.331934067 (135h40m12.763014198s) [upload=141124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:06:18.331936872 (135h40m12.763017003s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:06:18.622093599 (135h40m13.05317373s) [upload=141124]: Done uploading segments... Aug 14 09:06:18.622111313 (135h40m13.053191444s) [upload=141124]: Upload finished. err: <nil> Duration:* 1.849767468s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.......X.........X....XX..................................] duration: 5.580921464s FAIL (2025-08-14 09:12:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.580957253s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X............................................X..X.......] duration: 1.818883925s FAIL (2025-08-14 09:11:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 09:06:18.331728314 (135h40m12.762808445s) [upload=141124]: Starting upload Aug 14 09:06:18.331774552 (135h40m12.762854683s) [upload=141124]: Done starting upload Aug 14 09:06:18.331829598 (135h40m12.762909729s) [upload=141124]: Uploading segments... Aug 14 09:06:18.331888370 (135h40m12.762968501s) [upload=141124]: Got next segment. Inline: true Aug 14 09:06:18.331891777 (135h40m12.762971908s) [upload=141124]: Waiting for error group managing segments... Aug 14 09:06:18.331929589 (135h40m12.76300971s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:06:18.331934067 (135h40m12.763014198s) [upload=141124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:06:18.331936872 (135h40m12.763017003s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:06:18.622093599 (135h40m13.05317373s) [upload=141124]: Done uploading segments... Aug 14 09:06:18.622111313 (135h40m13.053191444s) [upload=141124]: Upload finished. err: <nil> Duration:* 1.81893846s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.063818714s FAIL (2025-08-14 09:11:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.063841218s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X............................................X..X......] duration: 1.830103583s FAIL (2025-08-14 09:11:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 09:06:18.331728314 (135h40m12.762808445s) [upload=141124]: Starting upload Aug 14 09:06:18.331774552 (135h40m12.762854683s) [upload=141124]: Done starting upload Aug 14 09:06:18.331829598 (135h40m12.762909729s) [upload=141124]: Uploading segments... Aug 14 09:06:18.331888370 (135h40m12.762968501s) [upload=141124]: Got next segment. Inline: true Aug 14 09:06:18.331891777 (135h40m12.762971908s) [upload=141124]: Waiting for error group managing segments... Aug 14 09:06:18.331929589 (135h40m12.76300971s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:06:18.331934067 (135h40m12.763014198s) [upload=141124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:06:18.331936872 (135h40m12.763017003s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:06:18.622093599 (135h40m13.05317373s) [upload=141124]: Done uploading segments... Aug 14 09:06:18.622111313 (135h40m13.053191444s) [upload=141124]: Upload finished. err: <nil> Duration:* 1.830129663s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X.......X.........X....XX.................................] duration: 5.784837256s FAIL (2025-08-14 09:11:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.784876452s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.321890356s FAIL (2025-08-14 09:10:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.321925824s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X.......X.........X....XX................................] duration: 5.646490546s FAIL (2025-08-14 09:10:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.646511647s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X............................................X..X.....] duration: 1.844442758s FAIL (2025-08-14 09:10:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 09:06:18.331728314 (135h40m12.762808445s) [upload=141124]: Starting upload Aug 14 09:06:18.331774552 (135h40m12.762854683s) [upload=141124]: Done starting upload Aug 14 09:06:18.331829598 (135h40m12.762909729s) [upload=141124]: Uploading segments... Aug 14 09:06:18.331888370 (135h40m12.762968501s) [upload=141124]: Got next segment. Inline: true Aug 14 09:06:18.331891777 (135h40m12.762971908s) [upload=141124]: Waiting for error group managing segments... Aug 14 09:06:18.331929589 (135h40m12.76300971s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:06:18.331934067 (135h40m12.763014198s) [upload=141124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:06:18.331936872 (135h40m12.763017003s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:06:18.622093599 (135h40m13.05317373s) [upload=141124]: Done uploading segments... Aug 14 09:06:18.622111313 (135h40m13.053191444s) [upload=141124]: Upload finished. err: <nil> Duration:* 1.844471663s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 6.136081876s FAIL (2025-08-14 09:09:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.136108627s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X.......X.........X....XX...............................] duration: 5.74441835s FAIL (2025-08-14 09:09:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.744448168s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X............................................X..X....] duration: 1.840721067s FAIL (2025-08-14 09:09:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 09:06:18.331728314 (135h40m12.762808445s) [upload=141124]: Starting upload Aug 14 09:06:18.331774552 (135h40m12.762854683s) [upload=141124]: Done starting upload Aug 14 09:06:18.331829598 (135h40m12.762909729s) [upload=141124]: Uploading segments... Aug 14 09:06:18.331888370 (135h40m12.762968501s) [upload=141124]: Got next segment. Inline: true Aug 14 09:06:18.331891777 (135h40m12.762971908s) [upload=141124]: Waiting for error group managing segments... Aug 14 09:06:18.331929589 (135h40m12.76300971s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:06:18.331934067 (135h40m12.763014198s) [upload=141124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:06:18.331936872 (135h40m12.763017003s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:06:18.622093599 (135h40m13.05317373s) [upload=141124]: Done uploading segments... Aug 14 09:06:18.622111313 (135h40m13.053191444s) [upload=141124]: Upload finished. err: <nil> Duration:* 1.84074834s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X............................................X..X...] duration: 1.980307117s FAIL (2025-08-14 09:08:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 09:06:18.331728314 (135h40m12.762808445s) [upload=141124]: Starting upload Aug 14 09:06:18.331774552 (135h40m12.762854683s) [upload=141124]: Done starting upload Aug 14 09:06:18.331829598 (135h40m12.762909729s) [upload=141124]: Uploading segments... Aug 14 09:06:18.331888370 (135h40m12.762968501s) [upload=141124]: Got next segment. Inline: true Aug 14 09:06:18.331891777 (135h40m12.762971908s) [upload=141124]: Waiting for error group managing segments... Aug 14 09:06:18.331929589 (135h40m12.76300971s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:06:18.331934067 (135h40m12.763014198s) [upload=141124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:06:18.331936872 (135h40m12.763017003s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:06:18.622093599 (135h40m13.05317373s) [upload=141124]: Done uploading segments... Aug 14 09:06:18.622111313 (135h40m13.053191444s) [upload=141124]: Upload finished. err: <nil> Duration:* 1.980333727s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 6.054879683s FAIL (2025-08-14 09:08:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.054900484s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X.......X.........X....XX..............................] duration: 5.684975759s FAIL (2025-08-14 09:08:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.685001759s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X.......X.........X....XX.............................] duration: 5.706385893s FAIL (2025-08-14 09:07:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.706410159s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 10.580345092s FAIL (2025-08-14 09:07:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.580705212s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X............................................X..X..] duration: 1.859255232s FAIL (2025-08-14 09:07:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 09:06:18.331728314 (135h40m12.762808445s) [upload=141124]: Starting upload Aug 14 09:06:18.331774552 (135h40m12.762854683s) [upload=141124]: Done starting upload Aug 14 09:06:18.331829598 (135h40m12.762909729s) [upload=141124]: Uploading segments... Aug 14 09:06:18.331888370 (135h40m12.762968501s) [upload=141124]: Got next segment. Inline: true Aug 14 09:06:18.331891777 (135h40m12.762971908s) [upload=141124]: Waiting for error group managing segments... Aug 14 09:06:18.331929589 (135h40m12.76300971s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:06:18.331934067 (135h40m12.763014198s) [upload=141124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:06:18.331936872 (135h40m12.763017003s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:06:18.622093599 (135h40m13.05317373s) [upload=141124]: Done uploading segments... Aug 14 09:06:18.622111313 (135h40m13.053191444s) [upload=141124]: Upload finished. err: <nil> Duration:* 1.859290148s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.646876533s FAIL (2025-08-14 09:07:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.646890329s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X.......X.........X....XX............................] duration: 5.567620829s FAIL (2025-08-14 09:06:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.567638694s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X............................................X..X.] duration: 1.842104984s FAIL (2025-08-14 09:06:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 09:06:18.331728314 (135h40m12.762808445s) [upload=141124]: Starting upload Aug 14 09:06:18.331774552 (135h40m12.762854683s) [upload=141124]: Done starting upload Aug 14 09:06:18.331829598 (135h40m12.762909729s) [upload=141124]: Uploading segments... Aug 14 09:06:18.331888370 (135h40m12.762968501s) [upload=141124]: Got next segment. Inline: true Aug 14 09:06:18.331891777 (135h40m12.762971908s) [upload=141124]: Waiting for error group managing segments... Aug 14 09:06:18.331929589 (135h40m12.76300971s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:06:18.331934067 (135h40m12.763014198s) [upload=141124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:06:18.331936872 (135h40m12.763017003s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:06:18.622093599 (135h40m13.05317373s) [upload=141124]: Done uploading segments... Aug 14 09:06:18.622111313 (135h40m13.053191444s) [upload=141124]: Upload finished. err: <nil> Duration:* 1.84213407s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001243631s FAIL (2025-08-14 09:06:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001267858s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X............................................X..X] duration: 1.615845008s FAIL (2025-08-14 09:06:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 09:06:18.331728314 (135h40m12.762808445s) [upload=141124]: Starting upload Aug 14 09:06:18.331774552 (135h40m12.762854683s) [upload=141124]: Done starting upload Aug 14 09:06:18.331829598 (135h40m12.762909729s) [upload=141124]: Uploading segments... Aug 14 09:06:18.331888370 (135h40m12.762968501s) [upload=141124]: Got next segment. Inline: true Aug 14 09:06:18.331891777 (135h40m12.762971908s) [upload=141124]: Waiting for error group managing segments... Aug 14 09:06:18.331929589 (135h40m12.76300971s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:06:18.331934067 (135h40m12.763014198s) [upload=141124]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:06:18.331936872 (135h40m12.763017003s) [upload=141124]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:06:18.622093599 (135h40m13.05317373s) [upload=141124]: Done uploading segments... Aug 14 09:06:18.622111313 (135h40m13.053191444s) [upload=141124]: Upload finished. err: <nil> Duration:* 1.61586758s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [X.......X.......X.........X....XX...........................] duration: 5.836428059s FAIL (2025-08-14 09:06:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.836462736s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X............................................X..] duration: 1.845543625s FAIL (2025-08-14 09:05:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 09:04:19.992739334 (135h38m14.423819465s) [upload=141092]: Starting upload Aug 14 09:04:19.992782537 (135h38m14.423862668s) [upload=141092]: Done starting upload Aug 14 09:04:19.992829697 (135h38m14.423909818s) [upload=141092]: Uploading segments... Aug 14 09:04:19.992859895 (135h38m14.423940026s) [upload=141092]: Got next segment. Inline: true Aug 14 09:04:19.992863181 (135h38m14.423943312s) [upload=141092]: Waiting for error group managing segments... Aug 14 09:04:19.992891976 (135h38m14.423972107s) [upload=141092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:04:19.992896274 (135h38m14.423976405s) [upload=141092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:04:19.992899050 (135h38m14.423979181s) [upload=141092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:04:20.298566663 (135h38m14.729646804s) [upload=141092]: Done uploading segments... Aug 14 09:04:20.298586742 (135h38m14.729666903s) [upload=141092]: Upload finished. err: <nil> Duration:* 1.84557262s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.X.......X.......X.........X....XX..........................] duration: 5.592373813s FAIL (2025-08-14 09:05:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.592400605s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X............................................X.] duration: 1.85425895s FAIL (2025-08-14 09:05:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 09:04:19.992739334 (135h38m14.423819465s) [upload=141092]: Starting upload Aug 14 09:04:19.992782537 (135h38m14.423862668s) [upload=141092]: Done starting upload Aug 14 09:04:19.992829697 (135h38m14.423909818s) [upload=141092]: Uploading segments... Aug 14 09:04:19.992859895 (135h38m14.423940026s) [upload=141092]: Got next segment. Inline: true Aug 14 09:04:19.992863181 (135h38m14.423943312s) [upload=141092]: Waiting for error group managing segments... Aug 14 09:04:19.992891976 (135h38m14.423972107s) [upload=141092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:04:19.992896274 (135h38m14.423976405s) [upload=141092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:04:19.992899050 (135h38m14.423979181s) [upload=141092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:04:20.298566663 (135h38m14.729646804s) [upload=141092]: Done uploading segments... Aug 14 09:04:20.298586742 (135h38m14.729666903s) [upload=141092]: Upload finished. err: <nil> Duration:* 1.854292525s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..X.......X.......X.........X....XX.........................] duration: 5.557286621s FAIL (2025-08-14 09:04:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.557313523s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...X.......X.......X.........X....XX........................] duration: 5.778429522s FAIL (2025-08-14 09:04:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.778455432s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X............................................X] duration: 1.401900272s FAIL (2025-08-14 09:04:20 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 09:04:19.992739334 (135h38m14.423819465s) [upload=141092]: Starting upload Aug 14 09:04:19.992782537 (135h38m14.423862668s) [upload=141092]: Done starting upload Aug 14 09:04:19.992829697 (135h38m14.423909818s) [upload=141092]: Uploading segments... Aug 14 09:04:19.992859895 (135h38m14.423940026s) [upload=141092]: Got next segment. Inline: true Aug 14 09:04:19.992863181 (135h38m14.423943312s) [upload=141092]: Waiting for error group managing segments... Aug 14 09:04:19.992891976 (135h38m14.423972107s) [upload=141092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:04:19.992896274 (135h38m14.423976405s) [upload=141092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:04:19.992899050 (135h38m14.423979181s) [upload=141092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:04:20.298566663 (135h38m14.729646804s) [upload=141092]: Done uploading segments... Aug 14 09:04:20.298586742 (135h38m14.729666903s) [upload=141092]: Upload finished. err: <nil> Duration:* 1.401944716s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 1.851083494s FAIL (2025-08-14 09:03:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 14 08:31:16.650040828 (135h5m11.081120959s) [upload=140516]: Starting upload Aug 14 08:31:16.650106623 (135h5m11.081186754s) [upload=140516]: Done starting upload Aug 14 08:31:16.650161168 (135h5m11.081241299s) [upload=140516]: Uploading segments... Aug 14 08:31:16.650234137 (135h5m11.081314269s) [upload=140516]: Got next segment. Inline: true Aug 14 08:31:16.650238175 (135h5m11.081318296s) [upload=140516]: Waiting for error group managing segments... Aug 14 08:31:16.650270557 (135h5m11.081350688s) [upload=140516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:31:16.650274594 (135h5m11.081354715s) [upload=140516]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 08:31:16.650277410 (135h5m11.081357541s) [upload=140516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:31:17.119919517 (135h5m11.550999648s) [upload=140516]: Done uploading segments... Aug 14 08:31:17.119937582 (135h5m11.551017713s) [upload=140516]: Upload finished. err: <nil> Duration:* 1.851130273s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)