Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X..X...........X......................] duration: 1.807532005s FAIL (2025-08-14 09:30:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.807564609s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.589914128s FAIL (2025-08-14 09:30:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.589938406s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.020798728s FAIL (2025-08-14 09:29:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.020817383s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 5.511696404s FAIL (2025-08-14 09:29:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.511716793s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 5.545975554s FAIL (2025-08-14 09:29:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.546000131s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X..X...........X.....................] duration: 1.835048667s FAIL (2025-08-14 09:29:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.835076359s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.143336814s FAIL (2025-08-14 09:28:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.143349599s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X..X...........X....................] duration: 1.838034312s FAIL (2025-08-14 09:28:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.838056503s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 5.495588324s FAIL (2025-08-14 09:28:18 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.495624323s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 5.527853298s FAIL (2025-08-14 09:27:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.527877123s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X..X...........X...................] duration: 1.844236076s FAIL (2025-08-14 09:27:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.844254471s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.139461124s FAIL (2025-08-14 09:27:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.139493386s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 5.59099931s FAIL (2025-08-14 09:27:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.591031672s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X..X...........X..................] duration: 1.821843952s FAIL (2025-08-14 09:26:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.821931509s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 6.329705219s FAIL (2025-08-14 09:26:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.329732021s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X..X...........X.................] duration: 1.874820298s FAIL (2025-08-14 09:26:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.874850034s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X....XX.....................................................] duration: 5.790739528s FAIL (2025-08-14 09:26:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.790765449s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X..X...........X................] duration: 1.828990485s FAIL (2025-08-14 09:25:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.829021504s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.309108223s FAIL (2025-08-14 09:25:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.309129453s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................X..X...........X...............] duration: 1.847224815s FAIL (2025-08-14 09:25:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.847259181s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X..X...........X..............] duration: 1.990741334s FAIL (2025-08-14 09:25:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.990756823s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X....XX....................................................] duration: 5.611186327s FAIL (2025-08-14 09:24:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.611236243s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.118076535s FAIL (2025-08-14 09:24:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.118091103s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X..X...........X.............] duration: 1.853059616s FAIL (2025-08-14 09:24:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.853088082s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.154119612s FAIL (2025-08-14 09:24:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.154140332s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X....XX...................................................] duration: 5.779444138s FAIL (2025-08-14 09:23:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.779473774s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X..X...........X............] duration: 2.098304684s FAIL (2025-08-14 09:23:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 2.098330504s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X....XX..................................................] duration: 5.474072926s FAIL (2025-08-14 09:23:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.474100069s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................X..X...........X...........] duration: 1.84681016s FAIL (2025-08-14 09:23:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.846847072s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.022612035s FAIL (2025-08-14 09:23:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.022666769s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X....XX.................................................] duration: 5.664137104s FAIL (2025-08-14 09:23:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.664168385s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.141965473s FAIL (2025-08-14 09:22:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.142072085s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X....XX................................................] duration: 5.760387805s FAIL (2025-08-14 09:22:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.760409566s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................X..X...........X..........] duration: 1.860979943s FAIL (2025-08-14 09:22:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.861008448s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.15424935s FAIL (2025-08-14 09:22:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.154274288s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................................X..X...........X.........] duration: 1.831832211s FAIL (2025-08-14 09:21:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.831865775s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 6.20525059s FAIL (2025-08-14 09:21:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.205276068s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X....XX...............................................] duration: 5.81338263s FAIL (2025-08-14 09:21:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.813406968s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................................X..X...........X........] duration: 1.847257086s FAIL (2025-08-14 09:20:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.847289358s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X....XX..............................................] duration: 5.47892115s FAIL (2025-08-14 09:20:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.478949103s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X..X...........X.......] duration: 1.863035306s FAIL (2025-08-14 09:20:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.863056116s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.043114107s FAIL (2025-08-14 09:20:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.04313696s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X....XX.............................................] duration: 5.784836441s FAIL (2025-08-14 09:19:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.784895605s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........X....XX............................................] duration: 5.594840303s FAIL (2025-08-14 09:19:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.594873887s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.941936611s FAIL (2025-08-14 09:19:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.941956659s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................................X..X...........X......] duration: 1.850251286s FAIL (2025-08-14 09:19:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.85029578s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X..X...........X.....] duration: 1.849524165s FAIL (2025-08-14 09:18:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.84955267s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X.........X....XX...........................................] duration: 5.589511944s FAIL (2025-08-14 09:18:37 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 3adec969fab9240794bd5740471c1ff7bc1f72a3987a1ce26545c8f7c62a7def != before 28bf0f1e1e30c32ae682b2d7d78b4149d66b50b7d8268d8c3408e1454c2ee23c ======LOGS====== Aug 14 08:46:01.004655689 (135h19m55.43573582s) [upload=140767]: Starting upload Aug 14 08:46:01.004705023 (135h19m55.435785154s) [upload=140767]: Done starting upload Aug 14 08:46:01.004801357 (135h19m55.435881488s) [upload=140767]: Uploading segments... Aug 14 08:46:01.004941816 (135h19m55.436021947s) [upload=140767]: Got next segment. Inline: false Aug 14 08:46:01.004970341 (135h19m55.436050472s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 08:46:01.004975932 (135h19m55.436056063s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 08:46:01.451301228 (135h19m55.882381359s) [seg_pos={0 0}, upload=140767]: Begin upload segment... Aug 14 08:46:01.451340893 (135h19m55.882421024s) [seg_pos={0 0}, upload=140767]: Done begin upload segment. Aug 14 08:46:01.451380790 (135h19m55.882460921s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451409134 (135h19m55.882489275s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451851400 (135h19m55.882931531s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.451860147 (135h19m55.882940268s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452178937 (135h19m55.883259068s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452311341 (135h19m55.883391472s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452538044 (135h19m55.883618175s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452627585 (135h19m55.883707706s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452824953 (135h19m55.883905084s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.452906929 (135h19m55.88398706s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453073969 (135h19m55.8841541s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453370937 (135h19m55.884451068s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453389453 (135h19m55.884469584s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453640784 (135h19m55.884720915s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.453924005 (135h19m55.885004136s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454180477 (135h19m55.885260608s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.454390047 (135h19m55.885470178s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:01.455590144 (135h19m55.886670275s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Uploading piece... Aug 14 08:46:02.585333591 (135h19m57.016413722s) [upload=140767]: Next returned nil segment Aug 14 08:46:02.585350303 (135h19m57.016430435s) [upload=140767]: Waiting for error group managing segments... Aug 14 08:46:02.876850972 (135h19m57.307931103s) [noise=true , address=79.127.205.233:4637 , piece_id=IEKGFZFFAXS5SPMQXALUEZDJJRK3VUVJ3TJNVQYHBZH4YONQUGHQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:02.910445291 (135h19m57.341525422s) [noise=true , address=66.23.193.175:4553 , piece_id=2LDXO7R5FPMYTPJM7MW7SGKP2OJCJA3RR7Q6SQIF5ERTR4ORYFJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.297299934 (135h19m57.728380065s) [noise=true , address=79.127.220.98:4405 , piece_id=DY4TZNIHIZ3J243Z6JQZMUYIVFQ57LUGSO4IPULU3ZXHXXBBTA3Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.366675756 (135h19m57.797755887s) [noise=true , address=104.36.82.37:4668 , piece_id=QUBE6CMLCUZH5JLF3ASZZ4TC52HGT26ZVUCOVACHXD65ANAPJUMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.369383868 (135h19m57.800463999s) [noise=true , address=79.127.219.38:4021 , piece_id=SLHBIC3EBW52TSN7OB57EY4B6WL3IAHVM4LZEZMUVNZ2POMRULEQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.379310341 (135h19m57.810390472s) [noise=true , address=104.36.82.23:4461 , piece_id=HFNGFKGYNSFSUJSZDPCYXBP54C7TQC3GXG3GV7COS7FOI6JUCWRQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.400092645 (135h19m57.831172776s) [noise=true , address=104.36.82.19:4419 , piece_id=ROX6Z3UAA52TTMHSKDFWMBU7K3CSYCE7LZ775FY6OQTV4U2YTJ4Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.414419598 (135h19m57.845499719s) [noise=true , address=79.127.201.215:4359 , piece_id=JEVDB3P7I3UF3QXVVYGF3VS3PYBMKE3RNWF4LRLL4MQY4GPPNA2Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.428359168 (135h19m57.859439299s) [noise=true , address=77.90.31.21:4906 , piece_id=CJH6UZPK4D2QKO5YCLGAYMFM42LAUJZI5DSBXW6JW2WDCAUDPESQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.429793834 (135h19m57.860873965s) [noise=true , address=77.90.31.13:4658 , piece_id=5WZAPTBCRAJZJG6YK3YUN6SHZCASZVUCZAIRKROIAFCPRK53DSGA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.470220876 (135h19m57.901301007s) [noise=true , address=104.36.82.10:4080 , piece_id=CGMEXXB5CLP4IWENEFCRPO7YROXWKVTEOJ7AEGMYVLXXRZZPZY4A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.479552691 (135h19m57.910632822s) [noise=true , address=104.36.82.7:4937 , piece_id=CYISAYQUT2T4GQ7R363YDYEYN27KVTWRDPYPANRVEAWCRTAL5SJQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.487809398 (135h19m57.918889539s) [noise=true , address=104.36.82.38:4709 , piece_id=I2FAHDVGQNJZX2WDKXSZE36H7ZZ2S234GHNI6EAZ6CJTQJD3BS5Q, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518014923 (135h19m57.949095044s) [noise=true , address=77.90.31.12:4594 , piece_id=TYQQGZ7SITR6T2Y6OEPCPJMTIYN6K7WQ3RF2MGLCS5H2B2NCEAAQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: <nil> Aug 14 08:46:03.518040131 (135h19m57.949120262s) [seg_pos={0 0}, upload=140767]: Segment reached optimal threshold of 14 pieces. Aug 14 08:46:03.518165481 (135h19m57.949245612s) [noise=true , address=104.36.82.60:4340 , piece_id=3B5IK7GWDPK3LVVXAJ7VAEDODBOFLP3Q3IUAUIC2RXP3WDTFCSVA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XeA4A8wbmv7wgPjRQnNbP9xgDQz4MzJH7PasaYsTrsMzTJRhC): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518200127 (135h19m57.949280258s) [noise=true , address=104.36.82.5:4846 , piece_id=TAPFJUCQK7IYZVTSI5RINPGFC3MBTIFRCQPMEA5TTUP5F3KJMY6A, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518241787 (135h19m57.949321908s) [noise=true , address=104.36.82.58:4300 , piece_id=JFC3HEAPIG4VDXIJUPCBI6VQJDEOIST6BQKHSZDSTHRWXQGJCVMA, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1g2c35xc8XXpVwwjcNWkqTDgqix5ow9otieWT4A4zi5cHPdWqM): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518289068 (135h19m57.949369209s) [noise=true , address=104.36.82.18:4374 , piece_id=TW4LK6MC2UQWZTTEH5JXRNDP237HNI4DCU3PSEK6HKBZYN2KYUSQ, seg_pos={0 0}, upload=140767]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pbWgKsDigGSwnWtNHwsJC3srt45YiUhswf2hv9gbn2LSCLkSH): protocol: expected piece hash; context canceled; EOF Aug 14 08:46:03.518331538 (135h19m57.949411669s) [seg_pos={0 0}, upload=140767]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 08:46:03.518412623 (135h19m57.949492755s) [upload=140767]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 08:46:03.518416651 (135h19m57.949496782s) [upload=140767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 08:46:03.801310643 (135h19m58.232390764s) [upload=140767]: Done uploading segments... Aug 14 08:46:03.801327816 (135h19m58.232407937s) [upload=140767]: Upload finished. err: <nil> Duration: 5.589534609s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.006743816s FAIL (2025-08-14 09:18:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.006775657s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................................X..X...........X....] duration: 1.847031145s FAIL (2025-08-14 09:18:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3bf56038050d61b64d32d2a42558efbdb30a09b66e824b4a680662d407afa23f != before 0a325ed07be0ddae65dd755b7d59bcc89167c9fa530bead071cba831e1425453 ======LOGS====== Aug 14 09:15:37.534617867 (135h49m31.965698008s) [upload=141291]: Starting upload Aug 14 09:15:37.534684685 (135h49m31.965764816s) [upload=141291]: Done starting upload Aug 14 09:15:37.534751923 (135h49m31.965832054s) [upload=141291]: Uploading segments... Aug 14 09:15:37.534801017 (135h49m31.965881148s) [upload=141291]: Got next segment. Inline: true Aug 14 09:15:37.534806598 (135h49m31.965886729s) [upload=141291]: Waiting for error group managing segments... Aug 14 09:15:37.534855692 (135h49m31.965935833s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 09:15:37.534861964 (135h49m31.965942095s) [upload=141291]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 09:15:37.534866263 (135h49m31.965946414s) [upload=141291]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 09:15:37.810533403 (135h49m32.241613534s) [upload=141291]: Done uploading segments... Aug 14 09:15:37.810551217 (135h49m32.241631348s) [upload=141291]: Upload finished. err: <nil> Duration:* 1.847059258s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)