Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.532878854s FAIL (2025-08-14 23:04:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.532910997s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 767.248583ms FAIL (2025-08-14 23:04:43 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 767.281075ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 7.493047363s FAIL (2025-08-14 23:04:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 584456c42d708087c09f0faeed3d1694451ccddbcd31c02942c9bab22782a5ee != before 5c56d2ec81ba59faf7cfbab91a8ddcef2d8a400fc52930931b158cbc222317fa ======LOGS====== Aug 14 22:26:13.497682333 (149h0m7.928762464s) [upload=154981]: Starting upload Aug 14 22:26:13.497731406 (149h0m7.928811537s) [upload=154981]: Done starting upload Aug 14 22:26:13.497858279 (149h0m7.92893842s) [upload=154981]: Uploading segments... Aug 14 22:26:13.498075795 (149h0m7.929155916s) [upload=154981]: Got next segment. Inline: false Aug 14 22:26:13.498128997 (149h0m7.929209118s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:26:13.498133646 (149h0m7.929213777s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 22:26:13.992314623 (149h0m8.423394744s) [seg_pos={0 0}, upload=154981]: Begin upload segment... Aug 14 22:26:13.992365701 (149h0m8.423445832s) [seg_pos={0 0}, upload=154981]: Done begin upload segment. Aug 14 22:26:13.992387002 (149h0m8.423467133s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992454140 (149h0m8.423534271s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992940611 (149h0m8.424020742s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.993072905 (149h0m8.424153036s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994062568 (149h0m8.425142699s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994133022 (149h0m8.425213153s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994388251 (149h0m8.425468383s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994595357 (149h0m8.425675488s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994800130 (149h0m8.425880261s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995007416 (149h0m8.426087547s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995221876 (149h0m8.426302007s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995422941 (149h0m8.426503073s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995617393 (149h0m8.426697525s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995813909 (149h0m8.42689404s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996000406 (149h0m8.427080537s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996185730 (149h0m8.427265871s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.998605130 (149h0m8.429685251s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.999270543 (149h0m8.430350664s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:15.479210578 (149h0m9.910290699s) [upload=154981]: Next returned nil segment Aug 14 22:26:15.479224896 (149h0m9.910305027s) [upload=154981]: Waiting for error group managing segments... Aug 14 22:26:15.884191582 (149h0m10.315271713s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:15.979809937 (149h0m10.410890068s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.038643598 (149h0m10.469723719s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.046584533 (149h0m10.477664664s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.060061459 (149h0m10.49114159s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.109095179 (149h0m10.54017531s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.125159296 (149h0m10.556239427s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.127764371 (149h0m10.558844502s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.274353653 (149h0m10.705433784s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.432231163 (149h0m10.863311294s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.479539401 (149h0m10.910619532s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.517647347 (149h0m10.948727468s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.698196867 (149h0m11.129276988s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701477545 (149h0m11.132557706s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701494006 (149h0m11.132574137s) [seg_pos={0 0}, upload=154981]: Segment reached optimal threshold of 14 pieces. Aug 14 22:26:16.701792186 (149h0m11.132872327s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17xmkbFoj3PTJnAygsjRAcfdd17AfSkPP2xdZp68GGPrvfMuU6): protocol: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection Aug 14 22:26:16.701887078 (149h0m11.132967209s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i8cJRxzLNvUYqELrufixk24oDZwDHroyG5Cfy13csTPgeajRM): protocol: read tcp 188.166.225.170:38298->104.36.82.3:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702037776 (149h0m11.133117957s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1534abg2Jn4zTQzvBcDDZDLq2QZp6kBKY1q6zEbk2PC8mJrnq3): protocol: read tcp 188.166.225.170:43306->104.36.82.3:4784: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702046854 (149h0m11.133126985s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HX5YAgmkBYJyw6bAY1vz4ov5aBeDsXjU4s7pxpBKAyLbG8yN6): protocol: read tcp 188.166.225.170:52080->104.36.82.20:4452: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702087111 (149h0m11.133167242s) [seg_pos={0 0}, upload=154981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 22:26:16.702169368 (149h0m11.133249499s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 22:26:16.702173857 (149h0m11.133253988s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:26:17.128005086 (149h0m11.559085237s) [upload=154981]: Done uploading segments... Aug 14 22:26:17.128028250 (149h0m11.559108401s) [upload=154981]: Upload finished. err: <nil> Duration: 7.493074675s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.422437747s FAIL (2025-08-14 23:04:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.422459479s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......X......X.......X...................................X.] duration: 2.000958175s FAIL (2025-08-14 23:04:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 23:03:11.394691508 (149h37m5.825771659s) [upload=155615]: Starting upload Aug 14 23:03:11.394782743 (149h37m5.825862874s) [upload=155615]: Done starting upload Aug 14 23:03:11.394845162 (149h37m5.825925293s) [upload=155615]: Uploading segments... Aug 14 23:03:11.394880600 (149h37m5.825960731s) [upload=155615]: Got next segment. Inline: true Aug 14 23:03:11.394885931 (149h37m5.825966062s) [upload=155615]: Waiting for error group managing segments... Aug 14 23:03:11.394918012 (149h37m5.825998143s) [upload=155615]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:03:11.394923482 (149h37m5.826003613s) [upload=155615]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:03:11.394925917 (149h37m5.826006048s) [upload=155615]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:03:11.801868054 (149h37m6.232948175s) [upload=155615]: Done uploading segments... Aug 14 23:03:11.801886991 (149h37m6.232967122s) [upload=155615]: Upload finished. err: <nil> Duration:* 2.001011818s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 41 out of 60 is failed (threshold=3) [.....XXXXXXXX.XXXXXXX.X..XXXXXXXXXXXXXXXXXXXXXXXXX..........] duration: 6.044305237s FAIL (2025-08-14 23:04:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.044326546s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 750.7272ms FAIL (2025-08-14 23:03:53 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 750.757938ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 7.049874484s FAIL (2025-08-14 23:03:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 584456c42d708087c09f0faeed3d1694451ccddbcd31c02942c9bab22782a5ee != before 5c56d2ec81ba59faf7cfbab91a8ddcef2d8a400fc52930931b158cbc222317fa ======LOGS====== Aug 14 22:26:13.497682333 (149h0m7.928762464s) [upload=154981]: Starting upload Aug 14 22:26:13.497731406 (149h0m7.928811537s) [upload=154981]: Done starting upload Aug 14 22:26:13.497858279 (149h0m7.92893842s) [upload=154981]: Uploading segments... Aug 14 22:26:13.498075795 (149h0m7.929155916s) [upload=154981]: Got next segment. Inline: false Aug 14 22:26:13.498128997 (149h0m7.929209118s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:26:13.498133646 (149h0m7.929213777s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 22:26:13.992314623 (149h0m8.423394744s) [seg_pos={0 0}, upload=154981]: Begin upload segment... Aug 14 22:26:13.992365701 (149h0m8.423445832s) [seg_pos={0 0}, upload=154981]: Done begin upload segment. Aug 14 22:26:13.992387002 (149h0m8.423467133s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992454140 (149h0m8.423534271s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992940611 (149h0m8.424020742s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.993072905 (149h0m8.424153036s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994062568 (149h0m8.425142699s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994133022 (149h0m8.425213153s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994388251 (149h0m8.425468383s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994595357 (149h0m8.425675488s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994800130 (149h0m8.425880261s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995007416 (149h0m8.426087547s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995221876 (149h0m8.426302007s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995422941 (149h0m8.426503073s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995617393 (149h0m8.426697525s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995813909 (149h0m8.42689404s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996000406 (149h0m8.427080537s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996185730 (149h0m8.427265871s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.998605130 (149h0m8.429685251s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.999270543 (149h0m8.430350664s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:15.479210578 (149h0m9.910290699s) [upload=154981]: Next returned nil segment Aug 14 22:26:15.479224896 (149h0m9.910305027s) [upload=154981]: Waiting for error group managing segments... Aug 14 22:26:15.884191582 (149h0m10.315271713s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:15.979809937 (149h0m10.410890068s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.038643598 (149h0m10.469723719s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.046584533 (149h0m10.477664664s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.060061459 (149h0m10.49114159s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.109095179 (149h0m10.54017531s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.125159296 (149h0m10.556239427s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.127764371 (149h0m10.558844502s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.274353653 (149h0m10.705433784s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.432231163 (149h0m10.863311294s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.479539401 (149h0m10.910619532s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.517647347 (149h0m10.948727468s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.698196867 (149h0m11.129276988s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701477545 (149h0m11.132557706s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701494006 (149h0m11.132574137s) [seg_pos={0 0}, upload=154981]: Segment reached optimal threshold of 14 pieces. Aug 14 22:26:16.701792186 (149h0m11.132872327s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17xmkbFoj3PTJnAygsjRAcfdd17AfSkPP2xdZp68GGPrvfMuU6): protocol: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection Aug 14 22:26:16.701887078 (149h0m11.132967209s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i8cJRxzLNvUYqELrufixk24oDZwDHroyG5Cfy13csTPgeajRM): protocol: read tcp 188.166.225.170:38298->104.36.82.3:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702037776 (149h0m11.133117957s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1534abg2Jn4zTQzvBcDDZDLq2QZp6kBKY1q6zEbk2PC8mJrnq3): protocol: read tcp 188.166.225.170:43306->104.36.82.3:4784: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702046854 (149h0m11.133126985s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HX5YAgmkBYJyw6bAY1vz4ov5aBeDsXjU4s7pxpBKAyLbG8yN6): protocol: read tcp 188.166.225.170:52080->104.36.82.20:4452: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702087111 (149h0m11.133167242s) [seg_pos={0 0}, upload=154981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 22:26:16.702169368 (149h0m11.133249499s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 22:26:16.702173857 (149h0m11.133253988s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:26:17.128005086 (149h0m11.559085237s) [upload=154981]: Done uploading segments... Aug 14 22:26:17.128028250 (149h0m11.559108401s) [upload=154981]: Upload finished. err: <nil> Duration: 7.049901516s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.308065202s FAIL (2025-08-14 23:03:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.308084197s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........X......X.......X...................................X] duration: 1.731924391s FAIL (2025-08-14 23:03:12 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Aug 14 23:03:11.394691508 (149h37m5.825771659s) [upload=155615]: Starting upload Aug 14 23:03:11.394782743 (149h37m5.825862874s) [upload=155615]: Done starting upload Aug 14 23:03:11.394845162 (149h37m5.825925293s) [upload=155615]: Uploading segments... Aug 14 23:03:11.394880600 (149h37m5.825960731s) [upload=155615]: Got next segment. Inline: true Aug 14 23:03:11.394885931 (149h37m5.825966062s) [upload=155615]: Waiting for error group managing segments... Aug 14 23:03:11.394918012 (149h37m5.825998143s) [upload=155615]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 23:03:11.394923482 (149h37m5.826003613s) [upload=155615]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 23:03:11.394925917 (149h37m5.826006048s) [upload=155615]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 23:03:11.801868054 (149h37m6.232948175s) [upload=155615]: Done uploading segments... Aug 14 23:03:11.801886991 (149h37m6.232967122s) [upload=155615]: Upload finished. err: <nil> Duration:* 1.731978474s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 789.21844ms FAIL (2025-08-14 23:03:11 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 789.242606ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 41 out of 60 is failed (threshold=3) [......XXXXXXXX.XXXXXXX.X..XXXXXXXXXXXXXXXXXXXXXXXXX.........] duration: 5.812795339s FAIL (2025-08-14 23:03:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.812819066s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 767.037227ms FAIL (2025-08-14 23:02:53 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 767.059281ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X......X.......X...................................] duration: 2.462413889s FAIL (2025-08-14 23:02:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1e316fd097b1870267c819b3250fd40531bcf53e3a840dd8e2b7b715082be916 != before 5f43c01f2131df9e97049d3f6bbb1f3377e2746aa976a893500957879cf9994d ======LOGS====== Aug 14 22:34:27.071178308 (149h8m21.50225844s) [upload=155123]: Starting upload Aug 14 22:34:27.071219086 (149h8m21.502299217s) [upload=155123]: Done starting upload Aug 14 22:34:27.071267589 (149h8m21.50234772s) [upload=155123]: Uploading segments... Aug 14 22:34:27.071299530 (149h8m21.502379651s) [upload=155123]: Got next segment. Inline: true Aug 14 22:34:27.071303288 (149h8m21.502383419s) [upload=155123]: Waiting for error group managing segments... Aug 14 22:34:27.071336451 (149h8m21.502416582s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:34:27.071340519 (149h8m21.50242065s) [upload=155123]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 22:34:27.071343695 (149h8m21.502423826s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:34:28.085395588 (149h8m22.516475719s) [upload=155123]: Done uploading segments... Aug 14 22:34:28.085442427 (149h8m22.516522558s) [upload=155123]: Upload finished. err: <nil> Duration:* 2.462437262s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 41 out of 60 is failed (threshold=3) [.......XXXXXXXX.XXXXXXX.X..XXXXXXXXXXXXXXXXXXXXXXXXX........] duration: 6.819431151s FAIL (2025-08-14 23:02:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.819452861s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 1.934265224s FAIL (2025-08-14 23:02:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.934290664s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 6.272886254s FAIL (2025-08-14 23:02:30 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 584456c42d708087c09f0faeed3d1694451ccddbcd31c02942c9bab22782a5ee != before 5c56d2ec81ba59faf7cfbab91a8ddcef2d8a400fc52930931b158cbc222317fa ======LOGS====== Aug 14 22:26:13.497682333 (149h0m7.928762464s) [upload=154981]: Starting upload Aug 14 22:26:13.497731406 (149h0m7.928811537s) [upload=154981]: Done starting upload Aug 14 22:26:13.497858279 (149h0m7.92893842s) [upload=154981]: Uploading segments... Aug 14 22:26:13.498075795 (149h0m7.929155916s) [upload=154981]: Got next segment. Inline: false Aug 14 22:26:13.498128997 (149h0m7.929209118s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:26:13.498133646 (149h0m7.929213777s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 22:26:13.992314623 (149h0m8.423394744s) [seg_pos={0 0}, upload=154981]: Begin upload segment... Aug 14 22:26:13.992365701 (149h0m8.423445832s) [seg_pos={0 0}, upload=154981]: Done begin upload segment. Aug 14 22:26:13.992387002 (149h0m8.423467133s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992454140 (149h0m8.423534271s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992940611 (149h0m8.424020742s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.993072905 (149h0m8.424153036s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994062568 (149h0m8.425142699s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994133022 (149h0m8.425213153s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994388251 (149h0m8.425468383s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994595357 (149h0m8.425675488s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994800130 (149h0m8.425880261s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995007416 (149h0m8.426087547s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995221876 (149h0m8.426302007s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995422941 (149h0m8.426503073s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995617393 (149h0m8.426697525s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995813909 (149h0m8.42689404s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996000406 (149h0m8.427080537s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996185730 (149h0m8.427265871s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.998605130 (149h0m8.429685251s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.999270543 (149h0m8.430350664s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:15.479210578 (149h0m9.910290699s) [upload=154981]: Next returned nil segment Aug 14 22:26:15.479224896 (149h0m9.910305027s) [upload=154981]: Waiting for error group managing segments... Aug 14 22:26:15.884191582 (149h0m10.315271713s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:15.979809937 (149h0m10.410890068s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.038643598 (149h0m10.469723719s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.046584533 (149h0m10.477664664s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.060061459 (149h0m10.49114159s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.109095179 (149h0m10.54017531s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.125159296 (149h0m10.556239427s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.127764371 (149h0m10.558844502s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.274353653 (149h0m10.705433784s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.432231163 (149h0m10.863311294s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.479539401 (149h0m10.910619532s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.517647347 (149h0m10.948727468s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.698196867 (149h0m11.129276988s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701477545 (149h0m11.132557706s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701494006 (149h0m11.132574137s) [seg_pos={0 0}, upload=154981]: Segment reached optimal threshold of 14 pieces. Aug 14 22:26:16.701792186 (149h0m11.132872327s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17xmkbFoj3PTJnAygsjRAcfdd17AfSkPP2xdZp68GGPrvfMuU6): protocol: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection Aug 14 22:26:16.701887078 (149h0m11.132967209s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i8cJRxzLNvUYqELrufixk24oDZwDHroyG5Cfy13csTPgeajRM): protocol: read tcp 188.166.225.170:38298->104.36.82.3:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702037776 (149h0m11.133117957s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1534abg2Jn4zTQzvBcDDZDLq2QZp6kBKY1q6zEbk2PC8mJrnq3): protocol: read tcp 188.166.225.170:43306->104.36.82.3:4784: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702046854 (149h0m11.133126985s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HX5YAgmkBYJyw6bAY1vz4ov5aBeDsXjU4s7pxpBKAyLbG8yN6): protocol: read tcp 188.166.225.170:52080->104.36.82.20:4452: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702087111 (149h0m11.133167242s) [seg_pos={0 0}, upload=154981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 22:26:16.702169368 (149h0m11.133249499s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 22:26:16.702173857 (149h0m11.133253988s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:26:17.128005086 (149h0m11.559085237s) [upload=154981]: Done uploading segments... Aug 14 22:26:17.128028250 (149h0m11.559108401s) [upload=154981]: Upload finished. err: <nil> Duration: 6.27291585s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X......X.......X..................................] duration: 1.931480969s FAIL (2025-08-14 23:02:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1e316fd097b1870267c819b3250fd40531bcf53e3a840dd8e2b7b715082be916 != before 5f43c01f2131df9e97049d3f6bbb1f3377e2746aa976a893500957879cf9994d ======LOGS====== Aug 14 22:34:27.071178308 (149h8m21.50225844s) [upload=155123]: Starting upload Aug 14 22:34:27.071219086 (149h8m21.502299217s) [upload=155123]: Done starting upload Aug 14 22:34:27.071267589 (149h8m21.50234772s) [upload=155123]: Uploading segments... Aug 14 22:34:27.071299530 (149h8m21.502379651s) [upload=155123]: Got next segment. Inline: true Aug 14 22:34:27.071303288 (149h8m21.502383419s) [upload=155123]: Waiting for error group managing segments... Aug 14 22:34:27.071336451 (149h8m21.502416582s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:34:27.071340519 (149h8m21.50242065s) [upload=155123]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 22:34:27.071343695 (149h8m21.502423826s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:34:28.085395588 (149h8m22.516475719s) [upload=155123]: Done uploading segments... Aug 14 22:34:28.085442427 (149h8m22.516522558s) [upload=155123]: Upload finished. err: <nil> Duration:* 1.931508542s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 41 out of 60 is failed (threshold=3) [........XXXXXXXX.XXXXXXX.X..XXXXXXXXXXXXXXXXXXXXXXXXX.......] duration: 6.229108541s FAIL (2025-08-14 23:02:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.229133949s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X......X.......X.................................] duration: 2.456915721s FAIL (2025-08-14 23:01:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1e316fd097b1870267c819b3250fd40531bcf53e3a840dd8e2b7b715082be916 != before 5f43c01f2131df9e97049d3f6bbb1f3377e2746aa976a893500957879cf9994d ======LOGS====== Aug 14 22:34:27.071178308 (149h8m21.50225844s) [upload=155123]: Starting upload Aug 14 22:34:27.071219086 (149h8m21.502299217s) [upload=155123]: Done starting upload Aug 14 22:34:27.071267589 (149h8m21.50234772s) [upload=155123]: Uploading segments... Aug 14 22:34:27.071299530 (149h8m21.502379651s) [upload=155123]: Got next segment. Inline: true Aug 14 22:34:27.071303288 (149h8m21.502383419s) [upload=155123]: Waiting for error group managing segments... Aug 14 22:34:27.071336451 (149h8m21.502416582s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:34:27.071340519 (149h8m21.50242065s) [upload=155123]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 22:34:27.071343695 (149h8m21.502423826s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:34:28.085395588 (149h8m22.516475719s) [upload=155123]: Done uploading segments... Aug 14 22:34:28.085442427 (149h8m22.516522558s) [upload=155123]: Upload finished. err: <nil> Duration:* 2.456944256s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 768.294547ms FAIL (2025-08-14 23:01:57 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 768.33271ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.254741716s FAIL (2025-08-14 23:01:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.254754911s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 6.488817862s FAIL (2025-08-14 23:01:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 584456c42d708087c09f0faeed3d1694451ccddbcd31c02942c9bab22782a5ee != before 5c56d2ec81ba59faf7cfbab91a8ddcef2d8a400fc52930931b158cbc222317fa ======LOGS====== Aug 14 22:26:13.497682333 (149h0m7.928762464s) [upload=154981]: Starting upload Aug 14 22:26:13.497731406 (149h0m7.928811537s) [upload=154981]: Done starting upload Aug 14 22:26:13.497858279 (149h0m7.92893842s) [upload=154981]: Uploading segments... Aug 14 22:26:13.498075795 (149h0m7.929155916s) [upload=154981]: Got next segment. Inline: false Aug 14 22:26:13.498128997 (149h0m7.929209118s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:26:13.498133646 (149h0m7.929213777s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 22:26:13.992314623 (149h0m8.423394744s) [seg_pos={0 0}, upload=154981]: Begin upload segment... Aug 14 22:26:13.992365701 (149h0m8.423445832s) [seg_pos={0 0}, upload=154981]: Done begin upload segment. Aug 14 22:26:13.992387002 (149h0m8.423467133s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992454140 (149h0m8.423534271s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992940611 (149h0m8.424020742s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.993072905 (149h0m8.424153036s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994062568 (149h0m8.425142699s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994133022 (149h0m8.425213153s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994388251 (149h0m8.425468383s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994595357 (149h0m8.425675488s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994800130 (149h0m8.425880261s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995007416 (149h0m8.426087547s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995221876 (149h0m8.426302007s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995422941 (149h0m8.426503073s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995617393 (149h0m8.426697525s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995813909 (149h0m8.42689404s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996000406 (149h0m8.427080537s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996185730 (149h0m8.427265871s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.998605130 (149h0m8.429685251s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.999270543 (149h0m8.430350664s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:15.479210578 (149h0m9.910290699s) [upload=154981]: Next returned nil segment Aug 14 22:26:15.479224896 (149h0m9.910305027s) [upload=154981]: Waiting for error group managing segments... Aug 14 22:26:15.884191582 (149h0m10.315271713s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:15.979809937 (149h0m10.410890068s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.038643598 (149h0m10.469723719s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.046584533 (149h0m10.477664664s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.060061459 (149h0m10.49114159s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.109095179 (149h0m10.54017531s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.125159296 (149h0m10.556239427s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.127764371 (149h0m10.558844502s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.274353653 (149h0m10.705433784s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.432231163 (149h0m10.863311294s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.479539401 (149h0m10.910619532s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.517647347 (149h0m10.948727468s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.698196867 (149h0m11.129276988s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701477545 (149h0m11.132557706s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701494006 (149h0m11.132574137s) [seg_pos={0 0}, upload=154981]: Segment reached optimal threshold of 14 pieces. Aug 14 22:26:16.701792186 (149h0m11.132872327s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17xmkbFoj3PTJnAygsjRAcfdd17AfSkPP2xdZp68GGPrvfMuU6): protocol: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection Aug 14 22:26:16.701887078 (149h0m11.132967209s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i8cJRxzLNvUYqELrufixk24oDZwDHroyG5Cfy13csTPgeajRM): protocol: read tcp 188.166.225.170:38298->104.36.82.3:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702037776 (149h0m11.133117957s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1534abg2Jn4zTQzvBcDDZDLq2QZp6kBKY1q6zEbk2PC8mJrnq3): protocol: read tcp 188.166.225.170:43306->104.36.82.3:4784: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702046854 (149h0m11.133126985s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HX5YAgmkBYJyw6bAY1vz4ov5aBeDsXjU4s7pxpBKAyLbG8yN6): protocol: read tcp 188.166.225.170:52080->104.36.82.20:4452: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702087111 (149h0m11.133167242s) [seg_pos={0 0}, upload=154981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 22:26:16.702169368 (149h0m11.133249499s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 22:26:16.702173857 (149h0m11.133253988s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:26:17.128005086 (149h0m11.559085237s) [upload=154981]: Done uploading segments... Aug 14 22:26:17.128028250 (149h0m11.559108401s) [upload=154981]: Upload finished. err: <nil> Duration: 6.488849261s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 41 out of 60 is failed (threshold=3) [.........XXXXXXXX.XXXXXXX.X..XXXXXXXXXXXXXXXXXXXXXXXXX......] duration: 6.22370595s FAIL (2025-08-14 23:01:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.223727681s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [X...............X...........................................] duration: 6.177168998s FAIL (2025-08-14 23:01:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 584456c42d708087c09f0faeed3d1694451ccddbcd31c02942c9bab22782a5ee != before 5c56d2ec81ba59faf7cfbab91a8ddcef2d8a400fc52930931b158cbc222317fa ======LOGS====== Aug 14 22:26:13.497682333 (149h0m7.928762464s) [upload=154981]: Starting upload Aug 14 22:26:13.497731406 (149h0m7.928811537s) [upload=154981]: Done starting upload Aug 14 22:26:13.497858279 (149h0m7.92893842s) [upload=154981]: Uploading segments... Aug 14 22:26:13.498075795 (149h0m7.929155916s) [upload=154981]: Got next segment. Inline: false Aug 14 22:26:13.498128997 (149h0m7.929209118s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:26:13.498133646 (149h0m7.929213777s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 22:26:13.992314623 (149h0m8.423394744s) [seg_pos={0 0}, upload=154981]: Begin upload segment... Aug 14 22:26:13.992365701 (149h0m8.423445832s) [seg_pos={0 0}, upload=154981]: Done begin upload segment. Aug 14 22:26:13.992387002 (149h0m8.423467133s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992454140 (149h0m8.423534271s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992940611 (149h0m8.424020742s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.993072905 (149h0m8.424153036s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994062568 (149h0m8.425142699s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994133022 (149h0m8.425213153s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994388251 (149h0m8.425468383s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994595357 (149h0m8.425675488s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994800130 (149h0m8.425880261s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995007416 (149h0m8.426087547s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995221876 (149h0m8.426302007s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995422941 (149h0m8.426503073s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995617393 (149h0m8.426697525s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995813909 (149h0m8.42689404s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996000406 (149h0m8.427080537s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996185730 (149h0m8.427265871s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.998605130 (149h0m8.429685251s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.999270543 (149h0m8.430350664s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:15.479210578 (149h0m9.910290699s) [upload=154981]: Next returned nil segment Aug 14 22:26:15.479224896 (149h0m9.910305027s) [upload=154981]: Waiting for error group managing segments... Aug 14 22:26:15.884191582 (149h0m10.315271713s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:15.979809937 (149h0m10.410890068s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.038643598 (149h0m10.469723719s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.046584533 (149h0m10.477664664s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.060061459 (149h0m10.49114159s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.109095179 (149h0m10.54017531s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.125159296 (149h0m10.556239427s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.127764371 (149h0m10.558844502s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.274353653 (149h0m10.705433784s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.432231163 (149h0m10.863311294s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.479539401 (149h0m10.910619532s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.517647347 (149h0m10.948727468s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.698196867 (149h0m11.129276988s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701477545 (149h0m11.132557706s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701494006 (149h0m11.132574137s) [seg_pos={0 0}, upload=154981]: Segment reached optimal threshold of 14 pieces. Aug 14 22:26:16.701792186 (149h0m11.132872327s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17xmkbFoj3PTJnAygsjRAcfdd17AfSkPP2xdZp68GGPrvfMuU6): protocol: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection Aug 14 22:26:16.701887078 (149h0m11.132967209s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i8cJRxzLNvUYqELrufixk24oDZwDHroyG5Cfy13csTPgeajRM): protocol: read tcp 188.166.225.170:38298->104.36.82.3:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702037776 (149h0m11.133117957s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1534abg2Jn4zTQzvBcDDZDLq2QZp6kBKY1q6zEbk2PC8mJrnq3): protocol: read tcp 188.166.225.170:43306->104.36.82.3:4784: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702046854 (149h0m11.133126985s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HX5YAgmkBYJyw6bAY1vz4ov5aBeDsXjU4s7pxpBKAyLbG8yN6): protocol: read tcp 188.166.225.170:52080->104.36.82.20:4452: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702087111 (149h0m11.133167242s) [seg_pos={0 0}, upload=154981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 22:26:16.702169368 (149h0m11.133249499s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 22:26:16.702173857 (149h0m11.133253988s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:26:17.128005086 (149h0m11.559085237s) [upload=154981]: Done uploading segments... Aug 14 22:26:17.128028250 (149h0m11.559108401s) [upload=154981]: Upload finished. err: <nil> Duration: 6.177206761s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 754.91344ms FAIL (2025-08-14 23:01:06 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 754.942637ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.369838776s FAIL (2025-08-14 23:01:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.369862973s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 41 out of 60 is failed (threshold=3) [..........XXXXXXXX.XXXXXXX.X..XXXXXXXXXXXXXXXXXXXXXXXXX.....] duration: 6.093951128s FAIL (2025-08-14 23:00:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.093994663s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X......X.......X................................] duration: 2.358904142s FAIL (2025-08-14 23:00:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1e316fd097b1870267c819b3250fd40531bcf53e3a840dd8e2b7b715082be916 != before 5f43c01f2131df9e97049d3f6bbb1f3377e2746aa976a893500957879cf9994d ======LOGS====== Aug 14 22:34:27.071178308 (149h8m21.50225844s) [upload=155123]: Starting upload Aug 14 22:34:27.071219086 (149h8m21.502299217s) [upload=155123]: Done starting upload Aug 14 22:34:27.071267589 (149h8m21.50234772s) [upload=155123]: Uploading segments... Aug 14 22:34:27.071299530 (149h8m21.502379651s) [upload=155123]: Got next segment. Inline: true Aug 14 22:34:27.071303288 (149h8m21.502383419s) [upload=155123]: Waiting for error group managing segments... Aug 14 22:34:27.071336451 (149h8m21.502416582s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:34:27.071340519 (149h8m21.50242065s) [upload=155123]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 22:34:27.071343695 (149h8m21.502423826s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:34:28.085395588 (149h8m22.516475719s) [upload=155123]: Done uploading segments... Aug 14 22:34:28.085442427 (149h8m22.516522558s) [upload=155123]: Upload finished. err: <nil> Duration:* 2.358931877s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 745.995167ms FAIL (2025-08-14 23:00:34 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 746.02802ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X...............X..........................................] duration: 7.080259204s FAIL (2025-08-14 23:00:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 584456c42d708087c09f0faeed3d1694451ccddbcd31c02942c9bab22782a5ee != before 5c56d2ec81ba59faf7cfbab91a8ddcef2d8a400fc52930931b158cbc222317fa ======LOGS====== Aug 14 22:26:13.497682333 (149h0m7.928762464s) [upload=154981]: Starting upload Aug 14 22:26:13.497731406 (149h0m7.928811537s) [upload=154981]: Done starting upload Aug 14 22:26:13.497858279 (149h0m7.92893842s) [upload=154981]: Uploading segments... Aug 14 22:26:13.498075795 (149h0m7.929155916s) [upload=154981]: Got next segment. Inline: false Aug 14 22:26:13.498128997 (149h0m7.929209118s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:26:13.498133646 (149h0m7.929213777s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 22:26:13.992314623 (149h0m8.423394744s) [seg_pos={0 0}, upload=154981]: Begin upload segment... Aug 14 22:26:13.992365701 (149h0m8.423445832s) [seg_pos={0 0}, upload=154981]: Done begin upload segment. Aug 14 22:26:13.992387002 (149h0m8.423467133s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992454140 (149h0m8.423534271s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992940611 (149h0m8.424020742s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.993072905 (149h0m8.424153036s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994062568 (149h0m8.425142699s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994133022 (149h0m8.425213153s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994388251 (149h0m8.425468383s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994595357 (149h0m8.425675488s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994800130 (149h0m8.425880261s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995007416 (149h0m8.426087547s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995221876 (149h0m8.426302007s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995422941 (149h0m8.426503073s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995617393 (149h0m8.426697525s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995813909 (149h0m8.42689404s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996000406 (149h0m8.427080537s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996185730 (149h0m8.427265871s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.998605130 (149h0m8.429685251s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.999270543 (149h0m8.430350664s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:15.479210578 (149h0m9.910290699s) [upload=154981]: Next returned nil segment Aug 14 22:26:15.479224896 (149h0m9.910305027s) [upload=154981]: Waiting for error group managing segments... Aug 14 22:26:15.884191582 (149h0m10.315271713s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:15.979809937 (149h0m10.410890068s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.038643598 (149h0m10.469723719s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.046584533 (149h0m10.477664664s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.060061459 (149h0m10.49114159s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.109095179 (149h0m10.54017531s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.125159296 (149h0m10.556239427s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.127764371 (149h0m10.558844502s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.274353653 (149h0m10.705433784s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.432231163 (149h0m10.863311294s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.479539401 (149h0m10.910619532s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.517647347 (149h0m10.948727468s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.698196867 (149h0m11.129276988s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701477545 (149h0m11.132557706s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701494006 (149h0m11.132574137s) [seg_pos={0 0}, upload=154981]: Segment reached optimal threshold of 14 pieces. Aug 14 22:26:16.701792186 (149h0m11.132872327s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17xmkbFoj3PTJnAygsjRAcfdd17AfSkPP2xdZp68GGPrvfMuU6): protocol: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection Aug 14 22:26:16.701887078 (149h0m11.132967209s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i8cJRxzLNvUYqELrufixk24oDZwDHroyG5Cfy13csTPgeajRM): protocol: read tcp 188.166.225.170:38298->104.36.82.3:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702037776 (149h0m11.133117957s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1534abg2Jn4zTQzvBcDDZDLq2QZp6kBKY1q6zEbk2PC8mJrnq3): protocol: read tcp 188.166.225.170:43306->104.36.82.3:4784: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702046854 (149h0m11.133126985s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HX5YAgmkBYJyw6bAY1vz4ov5aBeDsXjU4s7pxpBKAyLbG8yN6): protocol: read tcp 188.166.225.170:52080->104.36.82.20:4452: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702087111 (149h0m11.133167242s) [seg_pos={0 0}, upload=154981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 22:26:16.702169368 (149h0m11.133249499s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 22:26:16.702173857 (149h0m11.133253988s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:26:17.128005086 (149h0m11.559085237s) [upload=154981]: Done uploading segments... Aug 14 22:26:17.128028250 (149h0m11.559108401s) [upload=154981]: Upload finished. err: <nil> Duration: 7.080285174s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.48988001s FAIL (2025-08-14 23:00:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.489901952s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X......X.......X...............................] duration: 1.862388255s FAIL (2025-08-14 23:00:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1e316fd097b1870267c819b3250fd40531bcf53e3a840dd8e2b7b715082be916 != before 5f43c01f2131df9e97049d3f6bbb1f3377e2746aa976a893500957879cf9994d ======LOGS====== Aug 14 22:34:27.071178308 (149h8m21.50225844s) [upload=155123]: Starting upload Aug 14 22:34:27.071219086 (149h8m21.502299217s) [upload=155123]: Done starting upload Aug 14 22:34:27.071267589 (149h8m21.50234772s) [upload=155123]: Uploading segments... Aug 14 22:34:27.071299530 (149h8m21.502379651s) [upload=155123]: Got next segment. Inline: true Aug 14 22:34:27.071303288 (149h8m21.502383419s) [upload=155123]: Waiting for error group managing segments... Aug 14 22:34:27.071336451 (149h8m21.502416582s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:34:27.071340519 (149h8m21.50242065s) [upload=155123]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 22:34:27.071343695 (149h8m21.502423826s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:34:28.085395588 (149h8m22.516475719s) [upload=155123]: Done uploading segments... Aug 14 22:34:28.085442427 (149h8m22.516522558s) [upload=155123]: Upload finished. err: <nil> Duration:* 1.86241174s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 743.701427ms FAIL (2025-08-14 22:59:52 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 743.726085ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 41 out of 60 is failed (threshold=3) [...........XXXXXXXX.XXXXXXX.X..XXXXXXXXXXXXXXXXXXXXXXXXX....] duration: 6.528858791s FAIL (2025-08-14 22:59:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.528879639s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 785.002684ms FAIL (2025-08-14 22:59:28 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 785.028013ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X.X...............X.........................................] duration: 6.101029905s FAIL (2025-08-14 22:59:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 584456c42d708087c09f0faeed3d1694451ccddbcd31c02942c9bab22782a5ee != before 5c56d2ec81ba59faf7cfbab91a8ddcef2d8a400fc52930931b158cbc222317fa ======LOGS====== Aug 14 22:26:13.497682333 (149h0m7.928762464s) [upload=154981]: Starting upload Aug 14 22:26:13.497731406 (149h0m7.928811537s) [upload=154981]: Done starting upload Aug 14 22:26:13.497858279 (149h0m7.92893842s) [upload=154981]: Uploading segments... Aug 14 22:26:13.498075795 (149h0m7.929155916s) [upload=154981]: Got next segment. Inline: false Aug 14 22:26:13.498128997 (149h0m7.929209118s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:26:13.498133646 (149h0m7.929213777s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 22:26:13.992314623 (149h0m8.423394744s) [seg_pos={0 0}, upload=154981]: Begin upload segment... Aug 14 22:26:13.992365701 (149h0m8.423445832s) [seg_pos={0 0}, upload=154981]: Done begin upload segment. Aug 14 22:26:13.992387002 (149h0m8.423467133s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992454140 (149h0m8.423534271s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992940611 (149h0m8.424020742s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.993072905 (149h0m8.424153036s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994062568 (149h0m8.425142699s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994133022 (149h0m8.425213153s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994388251 (149h0m8.425468383s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994595357 (149h0m8.425675488s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994800130 (149h0m8.425880261s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995007416 (149h0m8.426087547s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995221876 (149h0m8.426302007s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995422941 (149h0m8.426503073s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995617393 (149h0m8.426697525s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995813909 (149h0m8.42689404s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996000406 (149h0m8.427080537s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996185730 (149h0m8.427265871s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.998605130 (149h0m8.429685251s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.999270543 (149h0m8.430350664s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:15.479210578 (149h0m9.910290699s) [upload=154981]: Next returned nil segment Aug 14 22:26:15.479224896 (149h0m9.910305027s) [upload=154981]: Waiting for error group managing segments... Aug 14 22:26:15.884191582 (149h0m10.315271713s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:15.979809937 (149h0m10.410890068s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.038643598 (149h0m10.469723719s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.046584533 (149h0m10.477664664s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.060061459 (149h0m10.49114159s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.109095179 (149h0m10.54017531s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.125159296 (149h0m10.556239427s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.127764371 (149h0m10.558844502s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.274353653 (149h0m10.705433784s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.432231163 (149h0m10.863311294s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.479539401 (149h0m10.910619532s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.517647347 (149h0m10.948727468s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.698196867 (149h0m11.129276988s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701477545 (149h0m11.132557706s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701494006 (149h0m11.132574137s) [seg_pos={0 0}, upload=154981]: Segment reached optimal threshold of 14 pieces. Aug 14 22:26:16.701792186 (149h0m11.132872327s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17xmkbFoj3PTJnAygsjRAcfdd17AfSkPP2xdZp68GGPrvfMuU6): protocol: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection Aug 14 22:26:16.701887078 (149h0m11.132967209s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i8cJRxzLNvUYqELrufixk24oDZwDHroyG5Cfy13csTPgeajRM): protocol: read tcp 188.166.225.170:38298->104.36.82.3:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702037776 (149h0m11.133117957s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1534abg2Jn4zTQzvBcDDZDLq2QZp6kBKY1q6zEbk2PC8mJrnq3): protocol: read tcp 188.166.225.170:43306->104.36.82.3:4784: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702046854 (149h0m11.133126985s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HX5YAgmkBYJyw6bAY1vz4ov5aBeDsXjU4s7pxpBKAyLbG8yN6): protocol: read tcp 188.166.225.170:52080->104.36.82.20:4452: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702087111 (149h0m11.133167242s) [seg_pos={0 0}, upload=154981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 22:26:16.702169368 (149h0m11.133249499s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 22:26:16.702173857 (149h0m11.133253988s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:26:17.128005086 (149h0m11.559085237s) [upload=154981]: Done uploading segments... Aug 14 22:26:17.128028250 (149h0m11.559108401s) [upload=154981]: Upload finished. err: <nil> Duration: 6.101061555s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.288705255s FAIL (2025-08-14 22:59:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.28871841s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 780.028827ms FAIL (2025-08-14 22:59:04 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 780.043354ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 41 out of 60 is failed (threshold=3) [............XXXXXXXX.XXXXXXX.X..XXXXXXXXXXXXXXXXXXXXXXXXX...] duration: 6.318571456s FAIL (2025-08-14 22:59:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.318596483s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............X......X.......X..............................] duration: 2.729985398s FAIL (2025-08-14 22:58:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1e316fd097b1870267c819b3250fd40531bcf53e3a840dd8e2b7b715082be916 != before 5f43c01f2131df9e97049d3f6bbb1f3377e2746aa976a893500957879cf9994d ======LOGS====== Aug 14 22:34:27.071178308 (149h8m21.50225844s) [upload=155123]: Starting upload Aug 14 22:34:27.071219086 (149h8m21.502299217s) [upload=155123]: Done starting upload Aug 14 22:34:27.071267589 (149h8m21.50234772s) [upload=155123]: Uploading segments... Aug 14 22:34:27.071299530 (149h8m21.502379651s) [upload=155123]: Got next segment. Inline: true Aug 14 22:34:27.071303288 (149h8m21.502383419s) [upload=155123]: Waiting for error group managing segments... Aug 14 22:34:27.071336451 (149h8m21.502416582s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:34:27.071340519 (149h8m21.50242065s) [upload=155123]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 22:34:27.071343695 (149h8m21.502423826s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:34:28.085395588 (149h8m22.516475719s) [upload=155123]: Done uploading segments... Aug 14 22:34:28.085442427 (149h8m22.516522558s) [upload=155123]: Upload finished. err: <nil> Duration:* 2.730020203s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 41 out of 60 is failed (threshold=3) [.............XXXXXXXX.XXXXXXX.X..XXXXXXXXXXXXXXXXXXXXXXXXX..] duration: 6.413894972s FAIL (2025-08-14 22:58:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.413910802s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 41 out of 60 is failed (threshold=3) [..............XXXXXXXX.XXXXXXX.X..XXXXXXXXXXXXXXXXXXXXXXXXX.] duration: 6.845482477s FAIL (2025-08-14 22:58:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.845494581s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 41 out of 60 is failed (threshold=3) [...............XXXXXXXX.XXXXXXX.X..XXXXXXXXXXXXXXXXXXXXXXXXX] duration: 30.000965092s FAIL (2025-08-14 22:58:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00099049s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X.X...............X........................................] duration: 6.618921668s FAIL (2025-08-14 22:58:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 584456c42d708087c09f0faeed3d1694451ccddbcd31c02942c9bab22782a5ee != before 5c56d2ec81ba59faf7cfbab91a8ddcef2d8a400fc52930931b158cbc222317fa ======LOGS====== Aug 14 22:26:13.497682333 (149h0m7.928762464s) [upload=154981]: Starting upload Aug 14 22:26:13.497731406 (149h0m7.928811537s) [upload=154981]: Done starting upload Aug 14 22:26:13.497858279 (149h0m7.92893842s) [upload=154981]: Uploading segments... Aug 14 22:26:13.498075795 (149h0m7.929155916s) [upload=154981]: Got next segment. Inline: false Aug 14 22:26:13.498128997 (149h0m7.929209118s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:26:13.498133646 (149h0m7.929213777s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 22:26:13.992314623 (149h0m8.423394744s) [seg_pos={0 0}, upload=154981]: Begin upload segment... Aug 14 22:26:13.992365701 (149h0m8.423445832s) [seg_pos={0 0}, upload=154981]: Done begin upload segment. Aug 14 22:26:13.992387002 (149h0m8.423467133s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992454140 (149h0m8.423534271s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992940611 (149h0m8.424020742s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.993072905 (149h0m8.424153036s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994062568 (149h0m8.425142699s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994133022 (149h0m8.425213153s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994388251 (149h0m8.425468383s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994595357 (149h0m8.425675488s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994800130 (149h0m8.425880261s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995007416 (149h0m8.426087547s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995221876 (149h0m8.426302007s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995422941 (149h0m8.426503073s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995617393 (149h0m8.426697525s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995813909 (149h0m8.42689404s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996000406 (149h0m8.427080537s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996185730 (149h0m8.427265871s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.998605130 (149h0m8.429685251s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.999270543 (149h0m8.430350664s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:15.479210578 (149h0m9.910290699s) [upload=154981]: Next returned nil segment Aug 14 22:26:15.479224896 (149h0m9.910305027s) [upload=154981]: Waiting for error group managing segments... Aug 14 22:26:15.884191582 (149h0m10.315271713s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:15.979809937 (149h0m10.410890068s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.038643598 (149h0m10.469723719s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.046584533 (149h0m10.477664664s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.060061459 (149h0m10.49114159s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.109095179 (149h0m10.54017531s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.125159296 (149h0m10.556239427s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.127764371 (149h0m10.558844502s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.274353653 (149h0m10.705433784s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.432231163 (149h0m10.863311294s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.479539401 (149h0m10.910619532s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.517647347 (149h0m10.948727468s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.698196867 (149h0m11.129276988s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701477545 (149h0m11.132557706s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701494006 (149h0m11.132574137s) [seg_pos={0 0}, upload=154981]: Segment reached optimal threshold of 14 pieces. Aug 14 22:26:16.701792186 (149h0m11.132872327s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17xmkbFoj3PTJnAygsjRAcfdd17AfSkPP2xdZp68GGPrvfMuU6): protocol: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection Aug 14 22:26:16.701887078 (149h0m11.132967209s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i8cJRxzLNvUYqELrufixk24oDZwDHroyG5Cfy13csTPgeajRM): protocol: read tcp 188.166.225.170:38298->104.36.82.3:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702037776 (149h0m11.133117957s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1534abg2Jn4zTQzvBcDDZDLq2QZp6kBKY1q6zEbk2PC8mJrnq3): protocol: read tcp 188.166.225.170:43306->104.36.82.3:4784: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702046854 (149h0m11.133126985s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HX5YAgmkBYJyw6bAY1vz4ov5aBeDsXjU4s7pxpBKAyLbG8yN6): protocol: read tcp 188.166.225.170:52080->104.36.82.20:4452: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702087111 (149h0m11.133167242s) [seg_pos={0 0}, upload=154981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 22:26:16.702169368 (149h0m11.133249499s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 22:26:16.702173857 (149h0m11.133253988s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:26:17.128005086 (149h0m11.559085237s) [upload=154981]: Done uploading segments... Aug 14 22:26:17.128028250 (149h0m11.559108401s) [upload=154981]: Upload finished. err: <nil> Duration: 6.618952086s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.49151987s FAIL (2025-08-14 22:57:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.491544796s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 790.343261ms FAIL (2025-08-14 22:57:59 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error Duration: 790.443343ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X......X.......X.............................] duration: 3.133065774s FAIL (2025-08-14 22:57:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 1e316fd097b1870267c819b3250fd40531bcf53e3a840dd8e2b7b715082be916 != before 5f43c01f2131df9e97049d3f6bbb1f3377e2746aa976a893500957879cf9994d ======LOGS====== Aug 14 22:34:27.071178308 (149h8m21.50225844s) [upload=155123]: Starting upload Aug 14 22:34:27.071219086 (149h8m21.502299217s) [upload=155123]: Done starting upload Aug 14 22:34:27.071267589 (149h8m21.50234772s) [upload=155123]: Uploading segments... Aug 14 22:34:27.071299530 (149h8m21.502379651s) [upload=155123]: Got next segment. Inline: true Aug 14 22:34:27.071303288 (149h8m21.502383419s) [upload=155123]: Waiting for error group managing segments... Aug 14 22:34:27.071336451 (149h8m21.502416582s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:34:27.071340519 (149h8m21.50242065s) [upload=155123]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 14 22:34:27.071343695 (149h8m21.502423826s) [upload=155123]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:34:28.085395588 (149h8m22.516475719s) [upload=155123]: Done uploading segments... Aug 14 22:34:28.085442427 (149h8m22.516522558s) [upload=155123]: Upload finished. err: <nil> Duration:* 3.133134275s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 10.016712287s FAIL (2025-08-14 22:57:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.016732526s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X.X...............X.......................................] duration: 7.360453108s FAIL (2025-08-14 22:57:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 584456c42d708087c09f0faeed3d1694451ccddbcd31c02942c9bab22782a5ee != before 5c56d2ec81ba59faf7cfbab91a8ddcef2d8a400fc52930931b158cbc222317fa ======LOGS====== Aug 14 22:26:13.497682333 (149h0m7.928762464s) [upload=154981]: Starting upload Aug 14 22:26:13.497731406 (149h0m7.928811537s) [upload=154981]: Done starting upload Aug 14 22:26:13.497858279 (149h0m7.92893842s) [upload=154981]: Uploading segments... Aug 14 22:26:13.498075795 (149h0m7.929155916s) [upload=154981]: Got next segment. Inline: false Aug 14 22:26:13.498128997 (149h0m7.929209118s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 14 22:26:13.498133646 (149h0m7.929213777s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 14 22:26:13.992314623 (149h0m8.423394744s) [seg_pos={0 0}, upload=154981]: Begin upload segment... Aug 14 22:26:13.992365701 (149h0m8.423445832s) [seg_pos={0 0}, upload=154981]: Done begin upload segment. Aug 14 22:26:13.992387002 (149h0m8.423467133s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992454140 (149h0m8.423534271s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.992940611 (149h0m8.424020742s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.993072905 (149h0m8.424153036s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994062568 (149h0m8.425142699s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994133022 (149h0m8.425213153s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994388251 (149h0m8.425468383s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994595357 (149h0m8.425675488s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.994800130 (149h0m8.425880261s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995007416 (149h0m8.426087547s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995221876 (149h0m8.426302007s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995422941 (149h0m8.426503073s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995617393 (149h0m8.426697525s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.995813909 (149h0m8.42689404s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996000406 (149h0m8.427080537s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.996185730 (149h0m8.427265871s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.998605130 (149h0m8.429685251s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:13.999270543 (149h0m8.430350664s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Uploading piece... Aug 14 22:26:15.479210578 (149h0m9.910290699s) [upload=154981]: Next returned nil segment Aug 14 22:26:15.479224896 (149h0m9.910305027s) [upload=154981]: Waiting for error group managing segments... Aug 14 22:26:15.884191582 (149h0m10.315271713s) [noise=true , address=79.127.220.101:4062 , piece_id=EB3WGWWNK3WC5L7QBAXINF45X3QG2UBXKC7NQDIMG2MC37W574IQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:15.979809937 (149h0m10.410890068s) [noise=true , address=104.36.82.22:4519 , piece_id=TRBOMMTO2D6H7IZOIZG7CJ4L7WW7JI67GJCZPEH7GZGOUO3JLT4A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.038643598 (149h0m10.469723719s) [noise=true , address=104.36.82.23:4459 , piece_id=R3VTPCYRCJE5BAQJKDG76UBIZW3WQADZIRPPPVLORFHAPPANQ6RQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.046584533 (149h0m10.477664664s) [noise=true , address=79.127.201.215:4343 , piece_id=32PBVWDURI6ZKXXVR5JUTRFOFZO63EWKAW5ZWKMJAKCSZVTMKPMQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.060061459 (149h0m10.49114159s) [noise=true , address=77.90.31.15:4721 , piece_id=ZDMZ772CRI3JJKIURGTAWR3GERAXUT5PPJ367KMFTGFESLEFWN5Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.109095179 (149h0m10.54017531s) [noise=true , address=104.36.82.2:4751 , piece_id=AN26TMRGCIDRWZJLRZ3D2RAPKGFWYG2SCPMVQIDDBGSULPR3CN3Q, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.125159296 (149h0m10.556239427s) [noise=true , address=104.36.82.5:4868 , piece_id=5IQVXHIE6U5OU7HX7AOKCZCNTAZTSY6OXULF2EIKNLNVEOYSPYCA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.127764371 (149h0m10.558844502s) [noise=true , address=104.36.82.58:4274 , piece_id=3O35Z7OA4PHQELTWQMOWZBU4OYOEGU6PTAV3UOJIRGCEZBNFEGEA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.274353653 (149h0m10.705433784s) [noise=true , address=77.90.31.21:4904 , piece_id=25ESPAPI5EX3PEK5DOKSGQJUY67XA7T5ABRA6KWXUEEYB2HRDITQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.432231163 (149h0m10.863311294s) [noise=true , address=77.90.31.13:4631 , piece_id=4V6PL6A2LX4LU4FX3FQKAIN75TMNSBPLAFIKESAKNGRZQWH2FCMA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.479539401 (149h0m10.910619532s) [noise=true , address=77.90.31.16:4749 , piece_id=YH4S54NRP375O66L7SRBMK3QPGXFUVREEBJOG55JHZALMZBVEYWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.517647347 (149h0m10.948727468s) [noise=true , address=77.90.31.12:4606 , piece_id=JAUXFZRHY3XNV3IU3FGMEDT6ILKAHV6Z7P5EPP4NYFXSVP22CAWA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.698196867 (149h0m11.129276988s) [noise=true , address=104.36.82.60:4359 , piece_id=6AN4XA4S54IBZZOISGGKUIIJXCAEDCOX3UDZBMSMSL47LAMX4VUQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701477545 (149h0m11.132557706s) [noise=true , address=104.36.82.45:4937 , piece_id=N5WKBIV2L5LFW3MWMCHTHQEMXFWK3GS4KVGZ6ZCBYZ57WWFZJUPQ, seg_pos={0 0}, upload=154981]: Done uploading piece. err: <nil> Aug 14 22:26:16.701494006 (149h0m11.132574137s) [seg_pos={0 0}, upload=154981]: Segment reached optimal threshold of 14 pieces. Aug 14 22:26:16.701792186 (149h0m11.132872327s) [noise=true , address=104.36.82.47:4527 , piece_id=AKTBF5SBOIOFPC6XWQ6RIBAUBCBBCPNJFNW7YLGV3IW573EGUOZA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17xmkbFoj3PTJnAygsjRAcfdd17AfSkPP2xdZp68GGPrvfMuU6): protocol: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57956->104.36.82.47:4527: use of closed network connection Aug 14 22:26:16.701887078 (149h0m11.132967209s) [noise=true , address=104.36.82.3:4780 , piece_id=JXS3SG57OPOQNGKXKFSOOF4XAH2GNE4SDN2OG2WVZYI6PCC5YGYA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i8cJRxzLNvUYqELrufixk24oDZwDHroyG5Cfy13csTPgeajRM): protocol: read tcp 188.166.225.170:38298->104.36.82.3:4780: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702037776 (149h0m11.133117957s) [noise=true , address=104.36.82.3:4784 , piece_id=S2G2YJNQB54DYHVD6JWNQ47PTD2BEYUSF4OLEA3IW2JQFKFBWA3A, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1534abg2Jn4zTQzvBcDDZDLq2QZp6kBKY1q6zEbk2PC8mJrnq3): protocol: read tcp 188.166.225.170:43306->104.36.82.3:4784: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702046854 (149h0m11.133126985s) [noise=true , address=104.36.82.20:4452 , piece_id=KAKFHVV6DYHJGVEKEXXNHINQRWO3WWWRVEGV5WRMX5TW6KFCMBNA, seg_pos={0 0}, upload=154981]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1HX5YAgmkBYJyw6bAY1vz4ov5aBeDsXjU4s7pxpBKAyLbG8yN6): protocol: read tcp 188.166.225.170:52080->104.36.82.20:4452: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 14 22:26:16.702087111 (149h0m11.133167242s) [seg_pos={0 0}, upload=154981]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 14 22:26:16.702169368 (149h0m11.133249499s) [upload=154981]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 14 22:26:16.702173857 (149h0m11.133253988s) [upload=154981]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 14 22:26:17.128005086 (149h0m11.559085237s) [upload=154981]: Done uploading segments... Aug 14 22:26:17.128028250 (149h0m11.559108401s) [upload=154981]: Upload finished. err: <nil> Duration: 7.360476233s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)