Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.932640042s FAIL (2025-08-22 18:42:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.932655873s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.X..........X...X.X.................X.............X.........] duration: 5.688718601s FAIL (2025-08-22 18:42:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 18:34:43.453438184 (337h8m37.884518305s) [upload=350752]: Starting upload Aug 22 18:34:43.453491707 (337h8m37.884571838s) [upload=350752]: Done starting upload Aug 22 18:34:43.453567491 (337h8m37.884647622s) [upload=350752]: Uploading segments... Aug 22 18:34:43.453677812 (337h8m37.884757943s) [upload=350752]: Got next segment. Inline: false Aug 22 18:34:43.453708861 (337h8m37.884788992s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:34:43.453713211 (337h8m37.884793342s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:34:43.910518285 (337h8m38.341598416s) [seg_pos={0 0}, upload=350752]: Begin upload segment... Aug 22 18:34:43.910567760 (337h8m38.341647891s) [seg_pos={0 0}, upload=350752]: Done begin upload segment. Aug 22 18:34:43.910580785 (337h8m38.341660916s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910588891 (337h8m38.341669022s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910809182 (337h8m38.341889313s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911048529 (337h8m38.34212866s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911321923 (337h8m38.342402054s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911579025 (337h8m38.342659156s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911834413 (337h8m38.342914545s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912084201 (337h8m38.343164332s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912384326 (337h8m38.343464457s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912596271 (337h8m38.343676392s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912789471 (337h8m38.343869592s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912982060 (337h8m38.344062191s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913185979 (337h8m38.34426611s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913377816 (337h8m38.344457947s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913559033 (337h8m38.344639155s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913756681 (337h8m38.344836812s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913960402 (337h8m38.345040533s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.914151447 (337h8m38.345231578s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:45.389715828 (337h8m39.820795959s) [upload=350752]: Next returned nil segment Aug 22 18:34:45.389732079 (337h8m39.82081221s) [upload=350752]: Waiting for error group managing segments... Aug 22 18:34:45.775177214 (337h8m40.206257345s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.881108404 (337h8m40.312188535s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.890602780 (337h8m40.321682911s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.894637731 (337h8m40.325717852s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.906915343 (337h8m40.337995474s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909015832 (337h8m40.340095963s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909315476 (337h8m40.340395607s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.920405655 (337h8m40.351485786s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.945707198 (337h8m40.376787329s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.979737151 (337h8m40.410817272s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.983752384 (337h8m40.414832515s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.041000462 (337h8m40.472080594s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.046744023 (337h8m40.477824144s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061602673 (337h8m40.492682804s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061627040 (337h8m40.492707171s) [seg_pos={0 0}, upload=350752]: Segment reached optimal threshold of 14 pieces. Aug 22 18:34:46.061751698 (337h8m40.492831829s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061885955 (337h8m40.492966116s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VaqXNoBYjwbbE9xhAoLzDuxZMdBPSm2aMw7bYm4qZqiEGp5CV): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061909621 (337h8m40.492989752s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124wXnmRuxo3o7AVwdSbUmai3SebaMV5qgScGVFSWFKSRvBNTyB): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061984163 (337h8m40.493064294s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dfnafsytLN1SDZVjxhGSoLxwduLPEEZC3CdsFGSZyELiZisVq): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.062004032 (337h8m40.493084163s) [seg_pos={0 0}, upload=350752]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 18:34:46.062065699 (337h8m40.493145831s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 18:34:46.062071410 (337h8m40.493151531s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:34:46.406094027 (337h8m40.837174158s) [upload=350752]: Done uploading segments... Aug 22 18:34:46.406112312 (337h8m40.837192443s) [upload=350752]: Upload finished. err: <nil> Duration: 5.688747978s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X...............X.....................................] duration: 1.883265282s FAIL (2025-08-22 18:42:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 1.883293846s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.890018204s FAIL (2025-08-22 18:41:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.890042732s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..X..........X...X.X.................X.............X........] duration: 5.723872349s FAIL (2025-08-22 18:41:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 18:34:43.453438184 (337h8m37.884518305s) [upload=350752]: Starting upload Aug 22 18:34:43.453491707 (337h8m37.884571838s) [upload=350752]: Done starting upload Aug 22 18:34:43.453567491 (337h8m37.884647622s) [upload=350752]: Uploading segments... Aug 22 18:34:43.453677812 (337h8m37.884757943s) [upload=350752]: Got next segment. Inline: false Aug 22 18:34:43.453708861 (337h8m37.884788992s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:34:43.453713211 (337h8m37.884793342s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:34:43.910518285 (337h8m38.341598416s) [seg_pos={0 0}, upload=350752]: Begin upload segment... Aug 22 18:34:43.910567760 (337h8m38.341647891s) [seg_pos={0 0}, upload=350752]: Done begin upload segment. Aug 22 18:34:43.910580785 (337h8m38.341660916s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910588891 (337h8m38.341669022s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910809182 (337h8m38.341889313s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911048529 (337h8m38.34212866s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911321923 (337h8m38.342402054s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911579025 (337h8m38.342659156s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911834413 (337h8m38.342914545s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912084201 (337h8m38.343164332s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912384326 (337h8m38.343464457s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912596271 (337h8m38.343676392s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912789471 (337h8m38.343869592s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912982060 (337h8m38.344062191s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913185979 (337h8m38.34426611s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913377816 (337h8m38.344457947s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913559033 (337h8m38.344639155s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913756681 (337h8m38.344836812s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913960402 (337h8m38.345040533s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.914151447 (337h8m38.345231578s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:45.389715828 (337h8m39.820795959s) [upload=350752]: Next returned nil segment Aug 22 18:34:45.389732079 (337h8m39.82081221s) [upload=350752]: Waiting for error group managing segments... Aug 22 18:34:45.775177214 (337h8m40.206257345s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.881108404 (337h8m40.312188535s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.890602780 (337h8m40.321682911s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.894637731 (337h8m40.325717852s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.906915343 (337h8m40.337995474s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909015832 (337h8m40.340095963s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909315476 (337h8m40.340395607s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.920405655 (337h8m40.351485786s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.945707198 (337h8m40.376787329s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.979737151 (337h8m40.410817272s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.983752384 (337h8m40.414832515s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.041000462 (337h8m40.472080594s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.046744023 (337h8m40.477824144s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061602673 (337h8m40.492682804s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061627040 (337h8m40.492707171s) [seg_pos={0 0}, upload=350752]: Segment reached optimal threshold of 14 pieces. Aug 22 18:34:46.061751698 (337h8m40.492831829s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061885955 (337h8m40.492966116s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VaqXNoBYjwbbE9xhAoLzDuxZMdBPSm2aMw7bYm4qZqiEGp5CV): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061909621 (337h8m40.492989752s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124wXnmRuxo3o7AVwdSbUmai3SebaMV5qgScGVFSWFKSRvBNTyB): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061984163 (337h8m40.493064294s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dfnafsytLN1SDZVjxhGSoLxwduLPEEZC3CdsFGSZyELiZisVq): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.062004032 (337h8m40.493084163s) [seg_pos={0 0}, upload=350752]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 18:34:46.062065699 (337h8m40.493145831s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 18:34:46.062071410 (337h8m40.493151531s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:34:46.406094027 (337h8m40.837174158s) [upload=350752]: Done uploading segments... Aug 22 18:34:46.406112312 (337h8m40.837192443s) [upload=350752]: Upload finished. err: <nil> Duration: 5.723898309s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X...............X....................................] duration: 1.856776426s FAIL (2025-08-22 18:41:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 1.856814328s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...X..........X...X.X.................X.............X.......] duration: 5.977288568s FAIL (2025-08-22 18:41:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 18:34:43.453438184 (337h8m37.884518305s) [upload=350752]: Starting upload Aug 22 18:34:43.453491707 (337h8m37.884571838s) [upload=350752]: Done starting upload Aug 22 18:34:43.453567491 (337h8m37.884647622s) [upload=350752]: Uploading segments... Aug 22 18:34:43.453677812 (337h8m37.884757943s) [upload=350752]: Got next segment. Inline: false Aug 22 18:34:43.453708861 (337h8m37.884788992s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:34:43.453713211 (337h8m37.884793342s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:34:43.910518285 (337h8m38.341598416s) [seg_pos={0 0}, upload=350752]: Begin upload segment... Aug 22 18:34:43.910567760 (337h8m38.341647891s) [seg_pos={0 0}, upload=350752]: Done begin upload segment. Aug 22 18:34:43.910580785 (337h8m38.341660916s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910588891 (337h8m38.341669022s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910809182 (337h8m38.341889313s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911048529 (337h8m38.34212866s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911321923 (337h8m38.342402054s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911579025 (337h8m38.342659156s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911834413 (337h8m38.342914545s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912084201 (337h8m38.343164332s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912384326 (337h8m38.343464457s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912596271 (337h8m38.343676392s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912789471 (337h8m38.343869592s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912982060 (337h8m38.344062191s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913185979 (337h8m38.34426611s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913377816 (337h8m38.344457947s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913559033 (337h8m38.344639155s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913756681 (337h8m38.344836812s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913960402 (337h8m38.345040533s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.914151447 (337h8m38.345231578s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:45.389715828 (337h8m39.820795959s) [upload=350752]: Next returned nil segment Aug 22 18:34:45.389732079 (337h8m39.82081221s) [upload=350752]: Waiting for error group managing segments... Aug 22 18:34:45.775177214 (337h8m40.206257345s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.881108404 (337h8m40.312188535s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.890602780 (337h8m40.321682911s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.894637731 (337h8m40.325717852s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.906915343 (337h8m40.337995474s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909015832 (337h8m40.340095963s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909315476 (337h8m40.340395607s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.920405655 (337h8m40.351485786s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.945707198 (337h8m40.376787329s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.979737151 (337h8m40.410817272s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.983752384 (337h8m40.414832515s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.041000462 (337h8m40.472080594s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.046744023 (337h8m40.477824144s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061602673 (337h8m40.492682804s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061627040 (337h8m40.492707171s) [seg_pos={0 0}, upload=350752]: Segment reached optimal threshold of 14 pieces. Aug 22 18:34:46.061751698 (337h8m40.492831829s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061885955 (337h8m40.492966116s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VaqXNoBYjwbbE9xhAoLzDuxZMdBPSm2aMw7bYm4qZqiEGp5CV): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061909621 (337h8m40.492989752s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124wXnmRuxo3o7AVwdSbUmai3SebaMV5qgScGVFSWFKSRvBNTyB): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061984163 (337h8m40.493064294s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dfnafsytLN1SDZVjxhGSoLxwduLPEEZC3CdsFGSZyELiZisVq): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.062004032 (337h8m40.493084163s) [seg_pos={0 0}, upload=350752]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 18:34:46.062065699 (337h8m40.493145831s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 18:34:46.062071410 (337h8m40.493151531s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:34:46.406094027 (337h8m40.837174158s) [upload=350752]: Done uploading segments... Aug 22 18:34:46.406112312 (337h8m40.837192443s) [upload=350752]: Upload finished. err: <nil> Duration: 5.977318044s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.807888776s FAIL (2025-08-22 18:41:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.807911991s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X...............X...................................] duration: 1.876171817s FAIL (2025-08-22 18:40:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 1.876201504s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [....X..........X...X.X.................X.............X......] duration: 5.979654746s FAIL (2025-08-22 18:40:24 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 18:34:43.453438184 (337h8m37.884518305s) [upload=350752]: Starting upload Aug 22 18:34:43.453491707 (337h8m37.884571838s) [upload=350752]: Done starting upload Aug 22 18:34:43.453567491 (337h8m37.884647622s) [upload=350752]: Uploading segments... Aug 22 18:34:43.453677812 (337h8m37.884757943s) [upload=350752]: Got next segment. Inline: false Aug 22 18:34:43.453708861 (337h8m37.884788992s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:34:43.453713211 (337h8m37.884793342s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:34:43.910518285 (337h8m38.341598416s) [seg_pos={0 0}, upload=350752]: Begin upload segment... Aug 22 18:34:43.910567760 (337h8m38.341647891s) [seg_pos={0 0}, upload=350752]: Done begin upload segment. Aug 22 18:34:43.910580785 (337h8m38.341660916s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910588891 (337h8m38.341669022s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910809182 (337h8m38.341889313s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911048529 (337h8m38.34212866s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911321923 (337h8m38.342402054s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911579025 (337h8m38.342659156s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911834413 (337h8m38.342914545s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912084201 (337h8m38.343164332s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912384326 (337h8m38.343464457s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912596271 (337h8m38.343676392s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912789471 (337h8m38.343869592s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912982060 (337h8m38.344062191s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913185979 (337h8m38.34426611s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913377816 (337h8m38.344457947s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913559033 (337h8m38.344639155s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913756681 (337h8m38.344836812s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913960402 (337h8m38.345040533s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.914151447 (337h8m38.345231578s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:45.389715828 (337h8m39.820795959s) [upload=350752]: Next returned nil segment Aug 22 18:34:45.389732079 (337h8m39.82081221s) [upload=350752]: Waiting for error group managing segments... Aug 22 18:34:45.775177214 (337h8m40.206257345s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.881108404 (337h8m40.312188535s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.890602780 (337h8m40.321682911s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.894637731 (337h8m40.325717852s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.906915343 (337h8m40.337995474s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909015832 (337h8m40.340095963s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909315476 (337h8m40.340395607s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.920405655 (337h8m40.351485786s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.945707198 (337h8m40.376787329s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.979737151 (337h8m40.410817272s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.983752384 (337h8m40.414832515s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.041000462 (337h8m40.472080594s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.046744023 (337h8m40.477824144s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061602673 (337h8m40.492682804s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061627040 (337h8m40.492707171s) [seg_pos={0 0}, upload=350752]: Segment reached optimal threshold of 14 pieces. Aug 22 18:34:46.061751698 (337h8m40.492831829s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061885955 (337h8m40.492966116s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VaqXNoBYjwbbE9xhAoLzDuxZMdBPSm2aMw7bYm4qZqiEGp5CV): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061909621 (337h8m40.492989752s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124wXnmRuxo3o7AVwdSbUmai3SebaMV5qgScGVFSWFKSRvBNTyB): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061984163 (337h8m40.493064294s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dfnafsytLN1SDZVjxhGSoLxwduLPEEZC3CdsFGSZyELiZisVq): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.062004032 (337h8m40.493084163s) [seg_pos={0 0}, upload=350752]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 18:34:46.062065699 (337h8m40.493145831s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 18:34:46.062071410 (337h8m40.493151531s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:34:46.406094027 (337h8m40.837174158s) [upload=350752]: Done uploading segments... Aug 22 18:34:46.406112312 (337h8m40.837192443s) [upload=350752]: Upload finished. err: <nil> Duration: 5.979682649s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 6.014441827s FAIL (2025-08-22 18:40:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.014468748s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X...............X..................................] duration: 1.848900296s FAIL (2025-08-22 18:39:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 1.848927076s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X...............X.................................] duration: 1.843495913s FAIL (2025-08-22 18:39:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 1.843636091s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.....X..........X...X.X.................X.............X.....] duration: 6.109525752s FAIL (2025-08-22 18:39:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 18:34:43.453438184 (337h8m37.884518305s) [upload=350752]: Starting upload Aug 22 18:34:43.453491707 (337h8m37.884571838s) [upload=350752]: Done starting upload Aug 22 18:34:43.453567491 (337h8m37.884647622s) [upload=350752]: Uploading segments... Aug 22 18:34:43.453677812 (337h8m37.884757943s) [upload=350752]: Got next segment. Inline: false Aug 22 18:34:43.453708861 (337h8m37.884788992s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:34:43.453713211 (337h8m37.884793342s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:34:43.910518285 (337h8m38.341598416s) [seg_pos={0 0}, upload=350752]: Begin upload segment... Aug 22 18:34:43.910567760 (337h8m38.341647891s) [seg_pos={0 0}, upload=350752]: Done begin upload segment. Aug 22 18:34:43.910580785 (337h8m38.341660916s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910588891 (337h8m38.341669022s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910809182 (337h8m38.341889313s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911048529 (337h8m38.34212866s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911321923 (337h8m38.342402054s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911579025 (337h8m38.342659156s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911834413 (337h8m38.342914545s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912084201 (337h8m38.343164332s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912384326 (337h8m38.343464457s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912596271 (337h8m38.343676392s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912789471 (337h8m38.343869592s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912982060 (337h8m38.344062191s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913185979 (337h8m38.34426611s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913377816 (337h8m38.344457947s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913559033 (337h8m38.344639155s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913756681 (337h8m38.344836812s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913960402 (337h8m38.345040533s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.914151447 (337h8m38.345231578s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:45.389715828 (337h8m39.820795959s) [upload=350752]: Next returned nil segment Aug 22 18:34:45.389732079 (337h8m39.82081221s) [upload=350752]: Waiting for error group managing segments... Aug 22 18:34:45.775177214 (337h8m40.206257345s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.881108404 (337h8m40.312188535s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.890602780 (337h8m40.321682911s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.894637731 (337h8m40.325717852s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.906915343 (337h8m40.337995474s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909015832 (337h8m40.340095963s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909315476 (337h8m40.340395607s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.920405655 (337h8m40.351485786s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.945707198 (337h8m40.376787329s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.979737151 (337h8m40.410817272s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.983752384 (337h8m40.414832515s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.041000462 (337h8m40.472080594s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.046744023 (337h8m40.477824144s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061602673 (337h8m40.492682804s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061627040 (337h8m40.492707171s) [seg_pos={0 0}, upload=350752]: Segment reached optimal threshold of 14 pieces. Aug 22 18:34:46.061751698 (337h8m40.492831829s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061885955 (337h8m40.492966116s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VaqXNoBYjwbbE9xhAoLzDuxZMdBPSm2aMw7bYm4qZqiEGp5CV): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061909621 (337h8m40.492989752s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124wXnmRuxo3o7AVwdSbUmai3SebaMV5qgScGVFSWFKSRvBNTyB): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061984163 (337h8m40.493064294s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dfnafsytLN1SDZVjxhGSoLxwduLPEEZC3CdsFGSZyELiZisVq): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.062004032 (337h8m40.493084163s) [seg_pos={0 0}, upload=350752]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 18:34:46.062065699 (337h8m40.493145831s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 18:34:46.062071410 (337h8m40.493151531s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:34:46.406094027 (337h8m40.837174158s) [upload=350752]: Done uploading segments... Aug 22 18:34:46.406112312 (337h8m40.837192443s) [upload=350752]: Upload finished. err: <nil> Duration: 6.109547364s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.025215212s FAIL (2025-08-22 18:39:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.025261951s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 6.159789797s FAIL (2025-08-22 18:38:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.159812992s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X...............X................................] duration: 2.095851654s FAIL (2025-08-22 18:38:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 2.095874419s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [......X..........X...X.X.................X.............X....] duration: 5.772165013s FAIL (2025-08-22 18:38:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 18:34:43.453438184 (337h8m37.884518305s) [upload=350752]: Starting upload Aug 22 18:34:43.453491707 (337h8m37.884571838s) [upload=350752]: Done starting upload Aug 22 18:34:43.453567491 (337h8m37.884647622s) [upload=350752]: Uploading segments... Aug 22 18:34:43.453677812 (337h8m37.884757943s) [upload=350752]: Got next segment. Inline: false Aug 22 18:34:43.453708861 (337h8m37.884788992s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:34:43.453713211 (337h8m37.884793342s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:34:43.910518285 (337h8m38.341598416s) [seg_pos={0 0}, upload=350752]: Begin upload segment... Aug 22 18:34:43.910567760 (337h8m38.341647891s) [seg_pos={0 0}, upload=350752]: Done begin upload segment. Aug 22 18:34:43.910580785 (337h8m38.341660916s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910588891 (337h8m38.341669022s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910809182 (337h8m38.341889313s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911048529 (337h8m38.34212866s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911321923 (337h8m38.342402054s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911579025 (337h8m38.342659156s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911834413 (337h8m38.342914545s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912084201 (337h8m38.343164332s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912384326 (337h8m38.343464457s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912596271 (337h8m38.343676392s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912789471 (337h8m38.343869592s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912982060 (337h8m38.344062191s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913185979 (337h8m38.34426611s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913377816 (337h8m38.344457947s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913559033 (337h8m38.344639155s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913756681 (337h8m38.344836812s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913960402 (337h8m38.345040533s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.914151447 (337h8m38.345231578s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:45.389715828 (337h8m39.820795959s) [upload=350752]: Next returned nil segment Aug 22 18:34:45.389732079 (337h8m39.82081221s) [upload=350752]: Waiting for error group managing segments... Aug 22 18:34:45.775177214 (337h8m40.206257345s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.881108404 (337h8m40.312188535s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.890602780 (337h8m40.321682911s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.894637731 (337h8m40.325717852s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.906915343 (337h8m40.337995474s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909015832 (337h8m40.340095963s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909315476 (337h8m40.340395607s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.920405655 (337h8m40.351485786s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.945707198 (337h8m40.376787329s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.979737151 (337h8m40.410817272s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.983752384 (337h8m40.414832515s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.041000462 (337h8m40.472080594s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.046744023 (337h8m40.477824144s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061602673 (337h8m40.492682804s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061627040 (337h8m40.492707171s) [seg_pos={0 0}, upload=350752]: Segment reached optimal threshold of 14 pieces. Aug 22 18:34:46.061751698 (337h8m40.492831829s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061885955 (337h8m40.492966116s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VaqXNoBYjwbbE9xhAoLzDuxZMdBPSm2aMw7bYm4qZqiEGp5CV): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061909621 (337h8m40.492989752s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124wXnmRuxo3o7AVwdSbUmai3SebaMV5qgScGVFSWFKSRvBNTyB): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061984163 (337h8m40.493064294s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dfnafsytLN1SDZVjxhGSoLxwduLPEEZC3CdsFGSZyELiZisVq): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.062004032 (337h8m40.493084163s) [seg_pos={0 0}, upload=350752]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 18:34:46.062065699 (337h8m40.493145831s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 18:34:46.062071410 (337h8m40.493151531s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:34:46.406094027 (337h8m40.837174158s) [upload=350752]: Done uploading segments... Aug 22 18:34:46.406112312 (337h8m40.837192443s) [upload=350752]: Upload finished. err: <nil> Duration: 5.772189479s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.......X..........X...X.X.................X.............X...] duration: 5.905565834s FAIL (2025-08-22 18:37:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 18:34:43.453438184 (337h8m37.884518305s) [upload=350752]: Starting upload Aug 22 18:34:43.453491707 (337h8m37.884571838s) [upload=350752]: Done starting upload Aug 22 18:34:43.453567491 (337h8m37.884647622s) [upload=350752]: Uploading segments... Aug 22 18:34:43.453677812 (337h8m37.884757943s) [upload=350752]: Got next segment. Inline: false Aug 22 18:34:43.453708861 (337h8m37.884788992s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:34:43.453713211 (337h8m37.884793342s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:34:43.910518285 (337h8m38.341598416s) [seg_pos={0 0}, upload=350752]: Begin upload segment... Aug 22 18:34:43.910567760 (337h8m38.341647891s) [seg_pos={0 0}, upload=350752]: Done begin upload segment. Aug 22 18:34:43.910580785 (337h8m38.341660916s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910588891 (337h8m38.341669022s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910809182 (337h8m38.341889313s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911048529 (337h8m38.34212866s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911321923 (337h8m38.342402054s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911579025 (337h8m38.342659156s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911834413 (337h8m38.342914545s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912084201 (337h8m38.343164332s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912384326 (337h8m38.343464457s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912596271 (337h8m38.343676392s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912789471 (337h8m38.343869592s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912982060 (337h8m38.344062191s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913185979 (337h8m38.34426611s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913377816 (337h8m38.344457947s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913559033 (337h8m38.344639155s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913756681 (337h8m38.344836812s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913960402 (337h8m38.345040533s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.914151447 (337h8m38.345231578s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:45.389715828 (337h8m39.820795959s) [upload=350752]: Next returned nil segment Aug 22 18:34:45.389732079 (337h8m39.82081221s) [upload=350752]: Waiting for error group managing segments... Aug 22 18:34:45.775177214 (337h8m40.206257345s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.881108404 (337h8m40.312188535s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.890602780 (337h8m40.321682911s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.894637731 (337h8m40.325717852s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.906915343 (337h8m40.337995474s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909015832 (337h8m40.340095963s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909315476 (337h8m40.340395607s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.920405655 (337h8m40.351485786s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.945707198 (337h8m40.376787329s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.979737151 (337h8m40.410817272s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.983752384 (337h8m40.414832515s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.041000462 (337h8m40.472080594s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.046744023 (337h8m40.477824144s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061602673 (337h8m40.492682804s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061627040 (337h8m40.492707171s) [seg_pos={0 0}, upload=350752]: Segment reached optimal threshold of 14 pieces. Aug 22 18:34:46.061751698 (337h8m40.492831829s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061885955 (337h8m40.492966116s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VaqXNoBYjwbbE9xhAoLzDuxZMdBPSm2aMw7bYm4qZqiEGp5CV): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061909621 (337h8m40.492989752s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124wXnmRuxo3o7AVwdSbUmai3SebaMV5qgScGVFSWFKSRvBNTyB): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061984163 (337h8m40.493064294s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dfnafsytLN1SDZVjxhGSoLxwduLPEEZC3CdsFGSZyELiZisVq): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.062004032 (337h8m40.493084163s) [seg_pos={0 0}, upload=350752]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 18:34:46.062065699 (337h8m40.493145831s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 18:34:46.062071410 (337h8m40.493151531s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:34:46.406094027 (337h8m40.837174158s) [upload=350752]: Done uploading segments... Aug 22 18:34:46.406112312 (337h8m40.837192443s) [upload=350752]: Upload finished. err: <nil> Duration: 5.905591172s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.23308373s FAIL (2025-08-22 18:37:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.2331051s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.897576584s FAIL (2025-08-22 18:37:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.897597324s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X...............X...............................] duration: 2.139825926s FAIL (2025-08-22 18:37:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 2.139894797s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.252973457s FAIL (2025-08-22 18:36:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.253002762s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [........X..........X...X.X.................X.............X..] duration: 5.910293971s FAIL (2025-08-22 18:36:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 18:34:43.453438184 (337h8m37.884518305s) [upload=350752]: Starting upload Aug 22 18:34:43.453491707 (337h8m37.884571838s) [upload=350752]: Done starting upload Aug 22 18:34:43.453567491 (337h8m37.884647622s) [upload=350752]: Uploading segments... Aug 22 18:34:43.453677812 (337h8m37.884757943s) [upload=350752]: Got next segment. Inline: false Aug 22 18:34:43.453708861 (337h8m37.884788992s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:34:43.453713211 (337h8m37.884793342s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:34:43.910518285 (337h8m38.341598416s) [seg_pos={0 0}, upload=350752]: Begin upload segment... Aug 22 18:34:43.910567760 (337h8m38.341647891s) [seg_pos={0 0}, upload=350752]: Done begin upload segment. Aug 22 18:34:43.910580785 (337h8m38.341660916s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910588891 (337h8m38.341669022s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910809182 (337h8m38.341889313s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911048529 (337h8m38.34212866s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911321923 (337h8m38.342402054s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911579025 (337h8m38.342659156s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911834413 (337h8m38.342914545s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912084201 (337h8m38.343164332s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912384326 (337h8m38.343464457s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912596271 (337h8m38.343676392s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912789471 (337h8m38.343869592s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912982060 (337h8m38.344062191s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913185979 (337h8m38.34426611s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913377816 (337h8m38.344457947s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913559033 (337h8m38.344639155s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913756681 (337h8m38.344836812s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913960402 (337h8m38.345040533s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.914151447 (337h8m38.345231578s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:45.389715828 (337h8m39.820795959s) [upload=350752]: Next returned nil segment Aug 22 18:34:45.389732079 (337h8m39.82081221s) [upload=350752]: Waiting for error group managing segments... Aug 22 18:34:45.775177214 (337h8m40.206257345s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.881108404 (337h8m40.312188535s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.890602780 (337h8m40.321682911s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.894637731 (337h8m40.325717852s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.906915343 (337h8m40.337995474s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909015832 (337h8m40.340095963s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909315476 (337h8m40.340395607s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.920405655 (337h8m40.351485786s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.945707198 (337h8m40.376787329s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.979737151 (337h8m40.410817272s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.983752384 (337h8m40.414832515s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.041000462 (337h8m40.472080594s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.046744023 (337h8m40.477824144s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061602673 (337h8m40.492682804s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061627040 (337h8m40.492707171s) [seg_pos={0 0}, upload=350752]: Segment reached optimal threshold of 14 pieces. Aug 22 18:34:46.061751698 (337h8m40.492831829s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061885955 (337h8m40.492966116s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VaqXNoBYjwbbE9xhAoLzDuxZMdBPSm2aMw7bYm4qZqiEGp5CV): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061909621 (337h8m40.492989752s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124wXnmRuxo3o7AVwdSbUmai3SebaMV5qgScGVFSWFKSRvBNTyB): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061984163 (337h8m40.493064294s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dfnafsytLN1SDZVjxhGSoLxwduLPEEZC3CdsFGSZyELiZisVq): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.062004032 (337h8m40.493084163s) [seg_pos={0 0}, upload=350752]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 18:34:46.062065699 (337h8m40.493145831s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 18:34:46.062071410 (337h8m40.493151531s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:34:46.406094027 (337h8m40.837174158s) [upload=350752]: Done uploading segments... Aug 22 18:34:46.406112312 (337h8m40.837192443s) [upload=350752]: Upload finished. err: <nil> Duration: 5.910320921s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.267904978s FAIL (2025-08-22 18:36:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.267926618s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X...............X..............................] duration: 2.169046197s FAIL (2025-08-22 18:36:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 2.169123403s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.........X..........X...X.X.................X.............X.] duration: 6.195471501s FAIL (2025-08-22 18:36:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 18:34:43.453438184 (337h8m37.884518305s) [upload=350752]: Starting upload Aug 22 18:34:43.453491707 (337h8m37.884571838s) [upload=350752]: Done starting upload Aug 22 18:34:43.453567491 (337h8m37.884647622s) [upload=350752]: Uploading segments... Aug 22 18:34:43.453677812 (337h8m37.884757943s) [upload=350752]: Got next segment. Inline: false Aug 22 18:34:43.453708861 (337h8m37.884788992s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:34:43.453713211 (337h8m37.884793342s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:34:43.910518285 (337h8m38.341598416s) [seg_pos={0 0}, upload=350752]: Begin upload segment... Aug 22 18:34:43.910567760 (337h8m38.341647891s) [seg_pos={0 0}, upload=350752]: Done begin upload segment. Aug 22 18:34:43.910580785 (337h8m38.341660916s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910588891 (337h8m38.341669022s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910809182 (337h8m38.341889313s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911048529 (337h8m38.34212866s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911321923 (337h8m38.342402054s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911579025 (337h8m38.342659156s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911834413 (337h8m38.342914545s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912084201 (337h8m38.343164332s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912384326 (337h8m38.343464457s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912596271 (337h8m38.343676392s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912789471 (337h8m38.343869592s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912982060 (337h8m38.344062191s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913185979 (337h8m38.34426611s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913377816 (337h8m38.344457947s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913559033 (337h8m38.344639155s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913756681 (337h8m38.344836812s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913960402 (337h8m38.345040533s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.914151447 (337h8m38.345231578s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:45.389715828 (337h8m39.820795959s) [upload=350752]: Next returned nil segment Aug 22 18:34:45.389732079 (337h8m39.82081221s) [upload=350752]: Waiting for error group managing segments... Aug 22 18:34:45.775177214 (337h8m40.206257345s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.881108404 (337h8m40.312188535s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.890602780 (337h8m40.321682911s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.894637731 (337h8m40.325717852s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.906915343 (337h8m40.337995474s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909015832 (337h8m40.340095963s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909315476 (337h8m40.340395607s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.920405655 (337h8m40.351485786s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.945707198 (337h8m40.376787329s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.979737151 (337h8m40.410817272s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.983752384 (337h8m40.414832515s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.041000462 (337h8m40.472080594s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.046744023 (337h8m40.477824144s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061602673 (337h8m40.492682804s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061627040 (337h8m40.492707171s) [seg_pos={0 0}, upload=350752]: Segment reached optimal threshold of 14 pieces. Aug 22 18:34:46.061751698 (337h8m40.492831829s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061885955 (337h8m40.492966116s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VaqXNoBYjwbbE9xhAoLzDuxZMdBPSm2aMw7bYm4qZqiEGp5CV): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061909621 (337h8m40.492989752s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124wXnmRuxo3o7AVwdSbUmai3SebaMV5qgScGVFSWFKSRvBNTyB): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061984163 (337h8m40.493064294s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dfnafsytLN1SDZVjxhGSoLxwduLPEEZC3CdsFGSZyELiZisVq): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.062004032 (337h8m40.493084163s) [seg_pos={0 0}, upload=350752]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 18:34:46.062065699 (337h8m40.493145831s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 18:34:46.062071410 (337h8m40.493151531s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:34:46.406094027 (337h8m40.837174158s) [upload=350752]: Done uploading segments... Aug 22 18:34:46.406112312 (337h8m40.837192443s) [upload=350752]: Upload finished. err: <nil> Duration: 6.19549706s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.265069341s FAIL (2025-08-22 18:36:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.265088527s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 9.105887322s FAIL (2025-08-22 18:35:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 9.10590759s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X...............X.............................] duration: 1.960768163s FAIL (2025-08-22 18:35:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 1.960795768s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.760171022s FAIL (2025-08-22 18:35:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.760192443s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..........X..........X...X.X.................X.............X] duration: 4.060641194s FAIL (2025-08-22 18:34:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 22 18:34:43.453438184 (337h8m37.884518305s) [upload=350752]: Starting upload Aug 22 18:34:43.453491707 (337h8m37.884571838s) [upload=350752]: Done starting upload Aug 22 18:34:43.453567491 (337h8m37.884647622s) [upload=350752]: Uploading segments... Aug 22 18:34:43.453677812 (337h8m37.884757943s) [upload=350752]: Got next segment. Inline: false Aug 22 18:34:43.453708861 (337h8m37.884788992s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:34:43.453713211 (337h8m37.884793342s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:34:43.910518285 (337h8m38.341598416s) [seg_pos={0 0}, upload=350752]: Begin upload segment... Aug 22 18:34:43.910567760 (337h8m38.341647891s) [seg_pos={0 0}, upload=350752]: Done begin upload segment. Aug 22 18:34:43.910580785 (337h8m38.341660916s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910588891 (337h8m38.341669022s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.910809182 (337h8m38.341889313s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911048529 (337h8m38.34212866s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911321923 (337h8m38.342402054s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911579025 (337h8m38.342659156s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.911834413 (337h8m38.342914545s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912084201 (337h8m38.343164332s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912384326 (337h8m38.343464457s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912596271 (337h8m38.343676392s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912789471 (337h8m38.343869592s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.912982060 (337h8m38.344062191s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913185979 (337h8m38.34426611s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913377816 (337h8m38.344457947s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913559033 (337h8m38.344639155s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913756681 (337h8m38.344836812s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.913960402 (337h8m38.345040533s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:43.914151447 (337h8m38.345231578s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Uploading piece... Aug 22 18:34:45.389715828 (337h8m39.820795959s) [upload=350752]: Next returned nil segment Aug 22 18:34:45.389732079 (337h8m39.82081221s) [upload=350752]: Waiting for error group managing segments... Aug 22 18:34:45.775177214 (337h8m40.206257345s) [noise=true , address=79.127.220.97:4377 , piece_id=2UOABAAJKZNW3W55F2RENTZOTYMU32IR7VCNAMXSGALKAJOEBSQQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.881108404 (337h8m40.312188535s) [noise=true , address=104.36.82.55:4213 , piece_id=EWCVGA4VX3T2UWXPMT44OL5FM7JQJP55WKKRX67UOFSN6RXCSDXQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.890602780 (337h8m40.321682911s) [noise=true , address=45.91.116.5:4328 , piece_id=GDRSZ4F4Q2I2VQCBGM3GNSEOBTMYSAKXD5G7ZBPLQA5TO37BSOSA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.894637731 (337h8m40.325717852s) [noise=true , address=77.90.31.17:4783 , piece_id=P6XUR6YNSETWZ4PQ75G3U7G434ZNSHVMNOMKGH62A3DGTATDQPAQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.906915343 (337h8m40.337995474s) [noise=true , address=104.36.82.12:4161 , piece_id=7UV7WCDWS74AMZRO4MDH6JLT5A447R4ZZXEUALI6DEQMWFYK3X2Q, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909015832 (337h8m40.340095963s) [noise=true , address=45.91.116.11:4141 , piece_id=QDOGCZ7F2MHS4H5NTDJC4UGH5LDRV7AIWH2EQ5NKECI2KJCF7M7A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.909315476 (337h8m40.340395607s) [noise=true , address=45.91.116.10:4107 , piece_id=LG5XD5VLQKLJX7ZCIIXKI2JLTV57JZJTXUUY2WEQMG4ATYFKX53A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.920405655 (337h8m40.351485786s) [noise=true , address=104.36.82.49:4993 , piece_id=HH32R3VVV2SQQK3ZTW7XBRPS2R4356YVNYEC3XXRW3LHFSTNU4WA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.945707198 (337h8m40.376787329s) [noise=true , address=104.36.82.60:4345 , piece_id=P62ONB2XZMFRBKR3BWVBQZCJIK2GA3WBTRUIL6XSBKK3OVZL3D4A, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.979737151 (337h8m40.410817272s) [noise=true , address=104.36.82.5:4872 , piece_id=XC7QFSIRS6L4U2XXH6XGJOFTB3YOYOSP4YYSW4XIGUIG4SHDF6EA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:45.983752384 (337h8m40.414832515s) [noise=true , address=104.36.82.23:4449 , piece_id=YFHGSYFJCH2X6MC3A25ONUQITG2F5LM7AB4ODNG5B3RNL4KHRUBQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.041000462 (337h8m40.472080594s) [noise=true , address=104.36.82.13:4206 , piece_id=EBRQDST2WAZM4OCSGTYEI4MCHMV6CJ5CKB5FCV4ND7OWKB5CZLKA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.046744023 (337h8m40.477824144s) [noise=true , address=104.36.82.34:4574 , piece_id=US3OIJEVAP7RYJ2Y4ZPMB7IIGSJJ3VYRP6IMSWZR2MFLHMG2EKMA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061602673 (337h8m40.492682804s) [noise=true , address=77.90.31.18:4827 , piece_id=G7YKRDXWTHR2OKYC526ZULB5TPJLYW5YMM5C3XUV6ZT4D3CY4DLQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: <nil> Aug 22 18:34:46.061627040 (337h8m40.492707171s) [seg_pos={0 0}, upload=350752]: Segment reached optimal threshold of 14 pieces. Aug 22 18:34:46.061751698 (337h8m40.492831829s) [noise=true , address=104.36.82.11:4125 , piece_id=6NXXOWFCNTK2WWMNRXTFL3R2A5HOLRO7DQ46IUQ57D6IOXLH2CJA, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vricofwx67FRaxAGLbmgT1TYyKkqfJbxdsyeEPL4R7kg8pKzT): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061885955 (337h8m40.492966116s) [noise=true , address=104.36.82.7:4917 , piece_id=QL3BMLYMRBEYB2COKGODZO5O4ZT7WA7AYRSLWEZWJ7CE7GPEJ4QQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VaqXNoBYjwbbE9xhAoLzDuxZMdBPSm2aMw7bYm4qZqiEGp5CV): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061909621 (337h8m40.492989752s) [noise=true , address=104.36.82.14:4233 , piece_id=HXRACJPJQVIFEAJYLQJQ3OND5VIY623B7G2TFRZBLH227SPFVFZQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124wXnmRuxo3o7AVwdSbUmai3SebaMV5qgScGVFSWFKSRvBNTyB): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.061984163 (337h8m40.493064294s) [noise=true , address=79.127.220.98:4427 , piece_id=IRG7COZMXE7BJGL5FYLDEFPX7MNMPIYT5SUZNG4QFQC5HIPJ2GTQ, seg_pos={0 0}, upload=350752]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dfnafsytLN1SDZVjxhGSoLxwduLPEEZC3CdsFGSZyELiZisVq): protocol: expected piece hash; context canceled; EOF Aug 22 18:34:46.062004032 (337h8m40.493084163s) [seg_pos={0 0}, upload=350752]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 22 18:34:46.062065699 (337h8m40.493145831s) [upload=350752]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 22 18:34:46.062071410 (337h8m40.493151531s) [upload=350752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:34:46.406094027 (337h8m40.837174158s) [upload=350752]: Done uploading segments... Aug 22 18:34:46.406112312 (337h8m40.837192443s) [upload=350752]: Upload finished. err: <nil> Duration: 4.060671653s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X...............X............................] duration: 1.928507235s FAIL (2025-08-22 18:34:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 1.928531102s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.844432297s FAIL (2025-08-22 18:34:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.84445557s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...........X..........X...X.X.................X.............] duration: 5.970043675s FAIL (2025-08-22 18:34:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests Duration: 5.970091707s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X...............X...........................] duration: 1.918005703s FAIL (2025-08-22 18:33:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 1.918033417s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [............X..........X...X.X.................X............] duration: 6.040115871s FAIL (2025-08-22 18:33:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests Duration: 6.040140157s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.517772565s FAIL (2025-08-22 18:33:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.517793024s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X...............X..........................] duration: 1.866625231s FAIL (2025-08-22 18:33:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 1.866649818s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.956887882s FAIL (2025-08-22 18:33:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.956908873s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [X............X..........X...X.X.................X...........] duration: 6.370904276s FAIL (2025-08-22 18:32:36 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests Duration: 6.370926108s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X...............X.........................] duration: 1.913317312s FAIL (2025-08-22 18:32:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 1.91333736s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 6.179210927s FAIL (2025-08-22 18:32:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.179246505s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [.X............X..........X...X.X.................X..........] duration: 6.037360913s FAIL (2025-08-22 18:31:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests Duration: 6.037388224s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.268301295s FAIL (2025-08-22 18:31:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.268332193s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X...............X........................] duration: 1.907945534s FAIL (2025-08-22 18:31:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 34b6639044b3defb464d63c3a1a649f89dccbf65d67da149ef9fa3bc1038358e != before 9dc427c8268b4d32eb4286403971ed3f0547bd056f7730cc12721d25f744e1c9 ======LOGS====== Aug 22 18:12:11.788594959 (336h46m6.219675091s) [upload=350363]: Starting upload Aug 22 18:12:11.788643582 (336h46m6.219723713s) [upload=350363]: Done starting upload Aug 22 18:12:11.788688799 (336h46m6.21976893s) [upload=350363]: Uploading segments... Aug 22 18:12:11.788724697 (336h46m6.219804818s) [upload=350363]: Got next segment. Inline: true Aug 22 18:12:11.788728955 (336h46m6.219809086s) [upload=350363]: Waiting for error group managing segments... Aug 22 18:12:11.788775625 (336h46m6.219855756s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:12:11.788783008 (336h46m6.21986315s) [upload=350363]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 22 18:12:11.788787247 (336h46m6.219867378s) [upload=350363]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 22 18:12:12.075988540 (336h46m6.507068671s) [upload=350363]: Done uploading segments... Aug 22 18:12:12.076007145 (336h46m6.507087276s) [upload=350363]: Upload finished. err: <nil> Duration:* 1.907995318s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.438635333s FAIL (2025-08-22 18:31:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.438718491s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [..X............X..........X...X.X.................X.........] duration: 5.703655345s FAIL (2025-08-22 18:31:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests Duration: 5.703754605s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.856255523s FAIL (2025-08-22 18:30:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.856281654s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 6 out of 60 is failed (threshold=3) [...X............X..........X...X.X.................X........] duration: 5.896228517s FAIL (2025-08-22 18:30:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 22 18:25:30.698854970 (336h59m25.129935101s) [upload=350593]: Starting upload Aug 22 18:25:30.698911879 (336h59m25.12999201s) [upload=350593]: Done starting upload Aug 22 18:25:30.699035856 (336h59m25.130115988s) [upload=350593]: Uploading segments... Aug 22 18:25:30.699125217 (336h59m25.130205348s) [upload=350593]: Got next segment. Inline: false Aug 22 18:25:30.699179180 (336h59m25.130259322s) [upload=350593]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 22 18:25:30.699184611 (336h59m25.130264752s) [upload=350593]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 22 18:25:30.967627323 (336h59m25.398707474s) [upload=350593]: Next segment err: metaclient: Too Many Requests Aug 22 18:25:30.967661118 (336h59m25.398741259s) [upload=350593]: Done uploading segments... Aug 22 18:25:30.967680164 (336h59m25.398760315s) [upload=350593]: Upload finished. err: metaclient: Too Many Requests Duration: 5.896258053s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)