Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................................................XXX] duration:
30.247768127s
FAIL (2025-08-17 13:03:50 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 9)
======LOGS======
Aug 17 13:03:20.484071994 (211h37m14.915152125s) [upload=220104]: Starting upload
Aug 17 13:03:20.484170583 (211h37m14.915250724s) [upload=220104]: Done starting upload
Aug 17 13:03:20.484227702 (211h37m14.915307863s) [upload=220104]: Uploading segments...
Aug 17 13:03:20.484525802 (211h37m14.915605933s) [upload=220104]: Got next segment. Inline: false
Aug 17 13:03:20.484563083 (211h37m14.915643204s) [upload=220104]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 13:03:20.484569075 (211h37m14.915649206s) [upload=220104]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 13:03:20.748753239 (211h37m15.17983338s) [seg_pos={0 0}, upload=220104]: Begin upload segment...
Aug 17 13:03:20.748811050 (211h37m15.179891181s) [seg_pos={0 0}, upload=220104]: Done begin upload segment.
Aug 17 13:03:20.748909258 (211h37m15.179989399s) [noise=true , address=77.90.31.14:4662 , piece_id=WHU2KWNBGSQ342A77GGSI5VJXXME7IUMMGTJF5S2QS44GJXEOPFA, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.748917123 (211h37m15.179997254s) [noise=true , address=104.36.82.4:4801 , piece_id=T7GBUNRGIJKKUOYJAXPNQCY7D37H2IXGYCE4QF5JW6HU3MU66TIQ, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.748978670 (211h37m15.180058801s) [noise=true , address=45.91.116.13:4154 , piece_id=DHZC5HYZTR6A6DO42TYR65J6LHGQAUDLF4ITZXYMSS652TXZYCXA, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.749331335 (211h37m15.180411466s) [noise=true , address=104.36.82.2:4729 , piece_id=SXC5TTHOKNQEPFHOFUMQYELKYHVQ2KPWFZUSWI35342B5NYWFX3A, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.755138867 (211h37m15.186218998s) [noise=true , address=104.36.82.16:4295 , piece_id=YYLRHZKBL3TCFD33XKU3JHL5562ZQCEWMK4DIVOB7WSW3GAZ7ZPA, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.755502082 (211h37m15.186582213s) [noise=true , address=45.91.116.14:4190 , piece_id=WWSUX4J6VZG6TOY5X3AT5HCRDCXAC2AWXGTBLE4E2FORCGFUYY6Q, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.755779192 (211h37m15.186859323s) [noise=true , address=77.90.31.11:4553 , piece_id=E2UY3MOVRE5SIP4WXX5YDGOJVGRM3XYBHLU5JZRYDNSXESO2LCNA, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.757123114 (211h37m15.188203235s) [noise=true , address=104.36.82.8:4969 , piece_id=RA7LMGM3GEWZSLWWEP7UOIT22DON74B3NGUDQKRPW5AZAZKO4GNQ, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.757454608 (211h37m15.188534739s) [noise=true , address=45.91.116.5:4298 , piece_id=TK7ZXWLEPVBCJG5SLMPROOADNTB6JQ5OMXI43YWJ2KIL47C7FITQ, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.758069424 (211h37m15.189149565s) [noise=true , address=104.36.82.11:4114 , piece_id=PIOD6TXDJV7N5NJ675BKGCUKV2OETBYG4AIS4E3V4HW4OLT2ZCLQ, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.760107995 (211h37m15.191188126s) [noise=true , address=45.91.116.8:4048 , piece_id=TX4KYEHL5ZFCTL473UIEWCOAD3FPFGCDM57FNUE3ELRGFS6G6CUA, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.765555960 (211h37m15.196636091s) [noise=true , address=45.91.116.11:4117 , piece_id=HBXWNFXFFZ3K6S2E62OIP3Q7SBLSCSLFGIY2RCEVETQ5CZPUPABA, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.765756122 (211h37m15.196836253s) [noise=true , address=77.90.31.21:4877 , piece_id=OD4VJJRKALYZEPFIP75PC3XD6CLDKPY67ARDVDCVUI5B42IIUDFA, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.766052199 (211h37m15.19713233s) [noise=true , address=104.36.82.14:4223 , piece_id=6OOAB5LWWZFB3JMA2ZPTXPPU35MFR3RCG3XML36BCHAVO3XUBS3A, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.768157617 (211h37m15.199237748s) [noise=true , address=45.91.116.12:4227 , piece_id=RFOTTKB4NYEIYUOWYQB2KG7DFRIPEJJ7DZUBBAWG3ZPENTDW7KTA, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:20.769398091 (211h37m15.200478222s) [noise=true , address=104.36.82.7:4912 , piece_id=CCUEKJ34HARG62QQPLXQ5SQFFYITIRLLHPHQ3SVV764QZ2LQKSGQ, seg_pos={0 0}, upload=220104]: Uploading piece...
Aug 17 13:03:22.504372111 (211h37m16.935452262s) [upload=220104]: Next returned nil segment
Aug 17 13:03:22.504423339 (211h37m16.93550347s) [upload=220104]: Waiting for error group managing segments...
Aug 17 13:03:22.784508367 (211h37m17.215588498s) [noise=true , address=45.91.116.8:4048 , piece_id=TX4KYEHL5ZFCTL473UIEWCOAD3FPFGCDM57FNUE3ELRGFS6G6CUA, seg_pos={0 0}, upload=220104]: Done uploading piece. err: <nil>
Aug 17 13:03:22.787487308 (211h37m17.218567439s) [noise=true , address=45.91.116.5:4298 , piece_id=TK7ZXWLEPVBCJG5SLMPROOADNTB6JQ5OMXI43YWJ2KIL47C7FITQ, seg_pos={0 0}, upload=220104]: Done uploading piece. err: <nil>
Aug 17 13:03:22.789157644 (211h37m17.220237775s) [noise=true , address=45.91.116.13:4154 , piece_id=DHZC5HYZTR6A6DO42TYR65J6LHGQAUDLF4ITZXYMSS652TXZYCXA, seg_pos={0 0}, upload=220104]: Done uploading piece. err: <nil>
Aug 17 13:03:22.791733743 (211h37m17.222813874s) [noise=true , address=45.91.116.11:4117 , piece_id=HBXWNFXFFZ3K6S2E62OIP3Q7SBLSCSLFGIY2RCEVETQ5CZPUPABA, seg_pos={0 0}, upload=220104]: Done uploading piece. err: <nil>
Aug 17 13:03:22.800103026 (211h37m17.231183157s) [noise=true , address=45.91.116.12:4227 , piece_id=RFOTTKB4NYEIYUOWYQB2KG7DFRIPEJJ7DZUBBAWG3ZPENTDW7KTA, seg_pos={0 0}, upload=220104]: Done uploading piece. err: <nil>
Aug 17 13:03:22.831037325 (211h37m17.262117456s) [noise=true , address=45.91.116.14:4190 , piece_id=WWSUX4J6VZG6TOY5X3AT5HCRDCXAC2AWXGTBLE4E2FORCGFUYY6Q, seg_pos={0 0}, upload=220104]: Done uploading piece. err: <nil>
Aug 17 13:03:22.886314281 (211h37m17.317394412s) [noise=true , address=77.90.31.11:4553 , piece_id=E2UY3MOVRE5SIP4WXX5YDGOJVGRM3XYBHLU5JZRYDNSXESO2LCNA, seg_pos={0 0}, upload=220104]: Done uploading piece. err: <nil>
Aug 17 13:03:22.909221471 (211h37m17.340301602s) [noise=true , address=77.90.31.21:4877 , piece_id=OD4VJJRKALYZEPFIP75PC3XD6CLDKPY67ARDVDCVUI5B42IIUDFA, seg_pos={0 0}, upload=220104]: Done uploading piece. err: <nil>
Aug 17 13:03:23.009185229 (211h37m17.44026536s) [noise=true , address=77.90.31.14:4662 , piece_id=WHU2KWNBGSQ342A77GGSI5VJXXME7IUMMGTJF5S2QS44GJXEOPFA, seg_pos={0 0}, upload=220104]: Done uploading piece. err: <nil>
Aug 17 13:03:49.829474594 (211h37m44.260554725s) [noise=true , address=104.36.82.11:4114 , piece_id=PIOD6TXDJV7N5NJ675BKGCUKV2OETBYG4AIS4E3V4HW4OLT2ZCLQ, seg_pos={0 0}, upload=220104]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: write tcp 188.166.225.170:48458->104.36.82.11:4114: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:49.829523719 (211h37m44.26060385s) [noise=true , address=104.36.82.4:4801 , piece_id=T7GBUNRGIJKKUOYJAXPNQCY7D37H2IXGYCE4QF5JW6HU3MU66TIQ, seg_pos={0 0}, upload=220104]: Done uploading piece. err: ecclient: upload failed (node:12mj4gkN1YNsnfjc9svNEhUo8EAgEmHe7yj4kScHCasB9RwVNwZ, address:104.36.82.4:4801): protocol: rpc: dial tcp 104.36.82.4:4801: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:49.829558765 (211h37m44.260638886s) [noise=true , address=104.36.82.2:4729 , piece_id=SXC5TTHOKNQEPFHOFUMQYELKYHVQ2KPWFZUSWI35342B5NYWFX3A, seg_pos={0 0}, upload=220104]: Done uploading piece. err: ecclient: upload failed (node:1BKzosFpHWqYNaAck7XPxK263dJ4bPZ6hVSYye65CJa1uHRmoR, address:104.36.82.2:4729): protocol: write tcp 188.166.225.170:55096->104.36.82.2:4729: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:49.829689305 (211h37m44.260769426s) [noise=true , address=104.36.82.16:4295 , piece_id=YYLRHZKBL3TCFD33XKU3JHL5562ZQCEWMK4DIVOB7WSW3GAZ7ZPA, seg_pos={0 0}, upload=220104]: Done uploading piece. err: ecclient: upload failed (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT, address:104.36.82.16:4295): protocol: rpc: dial tcp 104.36.82.16:4295: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:49.829739692 (211h37m44.260819823s) [noise=true , address=104.36.82.14:4223 , piece_id=6OOAB5LWWZFB3JMA2ZPTXPPU35MFR3RCG3XML36BCHAVO3XUBS3A, seg_pos={0 0}, upload=220104]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: write tcp 188.166.225.170:56880->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:49.829759240 (211h37m44.260839371s) [noise=true , address=104.36.82.8:4969 , piece_id=RA7LMGM3GEWZSLWWEP7UOIT22DON74B3NGUDQKRPW5AZAZKO4GNQ, seg_pos={0 0}, upload=220104]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:104.36.82.8:4969): protocol: rpc: dial tcp 104.36.82.8:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:49.829777414 (211h37m44.260857545s) [noise=true , address=104.36.82.7:4912 , piece_id=CCUEKJ34HARG62QQPLXQ5SQFFYITIRLLHPHQ3SVV764QZ2LQKSGQ, seg_pos={0 0}, upload=220104]: Done uploading piece. err: ecclient: upload failed (node:1gwuDRBC5oJXgZbP6FqP9tc8UB6aJt2uexUgSuzHCovw27v1NR, address:104.36.82.7:4912): protocol: write tcp 188.166.225.170:40732->104.36.82.7:4912: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:49.829818563 (211h37m44.260898694s) [seg_pos={0 0}, upload=220104]: Done waiting for segment. successful: 9 optimal: 13 errs: <nil>
Aug 17 13:03:50.074679714 (211h37m44.505759845s) [upload=220104]: Done uploading segments...
Aug 17 13:03:50.074709761 (211h37m44.505789932s) [upload=220104]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 9)
Duration: 30.247782113s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.......X........] duration:
1.965477333s
FAIL (2025-08-17 13:03:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:59:19.842006213 (211h33m14.273086344s) [upload=220038]: Starting upload Aug 17 12:59:19.842081377 (211h33m14.273161508s) [upload=220038]: Done starting upload Aug 17 12:59:19.842133507 (211h33m14.273213638s) [upload=220038]: Uploading segments... Aug 17 12:59:19.842168784 (211h33m14.273248905s) [upload=220038]: Got next segment. Inline: true Aug 17 12:59:19.842172060 (211h33m14.273252191s) [upload=220038]: Waiting for error group managing segments... Aug 17 12:59:19.842203652 (211h33m14.273283783s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:59:19.842208200 (211h33m14.273288331s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:59:19.842211075 (211h33m14.273291197s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:59:20.058635828 (211h33m14.489715959s) [upload=220038]: Done uploading segments... Aug 17 12:59:20.058654253 (211h33m14.489734384s) [upload=220038]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.965531627s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
6.685232579s
FAIL (2025-08-17 13:03:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.685248028s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.......X.......] duration:
2.099630958s
FAIL (2025-08-17 13:03:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:59:19.842006213 (211h33m14.273086344s) [upload=220038]: Starting upload Aug 17 12:59:19.842081377 (211h33m14.273161508s) [upload=220038]: Done starting upload Aug 17 12:59:19.842133507 (211h33m14.273213638s) [upload=220038]: Uploading segments... Aug 17 12:59:19.842168784 (211h33m14.273248905s) [upload=220038]: Got next segment. Inline: true Aug 17 12:59:19.842172060 (211h33m14.273252191s) [upload=220038]: Waiting for error group managing segments... Aug 17 12:59:19.842203652 (211h33m14.273283783s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:59:19.842208200 (211h33m14.273288331s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:59:19.842211075 (211h33m14.273291197s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:59:20.058635828 (211h33m14.489715959s) [upload=220038]: Done uploading segments... Aug 17 12:59:20.058654253 (211h33m14.489734384s) [upload=220038]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.099656546s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................................XX] duration:
30.236642234s
FAIL (2025-08-17 13:03:19 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Aug 17 13:02:49.985790244 (211h36m44.416870375s) [upload=220093]: Starting upload
Aug 17 13:02:49.985904582 (211h36m44.416984733s) [upload=220093]: Done starting upload
Aug 17 13:02:49.985999453 (211h36m44.417079585s) [upload=220093]: Uploading segments...
Aug 17 13:02:49.986153318 (211h36m44.417233449s) [upload=220093]: Got next segment. Inline: false
Aug 17 13:02:49.986185219 (211h36m44.41726534s) [upload=220093]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 13:02:49.986191250 (211h36m44.417271382s) [upload=220093]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 13:02:50.257097627 (211h36m44.688177758s) [seg_pos={0 0}, upload=220093]: Begin upload segment...
Aug 17 13:02:50.257144627 (211h36m44.688224768s) [seg_pos={0 0}, upload=220093]: Done begin upload segment.
Aug 17 13:02:50.257167600 (211h36m44.688247731s) [noise=true , address=45.91.116.6:4974 , piece_id=QFHQ4XPQM2N6BFXEVCJNV33NXBMGD5M4L6S6PCF77QK4RIDI67OQ, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.257206475 (211h36m44.688286606s) [noise=true , address=104.36.82.13:4187 , piece_id=GFGRDNJEWSIMIG5NUGGQOTBEA7U7CGBCV6PNJYBNVJ26GSOPZOVA, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.257666305 (211h36m44.688746447s) [noise=true , address=104.36.82.16:4293 , piece_id=TIESTJELMCMZOEFAEYYFNKR3THRVQVITDFAS7ZOIZSPKLCJZ2CZA, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.257693287 (211h36m44.688773408s) [noise=true , address=77.90.31.15:4697 , piece_id=RLT6AYSY2MKKAGKOCNB4PPMOPKIUCELKNZR6PJOSJJVMMVJB2ZWA, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.258026515 (211h36m44.689106646s) [noise=true , address=104.36.82.15:4259 , piece_id=5RSDGAFMZHXBRAKKEVNAKWL64QSWS7FFL4RFUXETA55RUB3YQ2IQ, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.258066290 (211h36m44.689146421s) [noise=true , address=45.91.116.6:4975 , piece_id=Q6YDE6GXA6U4VIU5FCB2DGTDQJAGQS2J7YDYL6U7ANV6M6QMNRHA, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.258420288 (211h36m44.689500419s) [noise=true , address=104.36.82.7:4911 , piece_id=HI54QHIMSE5GN3O4PNPPUESP77O3U7EO3SLPGH34VM7XUJQ5N3GA, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.258752102 (211h36m44.689832233s) [noise=true , address=77.90.31.19:4841 , piece_id=T22IALUBWSVYWDZPOJ4MR6Q7SDU2WZWW7ZQGSDFISQDU6NS6EVPQ, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.259024924 (211h36m44.690105046s) [noise=true , address=104.36.82.13:4186 , piece_id=DJQA2VOVDM3T6HW46P36SIK3GHWLI37HRCQK6H6BSXNOBMROTQRA, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.259288920 (211h36m44.690369051s) [noise=true , address=77.90.31.13:4628 , piece_id=IQZSIAVHZWXSFBRNJN63JVASGY5CCPN3AQPHKW5YFTN2MLJ2DJFA, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.259540661 (211h36m44.690620793s) [noise=true , address=45.91.116.4:4938 , piece_id=W4N5HZRR5H7D3UZFDO32SLSNWMJDHAPCAWCJLN7FE36LRPH5WMDQ, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.259662204 (211h36m44.690742335s) [noise=true , address=45.91.116.8:4045 , piece_id=MQWQ7FGE6ASVCKU4I5FSQEVE6CJ4JYOPYYCYPADXWZQC46ZDGUAQ, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.259988398 (211h36m44.691068539s) [noise=true , address=77.90.31.12:4590 , piece_id=C3VMXAZ7QRIIVM3V2VMAAKT6EWJI2SZMQPIFDJSSVDAS2TDAUZ4Q, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.260059384 (211h36m44.691139515s) [noise=true , address=77.90.31.10:4519 , piece_id=JX625OUWZVYKTEFL3XMDX5WY2Z6KN7PRHTH55KVRWHF52BK73XMA, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.260285096 (211h36m44.691365227s) [noise=true , address=77.90.31.19:4843 , piece_id=HSGJJMSZKOWIMMLRMXZQ66QTICPLBAXXGMA6PIYLT4WESHIAJOYA, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:50.260596051 (211h36m44.691676192s) [noise=true , address=45.91.116.12:4225 , piece_id=37BQES3EKGG3OQWW6KC3HTGR25OFAEAY4WJQ3NNVQNZRSNUAB7OQ, seg_pos={0 0}, upload=220093]: Uploading piece...
Aug 17 13:02:51.992361043 (211h36m46.423441174s) [upload=220093]: Next returned nil segment
Aug 17 13:02:51.992378156 (211h36m46.423458287s) [upload=220093]: Waiting for error group managing segments...
Aug 17 13:02:52.274301512 (211h36m46.705381643s) [noise=true , address=77.90.31.12:4590 , piece_id=C3VMXAZ7QRIIVM3V2VMAAKT6EWJI2SZMQPIFDJSSVDAS2TDAUZ4Q, seg_pos={0 0}, upload=220093]: Done uploading piece. err: <nil>
Aug 17 13:02:52.281760985 (211h36m46.712841116s) [noise=true , address=45.91.116.4:4938 , piece_id=W4N5HZRR5H7D3UZFDO32SLSNWMJDHAPCAWCJLN7FE36LRPH5WMDQ, seg_pos={0 0}, upload=220093]: Done uploading piece. err: <nil>
Aug 17 13:02:52.293667647 (211h36m46.724747788s) [noise=true , address=45.91.116.8:4045 , piece_id=MQWQ7FGE6ASVCKU4I5FSQEVE6CJ4JYOPYYCYPADXWZQC46ZDGUAQ, seg_pos={0 0}, upload=220093]: Done uploading piece. err: <nil>
Aug 17 13:02:52.301602780 (211h36m46.732682911s) [noise=true , address=45.91.116.6:4975 , piece_id=Q6YDE6GXA6U4VIU5FCB2DGTDQJAGQS2J7YDYL6U7ANV6M6QMNRHA, seg_pos={0 0}, upload=220093]: Done uploading piece. err: <nil>
Aug 17 13:02:52.321656039 (211h36m46.75273616s) [noise=true , address=77.90.31.15:4697 , piece_id=RLT6AYSY2MKKAGKOCNB4PPMOPKIUCELKNZR6PJOSJJVMMVJB2ZWA, seg_pos={0 0}, upload=220093]: Done uploading piece. err: <nil>
Aug 17 13:02:52.356129230 (211h36m46.787209361s) [noise=true , address=45.91.116.6:4974 , piece_id=QFHQ4XPQM2N6BFXEVCJNV33NXBMGD5M4L6S6PCF77QK4RIDI67OQ, seg_pos={0 0}, upload=220093]: Done uploading piece. err: <nil>
Aug 17 13:02:52.386652492 (211h36m46.817732623s) [noise=true , address=45.91.116.12:4225 , piece_id=37BQES3EKGG3OQWW6KC3HTGR25OFAEAY4WJQ3NNVQNZRSNUAB7OQ, seg_pos={0 0}, upload=220093]: Done uploading piece. err: <nil>
Aug 17 13:02:52.389514117 (211h36m46.820594238s) [noise=true , address=77.90.31.13:4628 , piece_id=IQZSIAVHZWXSFBRNJN63JVASGY5CCPN3AQPHKW5YFTN2MLJ2DJFA, seg_pos={0 0}, upload=220093]: Done uploading piece. err: <nil>
Aug 17 13:02:52.412336816 (211h36m46.843416947s) [noise=true , address=77.90.31.19:4841 , piece_id=T22IALUBWSVYWDZPOJ4MR6Q7SDU2WZWW7ZQGSDFISQDU6NS6EVPQ, seg_pos={0 0}, upload=220093]: Done uploading piece. err: <nil>
Aug 17 13:02:52.451202301 (211h36m46.882282432s) [noise=true , address=77.90.31.19:4843 , piece_id=HSGJJMSZKOWIMMLRMXZQ66QTICPLBAXXGMA6PIYLT4WESHIAJOYA, seg_pos={0 0}, upload=220093]: Done uploading piece. err: <nil>
Aug 17 13:02:52.463434214 (211h36m46.894514345s) [noise=true , address=77.90.31.10:4519 , piece_id=JX625OUWZVYKTEFL3XMDX5WY2Z6KN7PRHTH55KVRWHF52BK73XMA, seg_pos={0 0}, upload=220093]: Done uploading piece. err: <nil>
Aug 17 13:03:19.308498217 (211h37m13.739578349s) [noise=true , address=104.36.82.13:4186 , piece_id=DJQA2VOVDM3T6HW46P36SIK3GHWLI37HRCQK6H6BSXNOBMROTQRA, seg_pos={0 0}, upload=220093]: Done uploading piece. err: ecclient: upload failed (node:16iUE9RyvrbkRAv7DZVHPsf9fk5ukduiYriLkcS43YNgxu66ht, address:104.36.82.13:4186): protocol: rpc: dial tcp 104.36.82.13:4186: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:19.308610462 (211h37m13.739690593s) [noise=true , address=104.36.82.13:4187 , piece_id=GFGRDNJEWSIMIG5NUGGQOTBEA7U7CGBCV6PNJYBNVJ26GSOPZOVA, seg_pos={0 0}, upload=220093]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:104.36.82.13:4187): protocol: rpc: dial tcp 104.36.82.13:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:19.308628297 (211h37m13.739708428s) [noise=true , address=104.36.82.16:4293 , piece_id=TIESTJELMCMZOEFAEYYFNKR3THRVQVITDFAS7ZOIZSPKLCJZ2CZA, seg_pos={0 0}, upload=220093]: Done uploading piece. err: ecclient: upload failed (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE, address:104.36.82.16:4293): protocol: write tcp 188.166.225.170:45084->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:19.308644627 (211h37m13.739724768s) [noise=true , address=104.36.82.15:4259 , piece_id=5RSDGAFMZHXBRAKKEVNAKWL64QSWS7FFL4RFUXETA55RUB3YQ2IQ, seg_pos={0 0}, upload=220093]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:19.308668603 (211h37m13.739748734s) [noise=true , address=104.36.82.7:4911 , piece_id=HI54QHIMSE5GN3O4PNPPUESP77O3U7EO3SLPGH34VM7XUJQ5N3GA, seg_pos={0 0}, upload=220093]: Done uploading piece. err: ecclient: upload failed (node:13rWy7bK7AMZnejVCPwyMs7QrbNcSjWpuVEL8dKX2awG4oJUqu, address:104.36.82.7:4911): protocol: write tcp 188.166.225.170:37540->104.36.82.7:4911: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:19.308682691 (211h37m13.739762822s) [seg_pos={0 0}, upload=220093]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Aug 17 13:03:19.543232361 (211h37m13.974312502s) [upload=220093]: Done uploading segments...
Aug 17 13:03:19.543278089 (211h37m13.97435821s) [upload=220093]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 30.236694975s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X..............................X......X..X......X] duration:
1m0.255476333s
FAIL (2025-08-17 13:03:13 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
Aug 17 13:02:14.184711676 (211h36m8.615791797s) [upload=220084]: Starting upload
Aug 17 13:02:14.184761652 (211h36m8.615841783s) [upload=220084]: Done starting upload
Aug 17 13:02:14.184861624 (211h36m8.615941755s) [upload=220084]: Uploading segments...
Aug 17 13:02:14.184976934 (211h36m8.616057065s) [upload=220084]: Got next segment. Inline: false
Aug 17 13:02:14.185010809 (211h36m8.61609094s) [upload=220084]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 13:02:14.185015207 (211h36m8.616095338s) [upload=220084]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 13:02:14.645792549 (211h36m9.07687267s) [seg_pos={0 0}, upload=220084]: Begin upload segment...
Aug 17 13:02:14.645861711 (211h36m9.076941842s) [seg_pos={0 0}, upload=220084]: Done begin upload segment.
Aug 17 13:02:14.645888122 (211h36m9.076968253s) [noise=true , address=77.90.31.15:4721 , piece_id=LVH3UNX5I6ZYKOUSOZBTZKTLVHR5YJUYOUSB2QL5IDOYQRLU2TQA, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.645925984 (211h36m9.077006115s) [noise=true , address=104.36.82.60:4367 , piece_id=SHWTKZRA72PKB366BWNCCVTZTQAEQ7NTX44IHLRCPWLNU7WBZ27A, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.646315840 (211h36m9.077395971s) [noise=true , address=104.36.82.5:4853 , piece_id=ZLURXO7I7W7E3367J7G5EGDU7DNDY6HBKAQZXIPNKXVDYBRCXTYA, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.646381776 (211h36m9.077461908s) [noise=true , address=45.91.116.11:4146 , piece_id=6OT3ZDDLWJKFMM7EMBCOLYB2OU6F6ZAI7CBPYGYMDGQFRO23XQWQ, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.646597569 (211h36m9.077677701s) [noise=true , address=104.36.82.34:4556 , piece_id=DERXCXMZRH7SD6RKAU7IRTI2GAEVHZGGCQC6J2RGJ7FKKP6RKMXQ, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.646665699 (211h36m9.07774583s) [noise=true , address=104.36.82.59:4328 , piece_id=KFA7OKUTBNGXTUFYMFTRXSHVEO3JFIJBSKHHHFJICLSNUYUH74BA, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.646911329 (211h36m9.077991511s) [noise=true , address=104.36.82.23:4470 , piece_id=BILP2RKEOOFOQ4D67VFEKXDUSOVS653WSD4IYOJQJCVZANZDLPIA, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.646945384 (211h36m9.078025515s) [noise=true , address=77.90.31.11:4577 , piece_id=YCICAHCKUT6VKPIM7D3J3ST7G36CQE2TBLVNTZK7KCV3MGRQI3FQ, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.646988688 (211h36m9.078068809s) [noise=true , address=104.36.82.40:4958 , piece_id=QS6WWXP3EVCX4DYYGR2IHQDSC22EOMEHQNZPCZQ7NRNQIRE3IGIQ, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.647216032 (211h36m9.078296163s) [noise=true , address=45.91.116.6:4993 , piece_id=ULLVR3S57AYSTGZCMZJWJPEY5F4J5M5HO7LMNXFPR3KIOF3PXETQ, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.647275616 (211h36m9.078355747s) [noise=true , address=79.127.201.215:4354 , piece_id=D5NDGLI32KI5YCWGJXYW6VSGQ5LEUQOBDUXO4JPWVCNMJO6QOVIQ, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.647517840 (211h36m9.078597961s) [noise=true , address=77.90.31.10:4535 , piece_id=YPDDU3S7SZ2TXB6RU7JLTNMZMLKBLNUVA7OZXYK5AVVWBPQNWJ7Q, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.647531667 (211h36m9.078611798s) [noise=true , address=104.36.82.58:4279 , piece_id=VDNOSW3J63NEPK4UL4WXZYHU4O3BUTPFRG5BD75AX45MIJSOMIOQ, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.647753241 (211h36m9.078833372s) [noise=true , address=104.36.82.19:4414 , piece_id=JKJH7L3ZMFNLI72JILOWSNSE2ONX6D4GSUM5TWTYDAQNLTJ6DIQA, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.647769782 (211h36m9.078849913s) [noise=true , address=104.36.82.35:4601 , piece_id=3FJC4KDEB2EKVWK6BTGPR74FZGIHKNS5OG52IIROO2VQPX2DZYMA, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.647988831 (211h36m9.079068962s) [noise=true , address=104.36.82.14:4225 , piece_id=XYIJ47UUGMNTL2XF73IPJHSVA5JJX4H5OKVZ5BIU7GM3OQVY3WTQ, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.648212620 (211h36m9.079292751s) [noise=true , address=66.23.193.175:4560 , piece_id=GMRQ7TCLYON6QPNTZFHTEZKD2XW453ABNRA6IH4GOB5QSKW4KC2A, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:14.648457447 (211h36m9.079537578s) [noise=true , address=156.146.43.225:4456 , piece_id=SGJUMXPHU4ESGZVPFOV7F7UH7OAYTKNE347K5MRGQHDLQWSXOVRA, seg_pos={0 0}, upload=220084]: Uploading piece...
Aug 17 13:02:15.848605657 (211h36m10.279685788s) [upload=220084]: Next returned nil segment
Aug 17 13:02:15.848620646 (211h36m10.279700777s) [upload=220084]: Waiting for error group managing segments...
Aug 17 13:02:16.135604644 (211h36m10.566684775s) [noise=true , address=66.23.193.175:4560 , piece_id=GMRQ7TCLYON6QPNTZFHTEZKD2XW453ABNRA6IH4GOB5QSKW4KC2A, seg_pos={0 0}, upload=220084]: Done uploading piece. err: <nil>
Aug 17 13:02:16.558296455 (211h36m10.989376586s) [noise=true , address=45.91.116.11:4146 , piece_id=6OT3ZDDLWJKFMM7EMBCOLYB2OU6F6ZAI7CBPYGYMDGQFRO23XQWQ, seg_pos={0 0}, upload=220084]: Done uploading piece. err: <nil>
Aug 17 13:02:16.619071901 (211h36m11.050152032s) [noise=true , address=156.146.43.225:4456 , piece_id=SGJUMXPHU4ESGZVPFOV7F7UH7OAYTKNE347K5MRGQHDLQWSXOVRA, seg_pos={0 0}, upload=220084]: Done uploading piece. err: <nil>
Aug 17 13:02:16.644237993 (211h36m11.075318124s) [noise=true , address=79.127.201.215:4354 , piece_id=D5NDGLI32KI5YCWGJXYW6VSGQ5LEUQOBDUXO4JPWVCNMJO6QOVIQ, seg_pos={0 0}, upload=220084]: Done uploading piece. err: <nil>
Aug 17 13:02:16.652829963 (211h36m11.083910084s) [noise=true , address=77.90.31.11:4577 , piece_id=YCICAHCKUT6VKPIM7D3J3ST7G36CQE2TBLVNTZK7KCV3MGRQI3FQ, seg_pos={0 0}, upload=220084]: Done uploading piece. err: <nil>
Aug 17 13:02:16.698372393 (211h36m11.129452514s) [noise=true , address=77.90.31.15:4721 , piece_id=LVH3UNX5I6ZYKOUSOZBTZKTLVHR5YJUYOUSB2QL5IDOYQRLU2TQA, seg_pos={0 0}, upload=220084]: Done uploading piece. err: <nil>
Aug 17 13:02:16.730333977 (211h36m11.161414098s) [noise=true , address=45.91.116.6:4993 , piece_id=ULLVR3S57AYSTGZCMZJWJPEY5F4J5M5HO7LMNXFPR3KIOF3PXETQ, seg_pos={0 0}, upload=220084]: Done uploading piece. err: <nil>
Aug 17 13:02:17.074204532 (211h36m11.505284663s) [noise=true , address=77.90.31.10:4535 , piece_id=YPDDU3S7SZ2TXB6RU7JLTNMZMLKBLNUVA7OZXYK5AVVWBPQNWJ7Q, seg_pos={0 0}, upload=220084]: Done uploading piece. err: <nil>
Aug 17 13:03:13.512986684 (211h37m7.944066815s) [noise=true , address=104.36.82.58:4279 , piece_id=VDNOSW3J63NEPK4UL4WXZYHU4O3BUTPFRG5BD75AX45MIJSOMIOQ, seg_pos={0 0}, upload=220084]: Done uploading piece. err: ecclient: upload failed (node:12LtRviHk2GinJGa3L53MCHCAfKrqUsey5JhQRHbYQTuSUNKoNC, address:104.36.82.58:4279): protocol: rpc: dial tcp 104.36.82.58:4279: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:13.513038544 (211h37m7.944118675s) [noise=true , address=104.36.82.35:4601 , piece_id=3FJC4KDEB2EKVWK6BTGPR74FZGIHKNS5OG52IIROO2VQPX2DZYMA, seg_pos={0 0}, upload=220084]: Done uploading piece. err: ecclient: upload failed (node:16ggANPGWDLtyxp9hMkCsNYueB2KuVWsKVrG8mFa6pPBXW5RiW, address:104.36.82.35:4601): protocol: rpc: dial tcp 104.36.82.35:4601: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:13.513068090 (211h37m7.944148221s) [noise=true , address=104.36.82.23:4470 , piece_id=BILP2RKEOOFOQ4D67VFEKXDUSOVS653WSD4IYOJQJCVZANZDLPIA, seg_pos={0 0}, upload=220084]: Done uploading piece. err: ecclient: upload failed (node:1FT9cn7mxuyJ7xBeCJgyTcJKFRmHEqboqeGWLvygNceEo4LQVF, address:104.36.82.23:4470): protocol: write tcp 188.166.225.170:51950->104.36.82.23:4470: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:13.513103658 (211h37m7.944183789s) [noise=true , address=104.36.82.5:4853 , piece_id=ZLURXO7I7W7E3367J7G5EGDU7DNDY6HBKAQZXIPNKXVDYBRCXTYA, seg_pos={0 0}, upload=220084]: Done uploading piece. err: ecclient: upload failed (node:1ycsU8APac3LBkfY1xCsc8b9KJQVAx5kFJnYebWhKSKSbKyf5u, address:104.36.82.5:4853): protocol: rpc: dial tcp 104.36.82.5:4853: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:13.513130269 (211h37m7.9442104s) [noise=true , address=104.36.82.40:4958 , piece_id=QS6WWXP3EVCX4DYYGR2IHQDSC22EOMEHQNZPCZQ7NRNQIRE3IGIQ, seg_pos={0 0}, upload=220084]: Done uploading piece. err: ecclient: upload failed (node:1ySYdoPKsX8RRcnfGuneBqVjXLbuDQJ7ofRiv6dEyYxR32hoGR, address:104.36.82.40:4958): protocol: rpc: dial tcp 104.36.82.40:4958: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:13.513146170 (211h37m7.944226301s) [noise=true , address=104.36.82.34:4556 , piece_id=DERXCXMZRH7SD6RKAU7IRTI2GAEVHZGGCQC6J2RGJ7FKKP6RKMXQ, seg_pos={0 0}, upload=220084]: Done uploading piece. err: ecclient: upload failed (node:1i62GRFASf7UPVGhUofmRkz3zZSyhq4fDycgyYtfD7pHR3w91v, address:104.36.82.34:4556): protocol: rpc: dial tcp 104.36.82.34:4556: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:13.513156820 (211h37m7.944236951s) [noise=true , address=104.36.82.14:4225 , piece_id=XYIJ47UUGMNTL2XF73IPJHSVA5JJX4H5OKVZ5BIU7GM3OQVY3WTQ, seg_pos={0 0}, upload=220084]: Done uploading piece. err: ecclient: upload failed (node:12QtY3yN6J1H8htRneePHu4RmbN7A1xkgywphMDVsVxhTczGupY, address:104.36.82.14:4225): protocol: rpc: dial tcp 104.36.82.14:4225: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:13.513177920 (211h37m7.944258041s) [noise=true , address=104.36.82.19:4414 , piece_id=JKJH7L3ZMFNLI72JILOWSNSE2ONX6D4GSUM5TWTYDAQNLTJ6DIQA, seg_pos={0 0}, upload=220084]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: rpc: dial tcp 104.36.82.19:4414: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:13.513187889 (211h37m7.94426801s) [noise=true , address=104.36.82.60:4367 , piece_id=SHWTKZRA72PKB366BWNCCVTZTQAEQ7NTX44IHLRCPWLNU7WBZ27A, seg_pos={0 0}, upload=220084]: Done uploading piece. err: ecclient: upload failed (node:12C4Xom8WT5TZRiX3ZFyRT9tSoAUUFyPNS1VVzN7gT3oDVGDGhK, address:104.36.82.60:4367): protocol: rpc: dial tcp 104.36.82.60:4367: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:13.513195583 (211h37m7.944275714s) [noise=true , address=104.36.82.59:4328 , piece_id=KFA7OKUTBNGXTUFYMFTRXSHVEO3JFIJBSKHHHFJICLSNUYUH74BA, seg_pos={0 0}, upload=220084]: Done uploading piece. err: ecclient: upload failed (node:1JXYpLarXKLWgAMdNhxWfTWb9VYWGyaY4yLGtqXAWcCBAYJRZY, address:104.36.82.59:4328): protocol: rpc: dial tcp 104.36.82.59:4328: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:03:13.513208048 (211h37m7.944288169s) [seg_pos={0 0}, upload=220084]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Aug 17 13:03:13.767246177 (211h37m8.198326308s) [upload=220084]: Done uploading segments...
Aug 17 13:03:13.767270644 (211h37m8.198350775s) [upload=220084]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 1m0.255492603s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.......X......] duration:
1.909767168s
FAIL (2025-08-17 13:03:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:59:19.842006213 (211h33m14.273086344s) [upload=220038]: Starting upload Aug 17 12:59:19.842081377 (211h33m14.273161508s) [upload=220038]: Done starting upload Aug 17 12:59:19.842133507 (211h33m14.273213638s) [upload=220038]: Uploading segments... Aug 17 12:59:19.842168784 (211h33m14.273248905s) [upload=220038]: Got next segment. Inline: true Aug 17 12:59:19.842172060 (211h33m14.273252191s) [upload=220038]: Waiting for error group managing segments... Aug 17 12:59:19.842203652 (211h33m14.273283783s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:59:19.842208200 (211h33m14.273288331s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:59:19.842211075 (211h33m14.273291197s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:59:20.058635828 (211h33m14.489715959s) [upload=220038]: Done uploading segments... Aug 17 12:59:20.058654253 (211h33m14.489734384s) [upload=220038]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.909792226s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.232868606s
FAIL (2025-08-17 13:02:58 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 9)
======LOGS======
:4101 , piece_id=A5NDPVI3B6K7KZOYZW4TTO5BKDAN75TRHJCX5LTD55DKUFZKDHZQ, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.585230919 (211h35m54.01631105s) [noise=true , address=104.36.82.59:4315 , piece_id=F6HAU4KPG54A5IPEXFCC2MEZETJLSRIO3X7ML6H2TABDAOQYK7LA, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.585502509 (211h35m54.01658264s) [noise=true , address=104.36.82.19:4425 , piece_id=TOSTND5QZADIJGHPYRXOTNQCYVA4QHY7Z7BYLZK6UUR3GPNICF7Q, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.585727900 (211h35m54.016808031s) [noise=true , address=45.91.116.8:4046 , piece_id=NVXZA5YRUQQY64GIREQSGHXDLBEWSAPLRPJVOX3QQVWL4Y4FAQOQ, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.585838050 (211h35m54.016918182s) [noise=true , address=45.91.116.13:4179 , piece_id=ZLE73A7NPUCWMFCS2NAX45UXM5O65BKQMXMOCWADVSQXTYGQIWXA, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.586076727 (211h35m54.017156859s) [noise=true , address=79.127.201.214:4309 , piece_id=T4NB24BE74K7E4CJP624VC44P55W62QME7GNN27YLFXGCXM4GBIQ, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.586377553 (211h35m54.017457684s) [noise=true , address=104.36.82.60:4368 , piece_id=VQQXXVPBPBNYHWWT7WTZ77P6NTX4LSLFFCFMRWPYLDO5ZXIE73DA, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.586706563 (211h35m54.017786694s) [noise=true , address=104.36.82.40:4956 , piece_id=J3PFDTPOLJIREP6FSPFJKPZSQXQHVLSCVYJ5KH4G4IJ4VF6PCZRA, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.586976299 (211h35m54.01805642s) [noise=true , address=77.90.31.15:4721 , piece_id=PYJAHMAI7JJA57BSGC4JM5NSG3KSYLTIMGLXBJWF6LLGTVYYGSPQ, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.587282965 (211h35m54.018363097s) [noise=true , address=104.36.82.12:4169 , piece_id=KY2JCH3MSYJIN2S4KNINVEQILIBNQKXE6ZLGI5UNW3MJBASDJJPQ, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.587698500 (211h35m54.018778631s) [noise=true , address=79.127.201.215:4358 , piece_id=2PEE73DUON6GVL3KLFWPW3FB6UXHLERSFWQYDAZF6ULCZ7HQVSAA, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.587929743 (211h35m54.019009874s) [noise=true , address=104.36.82.35:4595 , piece_id=MPEPU476YMKTVNLZDV2CLHRGG2QZRFDZMUOURK6BUJGOV3LNHNFQ, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.588193958 (211h35m54.019274099s) [noise=true , address=79.127.219.51:4216 , piece_id=P3CZ6HMO7G2V5WSR4N5E4LODNZW5AY4R7NQKWEAPLMDDWCR6R67Q, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.588297817 (211h35m54.019377948s) [noise=true , address=77.90.31.16:4741 , piece_id=2JZGHB6HW5GXJLI6D7ZTKJU5DBZVAIZPHWBWKYLBGZTBZI2AHQIQ, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.588681932 (211h35m54.019762063s) [noise=true , address=104.36.82.5:4846 , piece_id=GH6O26PBD5UWS5JPESPQFE62XHCRRLZ5HZIRQKLKJL6WKJXSFDFQ, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:01:59.588944986 (211h35m54.020025117s) [noise=true , address=77.90.31.19:4866 , piece_id=75OAQFPEU37DZQDGS33FMDWTQTXOHA4CEDWWHC5KPHCYMMXVB53A, seg_pos={0 0}, upload=220080]: Uploading piece...
Aug 17 13:02:01.068827952 (211h35m55.499908084s) [upload=220080]: Next returned nil segment
Aug 17 13:02:01.068855986 (211h35m55.499936117s) [upload=220080]: Waiting for error group managing segments...
Aug 17 13:02:01.447634333 (211h35m55.878714474s) [noise=true , address=79.127.219.48:4101 , piece_id=A5NDPVI3B6K7KZOYZW4TTO5BKDAN75TRHJCX5LTD55DKUFZKDHZQ, seg_pos={0 0}, upload=220080]: Done uploading piece. err: <nil>
Aug 17 13:02:01.506236802 (211h35m55.937316933s) [noise=true , address=45.91.116.13:4179 , piece_id=ZLE73A7NPUCWMFCS2NAX45UXM5O65BKQMXMOCWADVSQXTYGQIWXA, seg_pos={0 0}, upload=220080]: Done uploading piece. err: <nil>
Aug 17 13:02:01.537268096 (211h35m55.968348227s) [noise=true , address=79.127.201.214:4309 , piece_id=T4NB24BE74K7E4CJP624VC44P55W62QME7GNN27YLFXGCXM4GBIQ, seg_pos={0 0}, upload=220080]: Done uploading piece. err: <nil>
Aug 17 13:02:01.550136649 (211h35m55.98121678s) [noise=true , address=79.127.201.215:4358 , piece_id=2PEE73DUON6GVL3KLFWPW3FB6UXHLERSFWQYDAZF6ULCZ7HQVSAA, seg_pos={0 0}, upload=220080]: Done uploading piece. err: <nil>
Aug 17 13:02:01.565297006 (211h35m55.996377137s) [noise=true , address=77.90.31.19:4866 , piece_id=75OAQFPEU37DZQDGS33FMDWTQTXOHA4CEDWWHC5KPHCYMMXVB53A, seg_pos={0 0}, upload=220080]: Done uploading piece. err: <nil>
Aug 17 13:02:01.572288994 (211h35m56.003369125s) [noise=true , address=77.90.31.16:4741 , piece_id=2JZGHB6HW5GXJLI6D7ZTKJU5DBZVAIZPHWBWKYLBGZTBZI2AHQIQ, seg_pos={0 0}, upload=220080]: Done uploading piece. err: <nil>
Aug 17 13:02:01.670289877 (211h35m56.101370008s) [noise=true , address=79.127.219.51:4216 , piece_id=P3CZ6HMO7G2V5WSR4N5E4LODNZW5AY4R7NQKWEAPLMDDWCR6R67Q, seg_pos={0 0}, upload=220080]: Done uploading piece. err: <nil>
Aug 17 13:02:01.731211764 (211h35m56.162291895s) [noise=true , address=45.91.116.8:4046 , piece_id=NVXZA5YRUQQY64GIREQSGHXDLBEWSAPLRPJVOX3QQVWL4Y4FAQOQ, seg_pos={0 0}, upload=220080]: Done uploading piece. err: <nil>
Aug 17 13:02:01.848079204 (211h35m56.279159335s) [noise=true , address=77.90.31.15:4721 , piece_id=PYJAHMAI7JJA57BSGC4JM5NSG3KSYLTIMGLXBJWF6LLGTVYYGSPQ, seg_pos={0 0}, upload=220080]: Done uploading piece. err: <nil>
Aug 17 13:02:58.460888656 (211h36m52.891968777s) [noise=true , address=104.36.82.10:4105 , piece_id=KIIFCKPSVWDCQ4DMOCIXN3UGCXSC3ZQHM6YGZZJRO6UR3TTNGVJQ, seg_pos={0 0}, upload=220080]: Done uploading piece. err: ecclient: upload failed (node:12GhDrKMcDEg2RxamqKtiHphpgNdvtZYdHXrjzGsNJFjBFYeEen, address:104.36.82.10:4105): protocol: rpc: dial tcp 104.36.82.10:4105: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:58.460941257 (211h36m52.892021378s) [noise=true , address=104.36.82.59:4315 , piece_id=F6HAU4KPG54A5IPEXFCC2MEZETJLSRIO3X7ML6H2TABDAOQYK7LA, seg_pos={0 0}, upload=220080]: Done uploading piece. err: ecclient: upload failed (node:1o5mMqSq2uht75TtSp9i4NpnkpA3AbwmNG9ffyp5zZehUqcMuz, address:104.36.82.59:4315): protocol: write tcp 188.166.225.170:44268->104.36.82.59:4315: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:58.460960664 (211h36m52.892040785s) [noise=true , address=104.36.82.23:4446 , piece_id=LN7HGKGUCGMPFQJISAE2OHQEPMVSBRUVBFS3GNYCSRNOB4WWX4WA, seg_pos={0 0}, upload=220080]: Done uploading piece. err: ecclient: upload failed (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7, address:104.36.82.23:4446): protocol: rpc: dial tcp 104.36.82.23:4446: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:58.461004538 (211h36m52.892084669s) [noise=true , address=104.36.82.12:4169 , piece_id=KY2JCH3MSYJIN2S4KNINVEQILIBNQKXE6ZLGI5UNW3MJBASDJJPQ, seg_pos={0 0}, upload=220080]: Done uploading piece. err: ecclient: upload failed (node:12AcJsPCQkjCgLxMTVcjMC5BpEe9RqzcC4CNC3oJDUt4f8cTbNX, address:104.36.82.12:4169): protocol: rpc: dial tcp 104.36.82.12:4169: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:58.461047290 (211h36m52.892127421s) [noise=true , address=104.36.82.19:4425 , piece_id=TOSTND5QZADIJGHPYRXOTNQCYVA4QHY7Z7BYLZK6UUR3GPNICF7Q, seg_pos={0 0}, upload=220080]: Done uploading piece. err: ecclient: upload failed (node:13sAcGFjAXuesAkUn7NuLaaV8TAah3Mr1kqd33wwh9MTELqmpD, address:104.36.82.19:4425): protocol: rpc: dial tcp 104.36.82.19:4425: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:58.461078459 (211h36m52.89215859s) [noise=true , address=104.36.82.40:4956 , piece_id=J3PFDTPOLJIREP6FSPFJKPZSQXQHVLSCVYJ5KH4G4IJ4VF6PCZRA, seg_pos={0 0}, upload=220080]: Done uploading piece. err: ecclient: upload failed (node:1pf65Tg83xM523bgdJK2BxiC6uzJ1Hh528DY8CUDxGTnxZSd2W, address:104.36.82.40:4956): protocol: write tcp 188.166.225.170:38078->104.36.82.40:4956: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:58.461120651 (211h36m52.892200782s) [noise=true , address=104.36.82.60:4368 , piece_id=VQQXXVPBPBNYHWWT7WTZ77P6NTX4LSLFFCFMRWPYLDO5ZXIE73DA, seg_pos={0 0}, upload=220080]: Done uploading piece. err: ecclient: upload failed (node:12Q6suyRuFmW1rG5qq8faCFbCkfAPaNfYQaBv6qhL1DNavUffkB, address:104.36.82.60:4368): protocol: write tcp 188.166.225.170:39652->104.36.82.60:4368: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:58.461135739 (211h36m52.89221587s) [noise=true , address=104.36.82.35:4595 , piece_id=MPEPU476YMKTVNLZDV2CLHRGG2QZRFDZMUOURK6BUJGOV3LNHNFQ, seg_pos={0 0}, upload=220080]: Done uploading piece. err: ecclient: upload failed (node:12amZR7XxhSNjYTK414HmFCTkMz6DDhT8AjvS1Xcg5C9nzvEK8d, address:104.36.82.35:4595): protocol: write tcp 188.166.225.170:47138->104.36.82.35:4595: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:58.461165175 (211h36m52.892245296s) [noise=true , address=104.36.82.5:4846 , piece_id=GH6O26PBD5UWS5JPESPQFE62XHCRRLZ5HZIRQKLKJL6WKJXSFDFQ, seg_pos={0 0}, upload=220080]: Done uploading piece. err: ecclient: upload failed (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR, address:104.36.82.5:4846): protocol: write tcp 188.166.225.170:57690->104.36.82.5:4846: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:58.461186416 (211h36m52.892266547s) [seg_pos={0 0}, upload=220080]: Done waiting for segment. successful: 9 optimal: 14 errs: <nil>
Aug 17 13:02:58.691807752 (211h36m53.122887883s) [upload=220080]: Done uploading segments...
Aug 17 13:02:58.691827379 (211h36m53.12290751s) [upload=220080]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 9)
Duration: 1m0.232892132s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
6.521834738s
FAIL (2025-08-17 13:02:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.521849457s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.001413419s
FAIL (2025-08-17 13:02:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1m0.00172221s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.......X.....] duration:
1.854691608s
FAIL (2025-08-17 13:02:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:59:19.842006213 (211h33m14.273086344s) [upload=220038]: Starting upload Aug 17 12:59:19.842081377 (211h33m14.273161508s) [upload=220038]: Done starting upload Aug 17 12:59:19.842133507 (211h33m14.273213638s) [upload=220038]: Uploading segments... Aug 17 12:59:19.842168784 (211h33m14.273248905s) [upload=220038]: Got next segment. Inline: true Aug 17 12:59:19.842172060 (211h33m14.273252191s) [upload=220038]: Waiting for error group managing segments... Aug 17 12:59:19.842203652 (211h33m14.273283783s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:59:19.842208200 (211h33m14.273288331s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:59:19.842211075 (211h33m14.273291197s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:59:20.058635828 (211h33m14.489715959s) [upload=220038]: Done uploading segments... Aug 17 12:59:20.058654253 (211h33m14.489734384s) [upload=220038]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.854719651s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.243698221s
FAIL (2025-08-17 13:02:22 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 8)
======LOGS======
079]: Done starting upload
Aug 17 13:01:52.810864583 (211h35m47.241944714s) [upload=220079]: Uploading segments...
Aug 17 13:01:52.810956628 (211h35m47.242036759s) [upload=220079]: Got next segment. Inline: false
Aug 17 13:01:52.810992788 (211h35m47.242072909s) [upload=220079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 13:01:52.810997237 (211h35m47.242077368s) [upload=220079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 13:01:53.109645965 (211h35m47.540726096s) [seg_pos={0 0}, upload=220079]: Begin upload segment...
Aug 17 13:01:53.109689348 (211h35m47.540769469s) [seg_pos={0 0}, upload=220079]: Done begin upload segment.
Aug 17 13:01:53.109713093 (211h35m47.540793214s) [noise=true , address=45.91.116.10:4083 , piece_id=XBCU6HXROPZ5JHHFUEJV4YXF35VSPERNYMM5FKNJMQV6BG2PXACA, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.109733121 (211h35m47.540813252s) [noise=true , address=45.91.116.4:4937 , piece_id=L7VJRBO7BOX4N5X24DLHV4CU3WM6P5PKGJYQA52N3XE5VYNG5EYA, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.110109502 (211h35m47.541189633s) [noise=true , address=104.36.82.11:4115 , piece_id=BVZGE2SWYW76XSIJB2YHOEOTNOD5A56GAELRHLJNWU4VSVAKLRRA, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.110394627 (211h35m47.541474758s) [noise=true , address=104.36.82.2:4731 , piece_id=EUOBDCVCQ6GAZJQVQP76C5DAH7S2F3PYNJWCLTTQXSY35WEITPEA, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.110676516 (211h35m47.541756647s) [noise=true , address=104.36.82.9:4007 , piece_id=FZU7C5J7MEI2YV6A7XNLNUHRLMSU73BBMGTX2DX7AEFNP7EVBSPQ, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.110925152 (211h35m47.542005283s) [noise=true , address=104.36.82.10:4079 , piece_id=EELQ3A4TXIHX242EP6YPJZY7D7VV7MKC7DX3Z3CRII27DQIGX7EA, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.111163057 (211h35m47.542243188s) [noise=true , address=77.90.31.18:4806 , piece_id=2KRF7MFXNNDPUBEWCUFIEVDHKRV3HIQSHD3PXHAM4QHKK7T46TWQ, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.111399029 (211h35m47.54247916s) [noise=true , address=104.36.82.11:4113 , piece_id=IJN7UO4WAJ3D2GEQM34HIJBLFQTZ2XZQKSGOU53EQOUMF6RJTGBA, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.111812921 (211h35m47.542893052s) [noise=true , address=45.91.116.9:4263 , piece_id=2EWUAMYOOXYJMAJODCJ2BNFIADAWCHKYDVGHXQK5ULDHKFHTYJDA, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.112094489 (211h35m47.54317461s) [noise=true , address=104.36.82.14:4222 , piece_id=DVDDSYYY23NX5NOR7ZPVXGNLOYOUIMCZ35J5X3UAIKCCHOWC5Z3Q, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.112312096 (211h35m47.543392227s) [noise=true , address=45.91.116.7:4009 , piece_id=I5SEZXEAZ4YIWQKSDTIZXKX3PF5TQD5ZLQXA65WSL7ZVYYQU2HNA, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.112579217 (211h35m47.543659338s) [noise=true , address=45.91.116.5:4297 , piece_id=FD4Y3OU66TMC3TZDQC32XIER4NHRA54ZBOGFM7DP4FIYMXU4RTNQ, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.112789168 (211h35m47.543869299s) [noise=true , address=45.91.116.14:4189 , piece_id=6FGAIZ7ZZVSBAANLLWPLZVZ4HZUHSKIQ4MIZPF6QUB5P7UMDJ45A, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.112984302 (211h35m47.544064433s) [noise=true , address=45.91.116.8:4045 , piece_id=6JDFTJEEFI63R2DUWCRIVTMLUUHC3DPQEVHWBL7G4IKVBTL76IGA, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.113190917 (211h35m47.544271048s) [noise=true , address=104.36.82.13:4187 , piece_id=KQ6PDZLMNK2C4O3Y6FCRIOHO6A2O77CRFYTC7ZYUKAEGYCEXUJUA, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:53.113440034 (211h35m47.544520165s) [noise=true , address=104.36.82.14:4221 , piece_id=VXBAD4FDWWI75P2R2HTOWBBZDL6JV6CYLCRFCAQFWCYH7QPM4MIQ, seg_pos={0 0}, upload=220079]: Uploading piece...
Aug 17 13:01:54.806392843 (211h35m49.237472974s) [upload=220079]: Next returned nil segment
Aug 17 13:01:54.806409795 (211h35m49.237489926s) [upload=220079]: Waiting for error group managing segments...
Aug 17 13:01:55.147488698 (211h35m49.578568859s) [noise=true , address=45.91.116.5:4297 , piece_id=FD4Y3OU66TMC3TZDQC32XIER4NHRA54ZBOGFM7DP4FIYMXU4RTNQ, seg_pos={0 0}, upload=220079]: Done uploading piece. err: <nil>
Aug 17 13:01:55.157297706 (211h35m49.588377837s) [noise=true , address=45.91.116.8:4045 , piece_id=6JDFTJEEFI63R2DUWCRIVTMLUUHC3DPQEVHWBL7G4IKVBTL76IGA, seg_pos={0 0}, upload=220079]: Done uploading piece. err: <nil>
Aug 17 13:01:55.176897198 (211h35m49.607977329s) [noise=true , address=45.91.116.4:4937 , piece_id=L7VJRBO7BOX4N5X24DLHV4CU3WM6P5PKGJYQA52N3XE5VYNG5EYA, seg_pos={0 0}, upload=220079]: Done uploading piece. err: <nil>
Aug 17 13:01:55.204591127 (211h35m49.635671288s) [noise=true , address=45.91.116.9:4263 , piece_id=2EWUAMYOOXYJMAJODCJ2BNFIADAWCHKYDVGHXQK5ULDHKFHTYJDA, seg_pos={0 0}, upload=220079]: Done uploading piece. err: <nil>
Aug 17 13:01:55.258013904 (211h35m49.689094035s) [noise=true , address=77.90.31.18:4806 , piece_id=2KRF7MFXNNDPUBEWCUFIEVDHKRV3HIQSHD3PXHAM4QHKK7T46TWQ, seg_pos={0 0}, upload=220079]: Done uploading piece. err: <nil>
Aug 17 13:01:55.312439311 (211h35m49.743519442s) [noise=true , address=45.91.116.7:4009 , piece_id=I5SEZXEAZ4YIWQKSDTIZXKX3PF5TQD5ZLQXA65WSL7ZVYYQU2HNA, seg_pos={0 0}, upload=220079]: Done uploading piece. err: <nil>
Aug 17 13:01:55.469513524 (211h35m49.900593655s) [noise=true , address=45.91.116.14:4189 , piece_id=6FGAIZ7ZZVSBAANLLWPLZVZ4HZUHSKIQ4MIZPF6QUB5P7UMDJ45A, seg_pos={0 0}, upload=220079]: Done uploading piece. err: <nil>
Aug 17 13:01:55.473475183 (211h35m49.904555304s) [noise=true , address=45.91.116.10:4083 , piece_id=XBCU6HXROPZ5JHHFUEJV4YXF35VSPERNYMM5FKNJMQV6BG2PXACA, seg_pos={0 0}, upload=220079]: Done uploading piece. err: <nil>
Aug 17 13:02:22.121309076 (211h36m16.552389207s) [noise=true , address=104.36.82.14:4222 , piece_id=DVDDSYYY23NX5NOR7ZPVXGNLOYOUIMCZ35J5X3UAIKCCHOWC5Z3Q, seg_pos={0 0}, upload=220079]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: rpc: dial tcp 104.36.82.14:4222: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:22.121357999 (211h36m16.55243813s) [noise=true , address=104.36.82.10:4079 , piece_id=EELQ3A4TXIHX242EP6YPJZY7D7VV7MKC7DX3Z3CRII27DQIGX7EA, seg_pos={0 0}, upload=220079]: Done uploading piece. err: ecclient: upload failed (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud, address:104.36.82.10:4079): protocol: rpc: dial tcp 104.36.82.10:4079: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:22.121388528 (211h36m16.552468649s) [noise=true , address=104.36.82.11:4113 , piece_id=IJN7UO4WAJ3D2GEQM34HIJBLFQTZ2XZQKSGOU53EQOUMF6RJTGBA, seg_pos={0 0}, upload=220079]: Done uploading piece. err: ecclient: upload failed (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV, address:104.36.82.11:4113): protocol: rpc: dial tcp 104.36.82.11:4113: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:22.121420719 (211h36m16.55250085s) [noise=true , address=104.36.82.9:4007 , piece_id=FZU7C5J7MEI2YV6A7XNLNUHRLMSU73BBMGTX2DX7AEFNP7EVBSPQ, seg_pos={0 0}, upload=220079]: Done uploading piece. err: ecclient: upload failed (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp, address:104.36.82.9:4007): protocol: write tcp 188.166.225.170:43440->104.36.82.9:4007: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:22.121448913 (211h36m16.552529044s) [noise=true , address=104.36.82.14:4221 , piece_id=VXBAD4FDWWI75P2R2HTOWBBZDL6JV6CYLCRFCAQFWCYH7QPM4MIQ, seg_pos={0 0}, upload=220079]: Done uploading piece. err: ecclient: upload failed (node:129qMN1kX8C3x3H1Epfc4pUbtVGU1xPiZj43QSLByCTPKqwUoJR, address:104.36.82.14:4221): protocol: write tcp 188.166.225.170:47218->104.36.82.14:4221: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:22.121486646 (211h36m16.552566767s) [noise=true , address=104.36.82.13:4187 , piece_id=KQ6PDZLMNK2C4O3Y6FCRIOHO6A2O77CRFYTC7ZYUKAEGYCEXUJUA, seg_pos={0 0}, upload=220079]: Done uploading piece. err: ecclient: upload failed (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x, address:104.36.82.13:4187): protocol: rpc: dial tcp 104.36.82.13:4187: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:22.121522684 (211h36m16.552602815s) [noise=true , address=104.36.82.11:4115 , piece_id=BVZGE2SWYW76XSIJB2YHOEOTNOD5A56GAELRHLJNWU4VSVAKLRRA, seg_pos={0 0}, upload=220079]: Done uploading piece. err: ecclient: upload failed (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR, address:104.36.82.11:4115): protocol: rpc: dial tcp 104.36.82.11:4115: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:22.121562060 (211h36m16.552642191s) [noise=true , address=104.36.82.2:4731 , piece_id=EUOBDCVCQ6GAZJQVQP76C5DAH7S2F3PYNJWCLTTQXSY35WEITPEA, seg_pos={0 0}, upload=220079]: Done uploading piece. err: ecclient: upload failed (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9, address:104.36.82.2:4731): protocol: write tcp 188.166.225.170:49946->104.36.82.2:4731: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 13:02:22.121585534 (211h36m16.552665665s) [seg_pos={0 0}, upload=220079]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil>
Aug 17 13:02:22.363547990 (211h36m16.794628121s) [upload=220079]: Done uploading segments...
Aug 17 13:02:22.363568850 (211h36m16.794648981s) [upload=220079]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8)
Duration: 30.24372348s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............X..............................X......X..X......] duration:
5.665925236s
FAIL (2025-08-17 13:01:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 12:56:57.224052275 (211h30m51.655132406s) [upload=219993]: Starting upload
Aug 17 12:56:57.224102810 (211h30m51.655182941s) [upload=219993]: Done starting upload
Aug 17 12:56:57.224151574 (211h30m51.655231705s) [upload=219993]: Uploading segments...
Aug 17 12:56:57.224279229 (211h30m51.65535936s) [upload=219993]: Got next segment. Inline: false
Aug 17 12:56:57.224317010 (211h30m51.655397142s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:56:57.224321128 (211h30m51.655401249s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:56:57.677216933 (211h30m52.108297065s) [seg_pos={0 0}, upload=219993]: Begin upload segment...
Aug 17 12:56:57.677263433 (211h30m52.108343564s) [seg_pos={0 0}, upload=219993]: Done begin upload segment.
Aug 17 12:56:57.677290294 (211h30m52.108370415s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677304821 (211h30m52.108384942s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677387800 (211h30m52.108467921s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677722621 (211h30m52.108802752s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677758921 (211h30m52.108839052s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678045899 (211h30m52.10912603s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678101416 (211h30m52.109181547s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678387003 (211h30m52.109467124s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678404756 (211h30m52.109484877s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678641179 (211h30m52.10972131s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678659573 (211h30m52.109739704s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678876558 (211h30m52.10995669s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678894523 (211h30m52.109974654s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679112631 (211h30m52.110192752s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679128952 (211h30m52.110209083s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679525721 (211h30m52.110605852s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679844311 (211h30m52.110924442s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.680058441 (211h30m52.111138562s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:59.151681593 (211h30m53.582761724s) [upload=219993]: Next returned nil segment
Aug 17 12:56:59.151714165 (211h30m53.582794296s) [upload=219993]: Waiting for error group managing segments...
Aug 17 12:56:59.528515790 (211h30m53.959595921s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.605123340 (211h30m54.036203471s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.606691070 (211h30m54.037771201s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.608050480 (211h30m54.039130611s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.626799223 (211h30m54.057879354s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.643741851 (211h30m54.074821982s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.652413604 (211h30m54.083493735s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.655307361 (211h30m54.086387482s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.663393292 (211h30m54.094473423s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.729418684 (211h30m54.160498815s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.730861063 (211h30m54.161941194s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.746544722 (211h30m54.177624853s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.776047903 (211h30m54.207128034s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843457792 (211h30m54.274537924s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843481588 (211h30m54.274561709s) [seg_pos={0 0}, upload=219993]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:56:59.843613781 (211h30m54.274693912s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843624502 (211h30m54.274704633s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843658187 (211h30m54.274738318s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o4pJyAnMMPS4uUy8EmbBnyT8owk2vSCe4nFpRnVmc7MeDcg83): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843694025 (211h30m54.274774156s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15i783VxxzbriD7LZCbFWNBY8uCKUffXtmWE2eu2VupgE1t9bZ): protocol: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection
Aug 17 12:56:59.843702521 (211h30m54.274782652s) [seg_pos={0 0}, upload=219993]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:56:59.843756735 (211h30m54.274836866s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:56:59.843760371 (211h30m54.274840502s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:57:00.171516182 (211h30m54.602596304s) [upload=219993]: Done uploading segments...
Aug 17 12:57:00.171532484 (211h30m54.602612615s) [upload=219993]: Upload finished. err: <nil>
Duration: 5.665951568s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.......X....] duration:
2.805715226s
FAIL (2025-08-17 13:01:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:59:19.842006213 (211h33m14.273086344s) [upload=220038]: Starting upload Aug 17 12:59:19.842081377 (211h33m14.273161508s) [upload=220038]: Done starting upload Aug 17 12:59:19.842133507 (211h33m14.273213638s) [upload=220038]: Uploading segments... Aug 17 12:59:19.842168784 (211h33m14.273248905s) [upload=220038]: Got next segment. Inline: true Aug 17 12:59:19.842172060 (211h33m14.273252191s) [upload=220038]: Waiting for error group managing segments... Aug 17 12:59:19.842203652 (211h33m14.273283783s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:59:19.842208200 (211h33m14.273288331s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:59:19.842211075 (211h33m14.273291197s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:59:20.058635828 (211h33m14.489715959s) [upload=220038]: Done uploading segments... Aug 17 12:59:20.058654253 (211h33m14.489734384s) [upload=220038]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.805750263s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............X..............................X......X..X.....] duration:
5.783769322s
FAIL (2025-08-17 13:00:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 12:56:57.224052275 (211h30m51.655132406s) [upload=219993]: Starting upload
Aug 17 12:56:57.224102810 (211h30m51.655182941s) [upload=219993]: Done starting upload
Aug 17 12:56:57.224151574 (211h30m51.655231705s) [upload=219993]: Uploading segments...
Aug 17 12:56:57.224279229 (211h30m51.65535936s) [upload=219993]: Got next segment. Inline: false
Aug 17 12:56:57.224317010 (211h30m51.655397142s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:56:57.224321128 (211h30m51.655401249s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:56:57.677216933 (211h30m52.108297065s) [seg_pos={0 0}, upload=219993]: Begin upload segment...
Aug 17 12:56:57.677263433 (211h30m52.108343564s) [seg_pos={0 0}, upload=219993]: Done begin upload segment.
Aug 17 12:56:57.677290294 (211h30m52.108370415s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677304821 (211h30m52.108384942s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677387800 (211h30m52.108467921s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677722621 (211h30m52.108802752s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677758921 (211h30m52.108839052s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678045899 (211h30m52.10912603s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678101416 (211h30m52.109181547s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678387003 (211h30m52.109467124s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678404756 (211h30m52.109484877s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678641179 (211h30m52.10972131s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678659573 (211h30m52.109739704s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678876558 (211h30m52.10995669s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678894523 (211h30m52.109974654s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679112631 (211h30m52.110192752s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679128952 (211h30m52.110209083s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679525721 (211h30m52.110605852s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679844311 (211h30m52.110924442s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.680058441 (211h30m52.111138562s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:59.151681593 (211h30m53.582761724s) [upload=219993]: Next returned nil segment
Aug 17 12:56:59.151714165 (211h30m53.582794296s) [upload=219993]: Waiting for error group managing segments...
Aug 17 12:56:59.528515790 (211h30m53.959595921s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.605123340 (211h30m54.036203471s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.606691070 (211h30m54.037771201s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.608050480 (211h30m54.039130611s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.626799223 (211h30m54.057879354s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.643741851 (211h30m54.074821982s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.652413604 (211h30m54.083493735s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.655307361 (211h30m54.086387482s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.663393292 (211h30m54.094473423s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.729418684 (211h30m54.160498815s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.730861063 (211h30m54.161941194s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.746544722 (211h30m54.177624853s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.776047903 (211h30m54.207128034s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843457792 (211h30m54.274537924s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843481588 (211h30m54.274561709s) [seg_pos={0 0}, upload=219993]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:56:59.843613781 (211h30m54.274693912s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843624502 (211h30m54.274704633s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843658187 (211h30m54.274738318s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o4pJyAnMMPS4uUy8EmbBnyT8owk2vSCe4nFpRnVmc7MeDcg83): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843694025 (211h30m54.274774156s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15i783VxxzbriD7LZCbFWNBY8uCKUffXtmWE2eu2VupgE1t9bZ): protocol: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection
Aug 17 12:56:59.843702521 (211h30m54.274782652s) [seg_pos={0 0}, upload=219993]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:56:59.843756735 (211h30m54.274836866s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:56:59.843760371 (211h30m54.274840502s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:57:00.171516182 (211h30m54.602596304s) [upload=219993]: Done uploading segments...
Aug 17 12:57:00.171532484 (211h30m54.602612615s) [upload=219993]: Upload finished. err: <nil>
Duration: 5.783791114s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.......X...] duration:
1.95608956s
FAIL (2025-08-17 13:00:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:59:19.842006213 (211h33m14.273086344s) [upload=220038]: Starting upload Aug 17 12:59:19.842081377 (211h33m14.273161508s) [upload=220038]: Done starting upload Aug 17 12:59:19.842133507 (211h33m14.273213638s) [upload=220038]: Uploading segments... Aug 17 12:59:19.842168784 (211h33m14.273248905s) [upload=220038]: Got next segment. Inline: true Aug 17 12:59:19.842172060 (211h33m14.273252191s) [upload=220038]: Waiting for error group managing segments... Aug 17 12:59:19.842203652 (211h33m14.273283783s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:59:19.842208200 (211h33m14.273288331s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:59:19.842211075 (211h33m14.273291197s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:59:20.058635828 (211h33m14.489715959s) [upload=220038]: Done uploading segments... Aug 17 12:59:20.058654253 (211h33m14.489734384s) [upload=220038]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.956114148s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X.......X..] duration:
2.060951331s
FAIL (2025-08-17 13:00:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:59:19.842006213 (211h33m14.273086344s) [upload=220038]: Starting upload Aug 17 12:59:19.842081377 (211h33m14.273161508s) [upload=220038]: Done starting upload Aug 17 12:59:19.842133507 (211h33m14.273213638s) [upload=220038]: Uploading segments... Aug 17 12:59:19.842168784 (211h33m14.273248905s) [upload=220038]: Got next segment. Inline: true Aug 17 12:59:19.842172060 (211h33m14.273252191s) [upload=220038]: Waiting for error group managing segments... Aug 17 12:59:19.842203652 (211h33m14.273283783s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:59:19.842208200 (211h33m14.273288331s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:59:19.842211075 (211h33m14.273291197s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:59:20.058635828 (211h33m14.489715959s) [upload=220038]: Done uploading segments... Aug 17 12:59:20.058654253 (211h33m14.489734384s) [upload=220038]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.060980034s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..............X..............................X......X..X....] duration:
5.642024227s
FAIL (2025-08-17 12:59:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 12:56:57.224052275 (211h30m51.655132406s) [upload=219993]: Starting upload
Aug 17 12:56:57.224102810 (211h30m51.655182941s) [upload=219993]: Done starting upload
Aug 17 12:56:57.224151574 (211h30m51.655231705s) [upload=219993]: Uploading segments...
Aug 17 12:56:57.224279229 (211h30m51.65535936s) [upload=219993]: Got next segment. Inline: false
Aug 17 12:56:57.224317010 (211h30m51.655397142s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:56:57.224321128 (211h30m51.655401249s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:56:57.677216933 (211h30m52.108297065s) [seg_pos={0 0}, upload=219993]: Begin upload segment...
Aug 17 12:56:57.677263433 (211h30m52.108343564s) [seg_pos={0 0}, upload=219993]: Done begin upload segment.
Aug 17 12:56:57.677290294 (211h30m52.108370415s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677304821 (211h30m52.108384942s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677387800 (211h30m52.108467921s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677722621 (211h30m52.108802752s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677758921 (211h30m52.108839052s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678045899 (211h30m52.10912603s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678101416 (211h30m52.109181547s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678387003 (211h30m52.109467124s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678404756 (211h30m52.109484877s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678641179 (211h30m52.10972131s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678659573 (211h30m52.109739704s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678876558 (211h30m52.10995669s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678894523 (211h30m52.109974654s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679112631 (211h30m52.110192752s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679128952 (211h30m52.110209083s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679525721 (211h30m52.110605852s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679844311 (211h30m52.110924442s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.680058441 (211h30m52.111138562s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:59.151681593 (211h30m53.582761724s) [upload=219993]: Next returned nil segment
Aug 17 12:56:59.151714165 (211h30m53.582794296s) [upload=219993]: Waiting for error group managing segments...
Aug 17 12:56:59.528515790 (211h30m53.959595921s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.605123340 (211h30m54.036203471s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.606691070 (211h30m54.037771201s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.608050480 (211h30m54.039130611s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.626799223 (211h30m54.057879354s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.643741851 (211h30m54.074821982s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.652413604 (211h30m54.083493735s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.655307361 (211h30m54.086387482s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.663393292 (211h30m54.094473423s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.729418684 (211h30m54.160498815s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.730861063 (211h30m54.161941194s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.746544722 (211h30m54.177624853s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.776047903 (211h30m54.207128034s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843457792 (211h30m54.274537924s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843481588 (211h30m54.274561709s) [seg_pos={0 0}, upload=219993]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:56:59.843613781 (211h30m54.274693912s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843624502 (211h30m54.274704633s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843658187 (211h30m54.274738318s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o4pJyAnMMPS4uUy8EmbBnyT8owk2vSCe4nFpRnVmc7MeDcg83): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843694025 (211h30m54.274774156s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15i783VxxzbriD7LZCbFWNBY8uCKUffXtmWE2eu2VupgE1t9bZ): protocol: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection
Aug 17 12:56:59.843702521 (211h30m54.274782652s) [seg_pos={0 0}, upload=219993]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:56:59.843756735 (211h30m54.274836866s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:56:59.843760371 (211h30m54.274840502s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:57:00.171516182 (211h30m54.602596304s) [upload=219993]: Done uploading segments...
Aug 17 12:57:00.171532484 (211h30m54.602612615s) [upload=219993]: Upload finished. err: <nil>
Duration: 5.642055297s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................................................X.......X.] duration:
1.904160761s
FAIL (2025-08-17 12:59:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:59:19.842006213 (211h33m14.273086344s) [upload=220038]: Starting upload Aug 17 12:59:19.842081377 (211h33m14.273161508s) [upload=220038]: Done starting upload Aug 17 12:59:19.842133507 (211h33m14.273213638s) [upload=220038]: Uploading segments... Aug 17 12:59:19.842168784 (211h33m14.273248905s) [upload=220038]: Got next segment. Inline: true Aug 17 12:59:19.842172060 (211h33m14.273252191s) [upload=220038]: Waiting for error group managing segments... Aug 17 12:59:19.842203652 (211h33m14.273283783s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:59:19.842208200 (211h33m14.273288331s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:59:19.842211075 (211h33m14.273291197s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:59:20.058635828 (211h33m14.489715959s) [upload=220038]: Done uploading segments... Aug 17 12:59:20.058654253 (211h33m14.489734384s) [upload=220038]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.904190598s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................................................X.......X] duration:
884.332153ms
FAIL (2025-08-17 12:59:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:59:19.842006213 (211h33m14.273086344s) [upload=220038]: Starting upload Aug 17 12:59:19.842081377 (211h33m14.273161508s) [upload=220038]: Done starting upload Aug 17 12:59:19.842133507 (211h33m14.273213638s) [upload=220038]: Uploading segments... Aug 17 12:59:19.842168784 (211h33m14.273248905s) [upload=220038]: Got next segment. Inline: true Aug 17 12:59:19.842172060 (211h33m14.273252191s) [upload=220038]: Waiting for error group managing segments... Aug 17 12:59:19.842203652 (211h33m14.273283783s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:59:19.842208200 (211h33m14.273288331s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:59:19.842211075 (211h33m14.273291197s) [upload=220038]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:59:20.058635828 (211h33m14.489715959s) [upload=220038]: Done uploading segments... Aug 17 12:59:20.058654253 (211h33m14.489734384s) [upload=220038]: Upload finished. err: metaclient: Too Many Requests
Duration: 884.354415ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...............X..............................X......X..X...] duration:
5.674196048s
FAIL (2025-08-17 12:59:10 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 12:56:57.224052275 (211h30m51.655132406s) [upload=219993]: Starting upload
Aug 17 12:56:57.224102810 (211h30m51.655182941s) [upload=219993]: Done starting upload
Aug 17 12:56:57.224151574 (211h30m51.655231705s) [upload=219993]: Uploading segments...
Aug 17 12:56:57.224279229 (211h30m51.65535936s) [upload=219993]: Got next segment. Inline: false
Aug 17 12:56:57.224317010 (211h30m51.655397142s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:56:57.224321128 (211h30m51.655401249s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:56:57.677216933 (211h30m52.108297065s) [seg_pos={0 0}, upload=219993]: Begin upload segment...
Aug 17 12:56:57.677263433 (211h30m52.108343564s) [seg_pos={0 0}, upload=219993]: Done begin upload segment.
Aug 17 12:56:57.677290294 (211h30m52.108370415s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677304821 (211h30m52.108384942s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677387800 (211h30m52.108467921s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677722621 (211h30m52.108802752s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677758921 (211h30m52.108839052s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678045899 (211h30m52.10912603s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678101416 (211h30m52.109181547s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678387003 (211h30m52.109467124s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678404756 (211h30m52.109484877s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678641179 (211h30m52.10972131s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678659573 (211h30m52.109739704s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678876558 (211h30m52.10995669s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678894523 (211h30m52.109974654s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679112631 (211h30m52.110192752s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679128952 (211h30m52.110209083s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679525721 (211h30m52.110605852s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679844311 (211h30m52.110924442s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.680058441 (211h30m52.111138562s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:59.151681593 (211h30m53.582761724s) [upload=219993]: Next returned nil segment
Aug 17 12:56:59.151714165 (211h30m53.582794296s) [upload=219993]: Waiting for error group managing segments...
Aug 17 12:56:59.528515790 (211h30m53.959595921s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.605123340 (211h30m54.036203471s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.606691070 (211h30m54.037771201s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.608050480 (211h30m54.039130611s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.626799223 (211h30m54.057879354s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.643741851 (211h30m54.074821982s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.652413604 (211h30m54.083493735s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.655307361 (211h30m54.086387482s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.663393292 (211h30m54.094473423s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.729418684 (211h30m54.160498815s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.730861063 (211h30m54.161941194s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.746544722 (211h30m54.177624853s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.776047903 (211h30m54.207128034s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843457792 (211h30m54.274537924s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843481588 (211h30m54.274561709s) [seg_pos={0 0}, upload=219993]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:56:59.843613781 (211h30m54.274693912s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843624502 (211h30m54.274704633s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843658187 (211h30m54.274738318s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o4pJyAnMMPS4uUy8EmbBnyT8owk2vSCe4nFpRnVmc7MeDcg83): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843694025 (211h30m54.274774156s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15i783VxxzbriD7LZCbFWNBY8uCKUffXtmWE2eu2VupgE1t9bZ): protocol: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection
Aug 17 12:56:59.843702521 (211h30m54.274782652s) [seg_pos={0 0}, upload=219993]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:56:59.843756735 (211h30m54.274836866s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:56:59.843760371 (211h30m54.274840502s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:57:00.171516182 (211h30m54.602596304s) [upload=219993]: Done uploading segments...
Aug 17 12:57:00.171532484 (211h30m54.602612615s) [upload=219993]: Upload finished. err: <nil>
Duration: 5.674233327s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.875777163s
FAIL (2025-08-17 12:59:03 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 12:53:44.385081367 (211h27m38.816161508s) [upload=219937]: Starting upload Aug 17 12:53:44.385129850 (211h27m38.816209971s) [upload=219937]: Done starting upload Aug 17 12:53:44.385181509 (211h27m38.81626169s) [upload=219937]: Uploading segments... Aug 17 12:53:44.385241984 (211h27m38.816322135s) [upload=219937]: Got next segment. Inline: true Aug 17 12:53:44.385248046 (211h27m38.816328167s) [upload=219937]: Waiting for error group managing segments... Aug 17 12:53:44.385283563 (211h27m38.816363695s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:53:44.385287542 (211h27m38.816367673s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:53:44.385289916 (211h27m38.816370037s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:53:44.706747386 (211h27m39.137827517s) [upload=219937]: Done uploading segments... Aug 17 12:53:44.706771211 (211h27m39.137851342s) [upload=219937]: Upload finished. err: <nil>
Duration: 1.875805157s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [................X..............................X......X..X..] duration:
5.831860719s
FAIL (2025-08-17 12:58:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 12:56:57.224052275 (211h30m51.655132406s) [upload=219993]: Starting upload
Aug 17 12:56:57.224102810 (211h30m51.655182941s) [upload=219993]: Done starting upload
Aug 17 12:56:57.224151574 (211h30m51.655231705s) [upload=219993]: Uploading segments...
Aug 17 12:56:57.224279229 (211h30m51.65535936s) [upload=219993]: Got next segment. Inline: false
Aug 17 12:56:57.224317010 (211h30m51.655397142s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:56:57.224321128 (211h30m51.655401249s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:56:57.677216933 (211h30m52.108297065s) [seg_pos={0 0}, upload=219993]: Begin upload segment...
Aug 17 12:56:57.677263433 (211h30m52.108343564s) [seg_pos={0 0}, upload=219993]: Done begin upload segment.
Aug 17 12:56:57.677290294 (211h30m52.108370415s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677304821 (211h30m52.108384942s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677387800 (211h30m52.108467921s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677722621 (211h30m52.108802752s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677758921 (211h30m52.108839052s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678045899 (211h30m52.10912603s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678101416 (211h30m52.109181547s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678387003 (211h30m52.109467124s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678404756 (211h30m52.109484877s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678641179 (211h30m52.10972131s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678659573 (211h30m52.109739704s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678876558 (211h30m52.10995669s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678894523 (211h30m52.109974654s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679112631 (211h30m52.110192752s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679128952 (211h30m52.110209083s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679525721 (211h30m52.110605852s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679844311 (211h30m52.110924442s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.680058441 (211h30m52.111138562s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:59.151681593 (211h30m53.582761724s) [upload=219993]: Next returned nil segment
Aug 17 12:56:59.151714165 (211h30m53.582794296s) [upload=219993]: Waiting for error group managing segments...
Aug 17 12:56:59.528515790 (211h30m53.959595921s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.605123340 (211h30m54.036203471s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.606691070 (211h30m54.037771201s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.608050480 (211h30m54.039130611s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.626799223 (211h30m54.057879354s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.643741851 (211h30m54.074821982s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.652413604 (211h30m54.083493735s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.655307361 (211h30m54.086387482s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.663393292 (211h30m54.094473423s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.729418684 (211h30m54.160498815s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.730861063 (211h30m54.161941194s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.746544722 (211h30m54.177624853s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.776047903 (211h30m54.207128034s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843457792 (211h30m54.274537924s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843481588 (211h30m54.274561709s) [seg_pos={0 0}, upload=219993]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:56:59.843613781 (211h30m54.274693912s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843624502 (211h30m54.274704633s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843658187 (211h30m54.274738318s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o4pJyAnMMPS4uUy8EmbBnyT8owk2vSCe4nFpRnVmc7MeDcg83): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843694025 (211h30m54.274774156s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15i783VxxzbriD7LZCbFWNBY8uCKUffXtmWE2eu2VupgE1t9bZ): protocol: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection
Aug 17 12:56:59.843702521 (211h30m54.274782652s) [seg_pos={0 0}, upload=219993]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:56:59.843756735 (211h30m54.274836866s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:56:59.843760371 (211h30m54.274840502s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:57:00.171516182 (211h30m54.602596304s) [upload=219993]: Done uploading segments...
Aug 17 12:57:00.171532484 (211h30m54.602612615s) [upload=219993]: Upload finished. err: <nil>
Duration: 5.831883312s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X..............................X......X..X.] duration:
5.79386137s
FAIL (2025-08-17 12:58:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 12:56:57.224052275 (211h30m51.655132406s) [upload=219993]: Starting upload
Aug 17 12:56:57.224102810 (211h30m51.655182941s) [upload=219993]: Done starting upload
Aug 17 12:56:57.224151574 (211h30m51.655231705s) [upload=219993]: Uploading segments...
Aug 17 12:56:57.224279229 (211h30m51.65535936s) [upload=219993]: Got next segment. Inline: false
Aug 17 12:56:57.224317010 (211h30m51.655397142s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:56:57.224321128 (211h30m51.655401249s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:56:57.677216933 (211h30m52.108297065s) [seg_pos={0 0}, upload=219993]: Begin upload segment...
Aug 17 12:56:57.677263433 (211h30m52.108343564s) [seg_pos={0 0}, upload=219993]: Done begin upload segment.
Aug 17 12:56:57.677290294 (211h30m52.108370415s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677304821 (211h30m52.108384942s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677387800 (211h30m52.108467921s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677722621 (211h30m52.108802752s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677758921 (211h30m52.108839052s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678045899 (211h30m52.10912603s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678101416 (211h30m52.109181547s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678387003 (211h30m52.109467124s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678404756 (211h30m52.109484877s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678641179 (211h30m52.10972131s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678659573 (211h30m52.109739704s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678876558 (211h30m52.10995669s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678894523 (211h30m52.109974654s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679112631 (211h30m52.110192752s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679128952 (211h30m52.110209083s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679525721 (211h30m52.110605852s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679844311 (211h30m52.110924442s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.680058441 (211h30m52.111138562s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:59.151681593 (211h30m53.582761724s) [upload=219993]: Next returned nil segment
Aug 17 12:56:59.151714165 (211h30m53.582794296s) [upload=219993]: Waiting for error group managing segments...
Aug 17 12:56:59.528515790 (211h30m53.959595921s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.605123340 (211h30m54.036203471s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.606691070 (211h30m54.037771201s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.608050480 (211h30m54.039130611s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.626799223 (211h30m54.057879354s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.643741851 (211h30m54.074821982s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.652413604 (211h30m54.083493735s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.655307361 (211h30m54.086387482s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.663393292 (211h30m54.094473423s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.729418684 (211h30m54.160498815s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.730861063 (211h30m54.161941194s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.746544722 (211h30m54.177624853s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.776047903 (211h30m54.207128034s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843457792 (211h30m54.274537924s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843481588 (211h30m54.274561709s) [seg_pos={0 0}, upload=219993]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:56:59.843613781 (211h30m54.274693912s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843624502 (211h30m54.274704633s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843658187 (211h30m54.274738318s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o4pJyAnMMPS4uUy8EmbBnyT8owk2vSCe4nFpRnVmc7MeDcg83): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843694025 (211h30m54.274774156s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15i783VxxzbriD7LZCbFWNBY8uCKUffXtmWE2eu2VupgE1t9bZ): protocol: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection
Aug 17 12:56:59.843702521 (211h30m54.274782652s) [seg_pos={0 0}, upload=219993]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:56:59.843756735 (211h30m54.274836866s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:56:59.843760371 (211h30m54.274840502s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:57:00.171516182 (211h30m54.602596304s) [upload=219993]: Done uploading segments...
Aug 17 12:57:00.171532484 (211h30m54.602612615s) [upload=219993]: Upload finished. err: <nil>
Duration: 5.793885416s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.078920472s
FAIL (2025-08-17 12:57:57 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 12:53:44.385081367 (211h27m38.816161508s) [upload=219937]: Starting upload Aug 17 12:53:44.385129850 (211h27m38.816209971s) [upload=219937]: Done starting upload Aug 17 12:53:44.385181509 (211h27m38.81626169s) [upload=219937]: Uploading segments... Aug 17 12:53:44.385241984 (211h27m38.816322135s) [upload=219937]: Got next segment. Inline: true Aug 17 12:53:44.385248046 (211h27m38.816328167s) [upload=219937]: Waiting for error group managing segments... Aug 17 12:53:44.385283563 (211h27m38.816363695s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:53:44.385287542 (211h27m38.816367673s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:53:44.385289916 (211h27m38.816370037s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:53:44.706747386 (211h27m39.137827517s) [upload=219937]: Done uploading segments... Aug 17 12:53:44.706771211 (211h27m39.137851342s) [upload=219937]: Upload finished. err: <nil>
Duration: 2.078938206s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.343058591s
FAIL (2025-08-17 12:57:27 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 12:53:44.385081367 (211h27m38.816161508s) [upload=219937]: Starting upload Aug 17 12:53:44.385129850 (211h27m38.816209971s) [upload=219937]: Done starting upload Aug 17 12:53:44.385181509 (211h27m38.81626169s) [upload=219937]: Uploading segments... Aug 17 12:53:44.385241984 (211h27m38.816322135s) [upload=219937]: Got next segment. Inline: true Aug 17 12:53:44.385248046 (211h27m38.816328167s) [upload=219937]: Waiting for error group managing segments... Aug 17 12:53:44.385283563 (211h27m38.816363695s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:53:44.385287542 (211h27m38.816367673s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:53:44.385289916 (211h27m38.816370037s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:53:44.706747386 (211h27m39.137827517s) [upload=219937]: Done uploading segments... Aug 17 12:53:44.706771211 (211h27m39.137851342s) [upload=219937]: Upload finished. err: <nil>
Duration: 2.343127182s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..................X..............................X......X..X] duration:
4.052185067s
FAIL (2025-08-17 12:57:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 12:56:57.224052275 (211h30m51.655132406s) [upload=219993]: Starting upload
Aug 17 12:56:57.224102810 (211h30m51.655182941s) [upload=219993]: Done starting upload
Aug 17 12:56:57.224151574 (211h30m51.655231705s) [upload=219993]: Uploading segments...
Aug 17 12:56:57.224279229 (211h30m51.65535936s) [upload=219993]: Got next segment. Inline: false
Aug 17 12:56:57.224317010 (211h30m51.655397142s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:56:57.224321128 (211h30m51.655401249s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:56:57.677216933 (211h30m52.108297065s) [seg_pos={0 0}, upload=219993]: Begin upload segment...
Aug 17 12:56:57.677263433 (211h30m52.108343564s) [seg_pos={0 0}, upload=219993]: Done begin upload segment.
Aug 17 12:56:57.677290294 (211h30m52.108370415s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677304821 (211h30m52.108384942s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677387800 (211h30m52.108467921s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677722621 (211h30m52.108802752s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.677758921 (211h30m52.108839052s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678045899 (211h30m52.10912603s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678101416 (211h30m52.109181547s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678387003 (211h30m52.109467124s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678404756 (211h30m52.109484877s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678641179 (211h30m52.10972131s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678659573 (211h30m52.109739704s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678876558 (211h30m52.10995669s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.678894523 (211h30m52.109974654s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679112631 (211h30m52.110192752s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679128952 (211h30m52.110209083s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679525721 (211h30m52.110605852s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.679844311 (211h30m52.110924442s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:57.680058441 (211h30m52.111138562s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Uploading piece...
Aug 17 12:56:59.151681593 (211h30m53.582761724s) [upload=219993]: Next returned nil segment
Aug 17 12:56:59.151714165 (211h30m53.582794296s) [upload=219993]: Waiting for error group managing segments...
Aug 17 12:56:59.528515790 (211h30m53.959595921s) [noise=true , address=79.127.220.97:4385 , piece_id=PXHMWR3BRFGUJVEST22WM3JNLRDZOS232YVQKSVFNXCE3PSRCSQA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.605123340 (211h30m54.036203471s) [noise=true , address=45.91.116.6:4976 , piece_id=OOGDS3ZHAXAJ6IOUGTP6SIXIMBMS7ELBRE32IH4ER7MZS5TC3VXQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.606691070 (211h30m54.037771201s) [noise=true , address=104.36.82.23:4460 , piece_id=CAGYF6ZKB5QSUNVSIMS6B4QCBTPLJXLMYK7UEPD3BKOJ4ACJ2HEA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.608050480 (211h30m54.039130611s) [noise=true , address=104.36.82.44:4881 , piece_id=RAVFMYJH2SACYXKE3YIBQ5RKULLWP7D7R64OSQCCNA64FFAVXAGA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.626799223 (211h30m54.057879354s) [noise=true , address=77.90.31.12:4601 , piece_id=RLPIDW2RMF7QTPTIHHH7555RCMHCWR5OH3D6R6YJZUQQMN36TPBQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.643741851 (211h30m54.074821982s) [noise=true , address=79.127.201.215:4355 , piece_id=HQUQSDSKFU5SB77S632IKLKQ6ZTWXEIGHQWV6XGPI7X5D3J6JYJA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.652413604 (211h30m54.083493735s) [noise=true , address=45.91.116.11:4130 , piece_id=RZSZCALMFIJFS7IA7TJLDJU2MBIJA7PBMEPUBVOYOTGOAU62CZCQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.655307361 (211h30m54.086387482s) [noise=true , address=104.36.82.35:4589 , piece_id=G35WASITS3KLNDQI6QF3NGSA2AIRX6LHSZ5YX3UC2E254ZWP4Q6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.663393292 (211h30m54.094473423s) [noise=true , address=45.91.116.4:4971 , piece_id=EMAMDP5TDGBTNY3ZN5I65CDJZICXXQVB5GV55GOOGHUJUJRI6GNQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.729418684 (211h30m54.160498815s) [noise=true , address=104.36.82.59:4314 , piece_id=4TKXM6WDZ367YS2NZOWZHRSRMUDVCXN3XGFSPHFHPMDKG32TDAWA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.730861063 (211h30m54.161941194s) [noise=true , address=45.91.116.8:4049 , piece_id=RYPQQBG5E3D6Q34P3NCI5DK45GH7NQHP6UUENKREFXFBY7XWFVKA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.746544722 (211h30m54.177624853s) [noise=true , address=77.90.31.14:4666 , piece_id=DOIZFPCM6WSSW3RVB6TODCSDOTUXIHOZZMDPXH7LSG2ZZBMZOBAA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.776047903 (211h30m54.207128034s) [noise=true , address=77.90.31.18:4830 , piece_id=JC3ZFQXZAJ7UYNWFIRGHP5JTKBLOBMSJLM3MBNCQEWJBUC4V4YIQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843457792 (211h30m54.274537924s) [noise=true , address=77.90.31.11:4585 , piece_id=JRWV5GXV52HQUNXXLOJNIE6G2PYO5TDPRIE275VUSIKFV5Q3KWRQ, seg_pos={0 0}, upload=219993]: Done uploading piece. err: <nil>
Aug 17 12:56:59.843481588 (211h30m54.274561709s) [seg_pos={0 0}, upload=219993]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:56:59.843613781 (211h30m54.274693912s) [noise=true , address=104.36.82.60:4349 , piece_id=OP4HHNBVJ7PLHGOGTL7EMOX2KEBYCOEKNA5QFGEEK4UEF5X7WP6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CrzYmDPm95TgyE7SHJsFVbL1JUTdwMmZVge4uEkSCbeP8iBEk): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843624502 (211h30m54.274704633s) [noise=true , address=77.90.31.10:4535 , piece_id=DK46G2ACYWODPUYWTHVBM2YPYLXRIIDKBIP7AJNVGTUUISW36K6Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12a3tsVj8R78geQJnTzdSroG6H6RiW3xv5YLyiBh1ctwSvAKeRz): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843658187 (211h30m54.274738318s) [noise=true , address=79.127.219.38:4025 , piece_id=7GCCLEBH7OIMFPJ4JM7RNQXRFOD4MMOYICDLENZODAQTE2CHG7RA, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o4pJyAnMMPS4uUy8EmbBnyT8owk2vSCe4nFpRnVmc7MeDcg83): protocol: expected piece hash; context canceled; EOF
Aug 17 12:56:59.843694025 (211h30m54.274774156s) [noise=true , address=104.36.82.58:4293 , piece_id=BOJ6DWOJ6OCRSMX5462WX5746NKIQ5D22LOILGU67VW5GIDLXZ7Q, seg_pos={0 0}, upload=219993]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15i783VxxzbriD7LZCbFWNBY8uCKUffXtmWE2eu2VupgE1t9bZ): protocol: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49016->104.36.82.58:4293: use of closed network connection
Aug 17 12:56:59.843702521 (211h30m54.274782652s) [seg_pos={0 0}, upload=219993]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:56:59.843756735 (211h30m54.274836866s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:56:59.843760371 (211h30m54.274840502s) [upload=219993]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:57:00.171516182 (211h30m54.602596304s) [upload=219993]: Done uploading segments...
Aug 17 12:57:00.171532484 (211h30m54.602612615s) [upload=219993]: Upload finished. err: <nil>
Duration: 4.052214022s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.41344891s
FAIL (2025-08-17 12:56:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 12:53:44.385081367 (211h27m38.816161508s) [upload=219937]: Starting upload Aug 17 12:53:44.385129850 (211h27m38.816209971s) [upload=219937]: Done starting upload Aug 17 12:53:44.385181509 (211h27m38.81626169s) [upload=219937]: Uploading segments... Aug 17 12:53:44.385241984 (211h27m38.816322135s) [upload=219937]: Got next segment. Inline: true Aug 17 12:53:44.385248046 (211h27m38.816328167s) [upload=219937]: Waiting for error group managing segments... Aug 17 12:53:44.385283563 (211h27m38.816363695s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:53:44.385287542 (211h27m38.816367673s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:53:44.385289916 (211h27m38.816370037s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:53:44.706747386 (211h27m39.137827517s) [upload=219937]: Done uploading segments... Aug 17 12:53:44.706771211 (211h27m39.137851342s) [upload=219937]: Upload finished. err: <nil>
Duration: 2.41348021s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X..............................X......X..] duration:
5.793037356s
FAIL (2025-08-17 12:56:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 12:54:14.636124650 (211h28m9.067204781s) [upload=219945]: Starting upload
Aug 17 12:54:14.636163314 (211h28m9.067243435s) [upload=219945]: Done starting upload
Aug 17 12:54:14.636335844 (211h28m9.067415965s) [upload=219945]: Uploading segments...
Aug 17 12:54:14.636427580 (211h28m9.067507711s) [upload=219945]: Got next segment. Inline: false
Aug 17 12:54:14.636455363 (211h28m9.067535484s) [upload=219945]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:54:14.636459851 (211h28m9.067539982s) [upload=219945]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:54:15.105209506 (211h28m9.536289637s) [seg_pos={0 0}, upload=219945]: Begin upload segment...
Aug 17 12:54:15.105255484 (211h28m9.536335615s) [seg_pos={0 0}, upload=219945]: Done begin upload segment.
Aug 17 12:54:15.105267327 (211h28m9.536347458s) [noise=true , address=104.36.82.2:4751 , piece_id=TPN4P2Y55WKRLF72KAJEU2OCGQFZCLOUESNI2767U6QYWKPW3J2Q, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.105274019 (211h28m9.53635415s) [noise=true , address=79.127.201.215:4345 , piece_id=OIBQDO7DL3CHJ72YLZH5YB67IFOU6TE55O65G2DRO7NJXI736STA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.105702590 (211h28m9.536782721s) [noise=true , address=104.36.82.23:4479 , piece_id=CHJDLFTOAHSXCKRG7ID4TH3C7WVVM7RSWFPXJAKREN5KMCZIDVWQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.106020999 (211h28m9.53710113s) [noise=true , address=104.36.82.59:4307 , piece_id=U4YDY73ED6YKOHASJUMSFQKGEXX2KOCIPDDF35VP37KU44HLGZ2Q, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.106322175 (211h28m9.537402307s) [noise=true , address=77.90.31.21:4894 , piece_id=53MRE7J2MTS7I4KKLMBCNVXJMOBUIQ3EIQDNYQT6IZLNHHSTAAYA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.106627500 (211h28m9.537707631s) [noise=true , address=66.23.193.175:4563 , piece_id=GM6Z4X5UD5YR7AOTTPEVCWDS2CTEOHWKD6VQOM7N3IJDISFQ4JKA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.106894570 (211h28m9.537974691s) [noise=true , address=104.36.82.40:4949 , piece_id=KV2THBL4HP2B4WJ6KMKZKWI4CGEDZEZOEEGRAZQRXZZNMRAKEB5Q, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.107173775 (211h28m9.538253906s) [noise=true , address=77.90.31.19:4872 , piece_id=D7R2UQ43XSAXHAOSE47MKDPCE2VUIRYWMNZLT6XB3QNSQWW2SPWA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.107407812 (211h28m9.538487943s) [noise=true , address=104.36.82.5:4856 , piece_id=ORL5ZCC2ACJII7OVX2O2DJ2VKE3KR2DGVBYM4QYXRG6ORHJ7NMEA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.107643904 (211h28m9.538724035s) [noise=true , address=77.90.31.13:4648 , piece_id=FH4GZODRXG6ZXPQGTIFPBITHYCVTNGYBZ6M6G3Q4K6PIHRW6MIBQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.107896307 (211h28m9.538976438s) [noise=true , address=104.36.82.10:4101 , piece_id=RFSWR7FGU5QDCM4YUNOFYGWUVO6Q6WMZFNQMIDNAZ66BZ7GIUXRA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.108116719 (211h28m9.53919685s) [noise=true , address=77.90.31.12:4609 , piece_id=IQ7VOWQ76MHQS42PSZSEUSB64SL6FRG7PA3OL7XRV25GDLX43LPA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.108439837 (211h28m9.539519968s) [noise=true , address=104.36.82.60:4341 , piece_id=FKJCU3INXF2MFVWCKZMZ7UYN6LMI4IZ5K5E4W6465CONVJXNUSNQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.108673884 (211h28m9.539754016s) [noise=true , address=104.36.82.8:4004 , piece_id=PZ32SXCWAEEMTC6OQ3KEXPCEGR6GCU4WNYYYGD4MQ7W2UZVIU6JA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.108911289 (211h28m9.53999141s) [noise=true , address=45.91.116.7:4033 , piece_id=TRXYTBWVCIOQXAY7ZGGM2W5P367WP4JK4MRXW7VA2H3VCWVUXPVQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.109163341 (211h28m9.540243472s) [noise=true , address=104.36.82.19:4403 , piece_id=EUGKIW43EMHTFEGTSZB5UQVA3CW57ILCFGA5I4KFGDDEAKLYNWRQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.109377481 (211h28m9.540457612s) [noise=true , address=104.36.82.12:4169 , piece_id=TDFZVAK2TAIQRXK4UCWQ3ENTRIKSIW6NZ7JHMSKQMJM263UQ4KMQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.109587022 (211h28m9.540667153s) [noise=true , address=104.36.82.9:4025 , piece_id=Y7DKBO2IKDCRVWQMIGBDQT6C333ASTZOU7LOYVNWDDSGEHDSPWRA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:16.321189204 (211h28m10.752269335s) [upload=219945]: Next returned nil segment
Aug 17 12:54:16.321206588 (211h28m10.752286719s) [upload=219945]: Waiting for error group managing segments...
Aug 17 12:54:16.624404260 (211h28m11.055484381s) [noise=true , address=66.23.193.175:4563 , piece_id=GM6Z4X5UD5YR7AOTTPEVCWDS2CTEOHWKD6VQOM7N3IJDISFQ4JKA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.016024217 (211h28m11.447104348s) [noise=true , address=104.36.82.40:4949 , piece_id=KV2THBL4HP2B4WJ6KMKZKWI4CGEDZEZOEEGRAZQRXZZNMRAKEB5Q, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.016185696 (211h28m11.447265827s) [noise=true , address=104.36.82.10:4101 , piece_id=RFSWR7FGU5QDCM4YUNOFYGWUVO6Q6WMZFNQMIDNAZ66BZ7GIUXRA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.033065454 (211h28m11.464145585s) [noise=true , address=104.36.82.5:4856 , piece_id=ORL5ZCC2ACJII7OVX2O2DJ2VKE3KR2DGVBYM4QYXRG6ORHJ7NMEA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.036655644 (211h28m11.467735775s) [noise=true , address=77.90.31.12:4609 , piece_id=IQ7VOWQ76MHQS42PSZSEUSB64SL6FRG7PA3OL7XRV25GDLX43LPA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.045487843 (211h28m11.476567974s) [noise=true , address=77.90.31.19:4872 , piece_id=D7R2UQ43XSAXHAOSE47MKDPCE2VUIRYWMNZLT6XB3QNSQWW2SPWA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.061453972 (211h28m11.492534093s) [noise=true , address=45.91.116.7:4033 , piece_id=TRXYTBWVCIOQXAY7ZGGM2W5P367WP4JK4MRXW7VA2H3VCWVUXPVQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.087303652 (211h28m11.518383783s) [noise=true , address=79.127.201.215:4345 , piece_id=OIBQDO7DL3CHJ72YLZH5YB67IFOU6TE55O65G2DRO7NJXI736STA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.110678276 (211h28m11.541758407s) [noise=true , address=104.36.82.8:4004 , piece_id=PZ32SXCWAEEMTC6OQ3KEXPCEGR6GCU4WNYYYGD4MQ7W2UZVIU6JA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.127334736 (211h28m11.558414867s) [noise=true , address=104.36.82.19:4403 , piece_id=EUGKIW43EMHTFEGTSZB5UQVA3CW57ILCFGA5I4KFGDDEAKLYNWRQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.128763399 (211h28m11.55984352s) [noise=true , address=77.90.31.21:4894 , piece_id=53MRE7J2MTS7I4KKLMBCNVXJMOBUIQ3EIQDNYQT6IZLNHHSTAAYA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.144016284 (211h28m11.575096415s) [noise=true , address=104.36.82.9:4025 , piece_id=Y7DKBO2IKDCRVWQMIGBDQT6C333ASTZOU7LOYVNWDDSGEHDSPWRA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.147177843 (211h28m11.578257964s) [noise=true , address=104.36.82.23:4479 , piece_id=CHJDLFTOAHSXCKRG7ID4TH3C7WVVM7RSWFPXJAKREN5KMCZIDVWQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.166975995 (211h28m11.598056126s) [noise=true , address=77.90.31.13:4648 , piece_id=FH4GZODRXG6ZXPQGTIFPBITHYCVTNGYBZ6M6G3Q4K6PIHRW6MIBQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.167000502 (211h28m11.598080633s) [seg_pos={0 0}, upload=219945]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:54:17.167127956 (211h28m11.598208087s) [noise=true , address=104.36.82.12:4169 , piece_id=TDFZVAK2TAIQRXK4UCWQ3ENTRIKSIW6NZ7JHMSKQMJM263UQ4KMQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AcJsPCQkjCgLxMTVcjMC5BpEe9RqzcC4CNC3oJDUt4f8cTbNX): protocol: expected piece hash; context canceled; EOF
Aug 17 12:54:17.167190175 (211h28m11.598270296s) [noise=true , address=104.36.82.2:4751 , piece_id=TPN4P2Y55WKRLF72KAJEU2OCGQFZCLOUESNI2767U6QYWKPW3J2Q, seg_pos={0 0}, upload=219945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rJkr2qSmcxGv7smeBBLwVjLoWz3Wsd7CvWWc3B7mzP5dBG3Uz): protocol: expected piece hash; context canceled; EOF
Aug 17 12:54:17.167246653 (211h28m11.598326784s) [noise=true , address=104.36.82.59:4307 , piece_id=U4YDY73ED6YKOHASJUMSFQKGEXX2KOCIPDDF35VP37KU44HLGZ2Q, seg_pos={0 0}, upload=219945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 17 12:54:17.167267423 (211h28m11.598347544s) [noise=true , address=104.36.82.60:4341 , piece_id=FKJCU3INXF2MFVWCKZMZ7UYN6LMI4IZ5K5E4W6465CONVJXNUSNQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 17 12:54:17.167310214 (211h28m11.598390345s) [seg_pos={0 0}, upload=219945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:54:17.167404886 (211h28m11.598485017s) [upload=219945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:54:17.167409985 (211h28m11.598490106s) [upload=219945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:54:17.494489312 (211h28m11.925569443s) [upload=219945]: Done uploading segments...
Aug 17 12:54:17.494507607 (211h28m11.925587738s) [upload=219945]: Upload finished. err: <nil>
Duration: 5.793062885s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.875812289s
FAIL (2025-08-17 12:55:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 12:53:44.385081367 (211h27m38.816161508s) [upload=219937]: Starting upload Aug 17 12:53:44.385129850 (211h27m38.816209971s) [upload=219937]: Done starting upload Aug 17 12:53:44.385181509 (211h27m38.81626169s) [upload=219937]: Uploading segments... Aug 17 12:53:44.385241984 (211h27m38.816322135s) [upload=219937]: Got next segment. Inline: true Aug 17 12:53:44.385248046 (211h27m38.816328167s) [upload=219937]: Waiting for error group managing segments... Aug 17 12:53:44.385283563 (211h27m38.816363695s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:53:44.385287542 (211h27m38.816367673s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:53:44.385289916 (211h27m38.816370037s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:53:44.706747386 (211h27m39.137827517s) [upload=219937]: Done uploading segments... Aug 17 12:53:44.706771211 (211h27m39.137851342s) [upload=219937]: Upload finished. err: <nil>
Duration: 1.875848479s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X..............................X......X.] duration:
5.93730814s
FAIL (2025-08-17 12:55:05 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 12:54:14.636124650 (211h28m9.067204781s) [upload=219945]: Starting upload
Aug 17 12:54:14.636163314 (211h28m9.067243435s) [upload=219945]: Done starting upload
Aug 17 12:54:14.636335844 (211h28m9.067415965s) [upload=219945]: Uploading segments...
Aug 17 12:54:14.636427580 (211h28m9.067507711s) [upload=219945]: Got next segment. Inline: false
Aug 17 12:54:14.636455363 (211h28m9.067535484s) [upload=219945]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:54:14.636459851 (211h28m9.067539982s) [upload=219945]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:54:15.105209506 (211h28m9.536289637s) [seg_pos={0 0}, upload=219945]: Begin upload segment...
Aug 17 12:54:15.105255484 (211h28m9.536335615s) [seg_pos={0 0}, upload=219945]: Done begin upload segment.
Aug 17 12:54:15.105267327 (211h28m9.536347458s) [noise=true , address=104.36.82.2:4751 , piece_id=TPN4P2Y55WKRLF72KAJEU2OCGQFZCLOUESNI2767U6QYWKPW3J2Q, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.105274019 (211h28m9.53635415s) [noise=true , address=79.127.201.215:4345 , piece_id=OIBQDO7DL3CHJ72YLZH5YB67IFOU6TE55O65G2DRO7NJXI736STA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.105702590 (211h28m9.536782721s) [noise=true , address=104.36.82.23:4479 , piece_id=CHJDLFTOAHSXCKRG7ID4TH3C7WVVM7RSWFPXJAKREN5KMCZIDVWQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.106020999 (211h28m9.53710113s) [noise=true , address=104.36.82.59:4307 , piece_id=U4YDY73ED6YKOHASJUMSFQKGEXX2KOCIPDDF35VP37KU44HLGZ2Q, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.106322175 (211h28m9.537402307s) [noise=true , address=77.90.31.21:4894 , piece_id=53MRE7J2MTS7I4KKLMBCNVXJMOBUIQ3EIQDNYQT6IZLNHHSTAAYA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.106627500 (211h28m9.537707631s) [noise=true , address=66.23.193.175:4563 , piece_id=GM6Z4X5UD5YR7AOTTPEVCWDS2CTEOHWKD6VQOM7N3IJDISFQ4JKA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.106894570 (211h28m9.537974691s) [noise=true , address=104.36.82.40:4949 , piece_id=KV2THBL4HP2B4WJ6KMKZKWI4CGEDZEZOEEGRAZQRXZZNMRAKEB5Q, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.107173775 (211h28m9.538253906s) [noise=true , address=77.90.31.19:4872 , piece_id=D7R2UQ43XSAXHAOSE47MKDPCE2VUIRYWMNZLT6XB3QNSQWW2SPWA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.107407812 (211h28m9.538487943s) [noise=true , address=104.36.82.5:4856 , piece_id=ORL5ZCC2ACJII7OVX2O2DJ2VKE3KR2DGVBYM4QYXRG6ORHJ7NMEA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.107643904 (211h28m9.538724035s) [noise=true , address=77.90.31.13:4648 , piece_id=FH4GZODRXG6ZXPQGTIFPBITHYCVTNGYBZ6M6G3Q4K6PIHRW6MIBQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.107896307 (211h28m9.538976438s) [noise=true , address=104.36.82.10:4101 , piece_id=RFSWR7FGU5QDCM4YUNOFYGWUVO6Q6WMZFNQMIDNAZ66BZ7GIUXRA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.108116719 (211h28m9.53919685s) [noise=true , address=77.90.31.12:4609 , piece_id=IQ7VOWQ76MHQS42PSZSEUSB64SL6FRG7PA3OL7XRV25GDLX43LPA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.108439837 (211h28m9.539519968s) [noise=true , address=104.36.82.60:4341 , piece_id=FKJCU3INXF2MFVWCKZMZ7UYN6LMI4IZ5K5E4W6465CONVJXNUSNQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.108673884 (211h28m9.539754016s) [noise=true , address=104.36.82.8:4004 , piece_id=PZ32SXCWAEEMTC6OQ3KEXPCEGR6GCU4WNYYYGD4MQ7W2UZVIU6JA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.108911289 (211h28m9.53999141s) [noise=true , address=45.91.116.7:4033 , piece_id=TRXYTBWVCIOQXAY7ZGGM2W5P367WP4JK4MRXW7VA2H3VCWVUXPVQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.109163341 (211h28m9.540243472s) [noise=true , address=104.36.82.19:4403 , piece_id=EUGKIW43EMHTFEGTSZB5UQVA3CW57ILCFGA5I4KFGDDEAKLYNWRQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.109377481 (211h28m9.540457612s) [noise=true , address=104.36.82.12:4169 , piece_id=TDFZVAK2TAIQRXK4UCWQ3ENTRIKSIW6NZ7JHMSKQMJM263UQ4KMQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.109587022 (211h28m9.540667153s) [noise=true , address=104.36.82.9:4025 , piece_id=Y7DKBO2IKDCRVWQMIGBDQT6C333ASTZOU7LOYVNWDDSGEHDSPWRA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:16.321189204 (211h28m10.752269335s) [upload=219945]: Next returned nil segment
Aug 17 12:54:16.321206588 (211h28m10.752286719s) [upload=219945]: Waiting for error group managing segments...
Aug 17 12:54:16.624404260 (211h28m11.055484381s) [noise=true , address=66.23.193.175:4563 , piece_id=GM6Z4X5UD5YR7AOTTPEVCWDS2CTEOHWKD6VQOM7N3IJDISFQ4JKA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.016024217 (211h28m11.447104348s) [noise=true , address=104.36.82.40:4949 , piece_id=KV2THBL4HP2B4WJ6KMKZKWI4CGEDZEZOEEGRAZQRXZZNMRAKEB5Q, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.016185696 (211h28m11.447265827s) [noise=true , address=104.36.82.10:4101 , piece_id=RFSWR7FGU5QDCM4YUNOFYGWUVO6Q6WMZFNQMIDNAZ66BZ7GIUXRA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.033065454 (211h28m11.464145585s) [noise=true , address=104.36.82.5:4856 , piece_id=ORL5ZCC2ACJII7OVX2O2DJ2VKE3KR2DGVBYM4QYXRG6ORHJ7NMEA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.036655644 (211h28m11.467735775s) [noise=true , address=77.90.31.12:4609 , piece_id=IQ7VOWQ76MHQS42PSZSEUSB64SL6FRG7PA3OL7XRV25GDLX43LPA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.045487843 (211h28m11.476567974s) [noise=true , address=77.90.31.19:4872 , piece_id=D7R2UQ43XSAXHAOSE47MKDPCE2VUIRYWMNZLT6XB3QNSQWW2SPWA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.061453972 (211h28m11.492534093s) [noise=true , address=45.91.116.7:4033 , piece_id=TRXYTBWVCIOQXAY7ZGGM2W5P367WP4JK4MRXW7VA2H3VCWVUXPVQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.087303652 (211h28m11.518383783s) [noise=true , address=79.127.201.215:4345 , piece_id=OIBQDO7DL3CHJ72YLZH5YB67IFOU6TE55O65G2DRO7NJXI736STA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.110678276 (211h28m11.541758407s) [noise=true , address=104.36.82.8:4004 , piece_id=PZ32SXCWAEEMTC6OQ3KEXPCEGR6GCU4WNYYYGD4MQ7W2UZVIU6JA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.127334736 (211h28m11.558414867s) [noise=true , address=104.36.82.19:4403 , piece_id=EUGKIW43EMHTFEGTSZB5UQVA3CW57ILCFGA5I4KFGDDEAKLYNWRQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.128763399 (211h28m11.55984352s) [noise=true , address=77.90.31.21:4894 , piece_id=53MRE7J2MTS7I4KKLMBCNVXJMOBUIQ3EIQDNYQT6IZLNHHSTAAYA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.144016284 (211h28m11.575096415s) [noise=true , address=104.36.82.9:4025 , piece_id=Y7DKBO2IKDCRVWQMIGBDQT6C333ASTZOU7LOYVNWDDSGEHDSPWRA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.147177843 (211h28m11.578257964s) [noise=true , address=104.36.82.23:4479 , piece_id=CHJDLFTOAHSXCKRG7ID4TH3C7WVVM7RSWFPXJAKREN5KMCZIDVWQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.166975995 (211h28m11.598056126s) [noise=true , address=77.90.31.13:4648 , piece_id=FH4GZODRXG6ZXPQGTIFPBITHYCVTNGYBZ6M6G3Q4K6PIHRW6MIBQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.167000502 (211h28m11.598080633s) [seg_pos={0 0}, upload=219945]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:54:17.167127956 (211h28m11.598208087s) [noise=true , address=104.36.82.12:4169 , piece_id=TDFZVAK2TAIQRXK4UCWQ3ENTRIKSIW6NZ7JHMSKQMJM263UQ4KMQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AcJsPCQkjCgLxMTVcjMC5BpEe9RqzcC4CNC3oJDUt4f8cTbNX): protocol: expected piece hash; context canceled; EOF
Aug 17 12:54:17.167190175 (211h28m11.598270296s) [noise=true , address=104.36.82.2:4751 , piece_id=TPN4P2Y55WKRLF72KAJEU2OCGQFZCLOUESNI2767U6QYWKPW3J2Q, seg_pos={0 0}, upload=219945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rJkr2qSmcxGv7smeBBLwVjLoWz3Wsd7CvWWc3B7mzP5dBG3Uz): protocol: expected piece hash; context canceled; EOF
Aug 17 12:54:17.167246653 (211h28m11.598326784s) [noise=true , address=104.36.82.59:4307 , piece_id=U4YDY73ED6YKOHASJUMSFQKGEXX2KOCIPDDF35VP37KU44HLGZ2Q, seg_pos={0 0}, upload=219945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 17 12:54:17.167267423 (211h28m11.598347544s) [noise=true , address=104.36.82.60:4341 , piece_id=FKJCU3INXF2MFVWCKZMZ7UYN6LMI4IZ5K5E4W6465CONVJXNUSNQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 17 12:54:17.167310214 (211h28m11.598390345s) [seg_pos={0 0}, upload=219945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:54:17.167404886 (211h28m11.598485017s) [upload=219945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:54:17.167409985 (211h28m11.598490106s) [upload=219945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:54:17.494489312 (211h28m11.925569443s) [upload=219945]: Done uploading segments...
Aug 17 12:54:17.494507607 (211h28m11.925587738s) [upload=219945]: Upload finished. err: <nil>
Duration: 5.937326466s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.969955861s
FAIL (2025-08-17 12:54:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 12:53:44.385081367 (211h27m38.816161508s) [upload=219937]: Starting upload Aug 17 12:53:44.385129850 (211h27m38.816209971s) [upload=219937]: Done starting upload Aug 17 12:53:44.385181509 (211h27m38.81626169s) [upload=219937]: Uploading segments... Aug 17 12:53:44.385241984 (211h27m38.816322135s) [upload=219937]: Got next segment. Inline: true Aug 17 12:53:44.385248046 (211h27m38.816328167s) [upload=219937]: Waiting for error group managing segments... Aug 17 12:53:44.385283563 (211h27m38.816363695s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:53:44.385287542 (211h27m38.816367673s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:53:44.385289916 (211h27m38.816370037s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:53:44.706747386 (211h27m39.137827517s) [upload=219937]: Done uploading segments... Aug 17 12:53:44.706771211 (211h27m39.137851342s) [upload=219937]: Upload finished. err: <nil>
Duration: 1.969985838s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.961618719s
FAIL (2025-08-17 12:54:22 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 12:53:44.385081367 (211h27m38.816161508s) [upload=219937]: Starting upload Aug 17 12:53:44.385129850 (211h27m38.816209971s) [upload=219937]: Done starting upload Aug 17 12:53:44.385181509 (211h27m38.81626169s) [upload=219937]: Uploading segments... Aug 17 12:53:44.385241984 (211h27m38.816322135s) [upload=219937]: Got next segment. Inline: true Aug 17 12:53:44.385248046 (211h27m38.816328167s) [upload=219937]: Waiting for error group managing segments... Aug 17 12:53:44.385283563 (211h27m38.816363695s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:53:44.385287542 (211h27m38.816367673s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:53:44.385289916 (211h27m38.816370037s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:53:44.706747386 (211h27m39.137827517s) [upload=219937]: Done uploading segments... Aug 17 12:53:44.706771211 (211h27m39.137851342s) [upload=219937]: Upload finished. err: <nil>
Duration: 1.961661151s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X..............................X......X] duration:
4.26643687s
FAIL (2025-08-17 12:54:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 17 12:54:14.636124650 (211h28m9.067204781s) [upload=219945]: Starting upload
Aug 17 12:54:14.636163314 (211h28m9.067243435s) [upload=219945]: Done starting upload
Aug 17 12:54:14.636335844 (211h28m9.067415965s) [upload=219945]: Uploading segments...
Aug 17 12:54:14.636427580 (211h28m9.067507711s) [upload=219945]: Got next segment. Inline: false
Aug 17 12:54:14.636455363 (211h28m9.067535484s) [upload=219945]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:54:14.636459851 (211h28m9.067539982s) [upload=219945]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:54:15.105209506 (211h28m9.536289637s) [seg_pos={0 0}, upload=219945]: Begin upload segment...
Aug 17 12:54:15.105255484 (211h28m9.536335615s) [seg_pos={0 0}, upload=219945]: Done begin upload segment.
Aug 17 12:54:15.105267327 (211h28m9.536347458s) [noise=true , address=104.36.82.2:4751 , piece_id=TPN4P2Y55WKRLF72KAJEU2OCGQFZCLOUESNI2767U6QYWKPW3J2Q, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.105274019 (211h28m9.53635415s) [noise=true , address=79.127.201.215:4345 , piece_id=OIBQDO7DL3CHJ72YLZH5YB67IFOU6TE55O65G2DRO7NJXI736STA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.105702590 (211h28m9.536782721s) [noise=true , address=104.36.82.23:4479 , piece_id=CHJDLFTOAHSXCKRG7ID4TH3C7WVVM7RSWFPXJAKREN5KMCZIDVWQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.106020999 (211h28m9.53710113s) [noise=true , address=104.36.82.59:4307 , piece_id=U4YDY73ED6YKOHASJUMSFQKGEXX2KOCIPDDF35VP37KU44HLGZ2Q, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.106322175 (211h28m9.537402307s) [noise=true , address=77.90.31.21:4894 , piece_id=53MRE7J2MTS7I4KKLMBCNVXJMOBUIQ3EIQDNYQT6IZLNHHSTAAYA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.106627500 (211h28m9.537707631s) [noise=true , address=66.23.193.175:4563 , piece_id=GM6Z4X5UD5YR7AOTTPEVCWDS2CTEOHWKD6VQOM7N3IJDISFQ4JKA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.106894570 (211h28m9.537974691s) [noise=true , address=104.36.82.40:4949 , piece_id=KV2THBL4HP2B4WJ6KMKZKWI4CGEDZEZOEEGRAZQRXZZNMRAKEB5Q, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.107173775 (211h28m9.538253906s) [noise=true , address=77.90.31.19:4872 , piece_id=D7R2UQ43XSAXHAOSE47MKDPCE2VUIRYWMNZLT6XB3QNSQWW2SPWA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.107407812 (211h28m9.538487943s) [noise=true , address=104.36.82.5:4856 , piece_id=ORL5ZCC2ACJII7OVX2O2DJ2VKE3KR2DGVBYM4QYXRG6ORHJ7NMEA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.107643904 (211h28m9.538724035s) [noise=true , address=77.90.31.13:4648 , piece_id=FH4GZODRXG6ZXPQGTIFPBITHYCVTNGYBZ6M6G3Q4K6PIHRW6MIBQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.107896307 (211h28m9.538976438s) [noise=true , address=104.36.82.10:4101 , piece_id=RFSWR7FGU5QDCM4YUNOFYGWUVO6Q6WMZFNQMIDNAZ66BZ7GIUXRA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.108116719 (211h28m9.53919685s) [noise=true , address=77.90.31.12:4609 , piece_id=IQ7VOWQ76MHQS42PSZSEUSB64SL6FRG7PA3OL7XRV25GDLX43LPA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.108439837 (211h28m9.539519968s) [noise=true , address=104.36.82.60:4341 , piece_id=FKJCU3INXF2MFVWCKZMZ7UYN6LMI4IZ5K5E4W6465CONVJXNUSNQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.108673884 (211h28m9.539754016s) [noise=true , address=104.36.82.8:4004 , piece_id=PZ32SXCWAEEMTC6OQ3KEXPCEGR6GCU4WNYYYGD4MQ7W2UZVIU6JA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.108911289 (211h28m9.53999141s) [noise=true , address=45.91.116.7:4033 , piece_id=TRXYTBWVCIOQXAY7ZGGM2W5P367WP4JK4MRXW7VA2H3VCWVUXPVQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.109163341 (211h28m9.540243472s) [noise=true , address=104.36.82.19:4403 , piece_id=EUGKIW43EMHTFEGTSZB5UQVA3CW57ILCFGA5I4KFGDDEAKLYNWRQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.109377481 (211h28m9.540457612s) [noise=true , address=104.36.82.12:4169 , piece_id=TDFZVAK2TAIQRXK4UCWQ3ENTRIKSIW6NZ7JHMSKQMJM263UQ4KMQ, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:15.109587022 (211h28m9.540667153s) [noise=true , address=104.36.82.9:4025 , piece_id=Y7DKBO2IKDCRVWQMIGBDQT6C333ASTZOU7LOYVNWDDSGEHDSPWRA, seg_pos={0 0}, upload=219945]: Uploading piece...
Aug 17 12:54:16.321189204 (211h28m10.752269335s) [upload=219945]: Next returned nil segment
Aug 17 12:54:16.321206588 (211h28m10.752286719s) [upload=219945]: Waiting for error group managing segments...
Aug 17 12:54:16.624404260 (211h28m11.055484381s) [noise=true , address=66.23.193.175:4563 , piece_id=GM6Z4X5UD5YR7AOTTPEVCWDS2CTEOHWKD6VQOM7N3IJDISFQ4JKA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.016024217 (211h28m11.447104348s) [noise=true , address=104.36.82.40:4949 , piece_id=KV2THBL4HP2B4WJ6KMKZKWI4CGEDZEZOEEGRAZQRXZZNMRAKEB5Q, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.016185696 (211h28m11.447265827s) [noise=true , address=104.36.82.10:4101 , piece_id=RFSWR7FGU5QDCM4YUNOFYGWUVO6Q6WMZFNQMIDNAZ66BZ7GIUXRA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.033065454 (211h28m11.464145585s) [noise=true , address=104.36.82.5:4856 , piece_id=ORL5ZCC2ACJII7OVX2O2DJ2VKE3KR2DGVBYM4QYXRG6ORHJ7NMEA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.036655644 (211h28m11.467735775s) [noise=true , address=77.90.31.12:4609 , piece_id=IQ7VOWQ76MHQS42PSZSEUSB64SL6FRG7PA3OL7XRV25GDLX43LPA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.045487843 (211h28m11.476567974s) [noise=true , address=77.90.31.19:4872 , piece_id=D7R2UQ43XSAXHAOSE47MKDPCE2VUIRYWMNZLT6XB3QNSQWW2SPWA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.061453972 (211h28m11.492534093s) [noise=true , address=45.91.116.7:4033 , piece_id=TRXYTBWVCIOQXAY7ZGGM2W5P367WP4JK4MRXW7VA2H3VCWVUXPVQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.087303652 (211h28m11.518383783s) [noise=true , address=79.127.201.215:4345 , piece_id=OIBQDO7DL3CHJ72YLZH5YB67IFOU6TE55O65G2DRO7NJXI736STA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.110678276 (211h28m11.541758407s) [noise=true , address=104.36.82.8:4004 , piece_id=PZ32SXCWAEEMTC6OQ3KEXPCEGR6GCU4WNYYYGD4MQ7W2UZVIU6JA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.127334736 (211h28m11.558414867s) [noise=true , address=104.36.82.19:4403 , piece_id=EUGKIW43EMHTFEGTSZB5UQVA3CW57ILCFGA5I4KFGDDEAKLYNWRQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.128763399 (211h28m11.55984352s) [noise=true , address=77.90.31.21:4894 , piece_id=53MRE7J2MTS7I4KKLMBCNVXJMOBUIQ3EIQDNYQT6IZLNHHSTAAYA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.144016284 (211h28m11.575096415s) [noise=true , address=104.36.82.9:4025 , piece_id=Y7DKBO2IKDCRVWQMIGBDQT6C333ASTZOU7LOYVNWDDSGEHDSPWRA, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.147177843 (211h28m11.578257964s) [noise=true , address=104.36.82.23:4479 , piece_id=CHJDLFTOAHSXCKRG7ID4TH3C7WVVM7RSWFPXJAKREN5KMCZIDVWQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.166975995 (211h28m11.598056126s) [noise=true , address=77.90.31.13:4648 , piece_id=FH4GZODRXG6ZXPQGTIFPBITHYCVTNGYBZ6M6G3Q4K6PIHRW6MIBQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: <nil>
Aug 17 12:54:17.167000502 (211h28m11.598080633s) [seg_pos={0 0}, upload=219945]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:54:17.167127956 (211h28m11.598208087s) [noise=true , address=104.36.82.12:4169 , piece_id=TDFZVAK2TAIQRXK4UCWQ3ENTRIKSIW6NZ7JHMSKQMJM263UQ4KMQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AcJsPCQkjCgLxMTVcjMC5BpEe9RqzcC4CNC3oJDUt4f8cTbNX): protocol: expected piece hash; context canceled; EOF
Aug 17 12:54:17.167190175 (211h28m11.598270296s) [noise=true , address=104.36.82.2:4751 , piece_id=TPN4P2Y55WKRLF72KAJEU2OCGQFZCLOUESNI2767U6QYWKPW3J2Q, seg_pos={0 0}, upload=219945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rJkr2qSmcxGv7smeBBLwVjLoWz3Wsd7CvWWc3B7mzP5dBG3Uz): protocol: expected piece hash; context canceled; EOF
Aug 17 12:54:17.167246653 (211h28m11.598326784s) [noise=true , address=104.36.82.59:4307 , piece_id=U4YDY73ED6YKOHASJUMSFQKGEXX2KOCIPDDF35VP37KU44HLGZ2Q, seg_pos={0 0}, upload=219945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127F8oKF6GRv6Rdht4BCPt4G9UhVXeWVHKGJRP4WrrkcfDMmApT): protocol: expected piece hash; context canceled; EOF
Aug 17 12:54:17.167267423 (211h28m11.598347544s) [noise=true , address=104.36.82.60:4341 , piece_id=FKJCU3INXF2MFVWCKZMZ7UYN6LMI4IZ5K5E4W6465CONVJXNUSNQ, seg_pos={0 0}, upload=219945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okrDyM4TfzYN3p8zUjTqbw2661rKQQqZdP1ptAKzzTQ82C7cN): protocol: expected piece hash; context canceled; EOF
Aug 17 12:54:17.167310214 (211h28m11.598390345s) [seg_pos={0 0}, upload=219945]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:54:17.167404886 (211h28m11.598485017s) [upload=219945]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:54:17.167409985 (211h28m11.598490106s) [upload=219945]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:54:17.494489312 (211h28m11.925569443s) [upload=219945]: Done uploading segments...
Aug 17 12:54:17.494507607 (211h28m11.925587738s) [upload=219945]: Upload finished. err: <nil>
Duration: 4.266464462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1.497354137s
FAIL (2025-08-17 12:53:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 17 12:53:44.385081367 (211h27m38.816161508s) [upload=219937]: Starting upload Aug 17 12:53:44.385129850 (211h27m38.816209971s) [upload=219937]: Done starting upload Aug 17 12:53:44.385181509 (211h27m38.81626169s) [upload=219937]: Uploading segments... Aug 17 12:53:44.385241984 (211h27m38.816322135s) [upload=219937]: Got next segment. Inline: true Aug 17 12:53:44.385248046 (211h27m38.816328167s) [upload=219937]: Waiting for error group managing segments... Aug 17 12:53:44.385283563 (211h27m38.816363695s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:53:44.385287542 (211h27m38.816367673s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:53:44.385289916 (211h27m38.816370037s) [upload=219937]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:53:44.706747386 (211h27m39.137827517s) [upload=219937]: Done uploading segments... Aug 17 12:53:44.706771211 (211h27m39.137851342s) [upload=219937]: Upload finished. err: <nil>
Duration: 1.497382552s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X..............................X......] duration:
5.895688167s
FAIL (2025-08-17 12:53:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1399fc4536ca16926e32e7bf2c2badd0596203ae10986aa416b86b23f752988f != before 671413ef0c49d08abc8815ea448f79a85d58f19b3ddeaf6d2a52f995ab429586
======LOGS======
Aug 17 12:48:59.338926527 (211h22m53.770006658s) [upload=219856]: Starting upload
Aug 17 12:48:59.338998545 (211h22m53.770078666s) [upload=219856]: Done starting upload
Aug 17 12:48:59.339091643 (211h22m53.770171774s) [upload=219856]: Uploading segments...
Aug 17 12:48:59.339205040 (211h22m53.770285161s) [upload=219856]: Got next segment. Inline: false
Aug 17 12:48:59.339233935 (211h22m53.770314066s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:48:59.339238494 (211h22m53.770318625s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:48:59.792012791 (211h22m54.223092972s) [seg_pos={0 0}, upload=219856]: Begin upload segment...
Aug 17 12:48:59.792067756 (211h22m54.223147877s) [seg_pos={0 0}, upload=219856]: Done begin upload segment.
Aug 17 12:48:59.792103335 (211h22m54.223183626s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792150955 (211h22m54.223231086s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792534739 (211h22m54.223614871s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792639320 (211h22m54.223719441s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792932521 (211h22m54.224012652s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792941668 (211h22m54.224021789s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793220431 (211h22m54.224300563s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793389987 (211h22m54.224470118s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793739905 (211h22m54.224820026s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794120764 (211h22m54.225200895s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794374339 (211h22m54.22545449s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794615581 (211h22m54.225695712s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794882863 (211h22m54.225962994s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795118173 (211h22m54.226198304s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795434578 (211h22m54.226514709s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795705126 (211h22m54.226785247s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795936508 (211h22m54.227016639s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.796134738 (211h22m54.227214859s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:49:00.966553166 (211h22m55.397633297s) [upload=219856]: Next returned nil segment
Aug 17 12:49:00.966570840 (211h22m55.397650961s) [upload=219856]: Waiting for error group managing segments...
Aug 17 12:49:01.273716496 (211h22m55.704796627s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.717690875 (211h22m56.148771006s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.719311826 (211h22m56.150391957s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.730446992 (211h22m56.161527123s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.773187100 (211h22m56.204267241s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.790053271 (211h22m56.221133412s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.793522348 (211h22m56.22460248s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.808845849 (211h22m56.23992598s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.809657812 (211h22m56.240737953s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.814856199 (211h22m56.24593634s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.828320931 (211h22m56.259401062s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.871317750 (211h22m56.302397881s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.873258053 (211h22m56.304338194s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894803607 (211h22m56.325883738s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894839566 (211h22m56.325919707s) [seg_pos={0 0}, upload=219856]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:49:01.894988481 (211h22m56.326068612s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1afoGj5ZD9twztzCN957MdgkWwydWT3pkGkXXtStw3P6hZBoqK): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895072743 (211h22m56.326152874s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895159759 (211h22m56.32623989s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895209995 (211h22m56.326290126s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123zeRoJ5g7juzsV7qQeNacC5BB7jZpfDBnznFhySGWfyPGJ4oa): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895226236 (211h22m56.326306367s) [seg_pos={0 0}, upload=219856]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:49:01.895304385 (211h22m56.326384516s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:49:01.895310256 (211h22m56.326390397s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:49:02.199248463 (211h22m56.630328605s) [upload=219856]: Done uploading segments...
Aug 17 12:49:02.199273301 (211h22m56.630353442s) [upload=219856]: Upload finished. err: <nil>
Duration: 5.895713886s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X..............................X.....] duration:
5.829679105s
FAIL (2025-08-17 12:52:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1399fc4536ca16926e32e7bf2c2badd0596203ae10986aa416b86b23f752988f != before 671413ef0c49d08abc8815ea448f79a85d58f19b3ddeaf6d2a52f995ab429586
======LOGS======
Aug 17 12:48:59.338926527 (211h22m53.770006658s) [upload=219856]: Starting upload
Aug 17 12:48:59.338998545 (211h22m53.770078666s) [upload=219856]: Done starting upload
Aug 17 12:48:59.339091643 (211h22m53.770171774s) [upload=219856]: Uploading segments...
Aug 17 12:48:59.339205040 (211h22m53.770285161s) [upload=219856]: Got next segment. Inline: false
Aug 17 12:48:59.339233935 (211h22m53.770314066s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:48:59.339238494 (211h22m53.770318625s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:48:59.792012791 (211h22m54.223092972s) [seg_pos={0 0}, upload=219856]: Begin upload segment...
Aug 17 12:48:59.792067756 (211h22m54.223147877s) [seg_pos={0 0}, upload=219856]: Done begin upload segment.
Aug 17 12:48:59.792103335 (211h22m54.223183626s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792150955 (211h22m54.223231086s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792534739 (211h22m54.223614871s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792639320 (211h22m54.223719441s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792932521 (211h22m54.224012652s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792941668 (211h22m54.224021789s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793220431 (211h22m54.224300563s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793389987 (211h22m54.224470118s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793739905 (211h22m54.224820026s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794120764 (211h22m54.225200895s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794374339 (211h22m54.22545449s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794615581 (211h22m54.225695712s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794882863 (211h22m54.225962994s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795118173 (211h22m54.226198304s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795434578 (211h22m54.226514709s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795705126 (211h22m54.226785247s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795936508 (211h22m54.227016639s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.796134738 (211h22m54.227214859s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:49:00.966553166 (211h22m55.397633297s) [upload=219856]: Next returned nil segment
Aug 17 12:49:00.966570840 (211h22m55.397650961s) [upload=219856]: Waiting for error group managing segments...
Aug 17 12:49:01.273716496 (211h22m55.704796627s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.717690875 (211h22m56.148771006s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.719311826 (211h22m56.150391957s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.730446992 (211h22m56.161527123s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.773187100 (211h22m56.204267241s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.790053271 (211h22m56.221133412s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.793522348 (211h22m56.22460248s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.808845849 (211h22m56.23992598s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.809657812 (211h22m56.240737953s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.814856199 (211h22m56.24593634s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.828320931 (211h22m56.259401062s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.871317750 (211h22m56.302397881s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.873258053 (211h22m56.304338194s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894803607 (211h22m56.325883738s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894839566 (211h22m56.325919707s) [seg_pos={0 0}, upload=219856]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:49:01.894988481 (211h22m56.326068612s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1afoGj5ZD9twztzCN957MdgkWwydWT3pkGkXXtStw3P6hZBoqK): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895072743 (211h22m56.326152874s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895159759 (211h22m56.32623989s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895209995 (211h22m56.326290126s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123zeRoJ5g7juzsV7qQeNacC5BB7jZpfDBnznFhySGWfyPGJ4oa): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895226236 (211h22m56.326306367s) [seg_pos={0 0}, upload=219856]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:49:01.895304385 (211h22m56.326384516s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:49:01.895310256 (211h22m56.326390397s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:49:02.199248463 (211h22m56.630328605s) [upload=219856]: Done uploading segments...
Aug 17 12:49:02.199273301 (211h22m56.630353442s) [upload=219856]: Upload finished. err: <nil>
Duration: 5.82970819s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X..............................X....] duration:
5.762569197s
FAIL (2025-08-17 12:52:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1399fc4536ca16926e32e7bf2c2badd0596203ae10986aa416b86b23f752988f != before 671413ef0c49d08abc8815ea448f79a85d58f19b3ddeaf6d2a52f995ab429586
======LOGS======
Aug 17 12:48:59.338926527 (211h22m53.770006658s) [upload=219856]: Starting upload
Aug 17 12:48:59.338998545 (211h22m53.770078666s) [upload=219856]: Done starting upload
Aug 17 12:48:59.339091643 (211h22m53.770171774s) [upload=219856]: Uploading segments...
Aug 17 12:48:59.339205040 (211h22m53.770285161s) [upload=219856]: Got next segment. Inline: false
Aug 17 12:48:59.339233935 (211h22m53.770314066s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:48:59.339238494 (211h22m53.770318625s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:48:59.792012791 (211h22m54.223092972s) [seg_pos={0 0}, upload=219856]: Begin upload segment...
Aug 17 12:48:59.792067756 (211h22m54.223147877s) [seg_pos={0 0}, upload=219856]: Done begin upload segment.
Aug 17 12:48:59.792103335 (211h22m54.223183626s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792150955 (211h22m54.223231086s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792534739 (211h22m54.223614871s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792639320 (211h22m54.223719441s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792932521 (211h22m54.224012652s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792941668 (211h22m54.224021789s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793220431 (211h22m54.224300563s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793389987 (211h22m54.224470118s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793739905 (211h22m54.224820026s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794120764 (211h22m54.225200895s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794374339 (211h22m54.22545449s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794615581 (211h22m54.225695712s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794882863 (211h22m54.225962994s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795118173 (211h22m54.226198304s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795434578 (211h22m54.226514709s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795705126 (211h22m54.226785247s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795936508 (211h22m54.227016639s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.796134738 (211h22m54.227214859s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:49:00.966553166 (211h22m55.397633297s) [upload=219856]: Next returned nil segment
Aug 17 12:49:00.966570840 (211h22m55.397650961s) [upload=219856]: Waiting for error group managing segments...
Aug 17 12:49:01.273716496 (211h22m55.704796627s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.717690875 (211h22m56.148771006s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.719311826 (211h22m56.150391957s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.730446992 (211h22m56.161527123s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.773187100 (211h22m56.204267241s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.790053271 (211h22m56.221133412s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.793522348 (211h22m56.22460248s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.808845849 (211h22m56.23992598s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.809657812 (211h22m56.240737953s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.814856199 (211h22m56.24593634s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.828320931 (211h22m56.259401062s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.871317750 (211h22m56.302397881s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.873258053 (211h22m56.304338194s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894803607 (211h22m56.325883738s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894839566 (211h22m56.325919707s) [seg_pos={0 0}, upload=219856]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:49:01.894988481 (211h22m56.326068612s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1afoGj5ZD9twztzCN957MdgkWwydWT3pkGkXXtStw3P6hZBoqK): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895072743 (211h22m56.326152874s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895159759 (211h22m56.32623989s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895209995 (211h22m56.326290126s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123zeRoJ5g7juzsV7qQeNacC5BB7jZpfDBnznFhySGWfyPGJ4oa): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895226236 (211h22m56.326306367s) [seg_pos={0 0}, upload=219856]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:49:01.895304385 (211h22m56.326384516s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:49:01.895310256 (211h22m56.326390397s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:49:02.199248463 (211h22m56.630328605s) [upload=219856]: Done uploading segments...
Aug 17 12:49:02.199273301 (211h22m56.630353442s) [upload=219856]: Upload finished. err: <nil>
Duration: 5.762596339s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X........................X..............................X...] duration:
5.953228342s
FAIL (2025-08-17 12:51:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1399fc4536ca16926e32e7bf2c2badd0596203ae10986aa416b86b23f752988f != before 671413ef0c49d08abc8815ea448f79a85d58f19b3ddeaf6d2a52f995ab429586
======LOGS======
Aug 17 12:48:59.338926527 (211h22m53.770006658s) [upload=219856]: Starting upload
Aug 17 12:48:59.338998545 (211h22m53.770078666s) [upload=219856]: Done starting upload
Aug 17 12:48:59.339091643 (211h22m53.770171774s) [upload=219856]: Uploading segments...
Aug 17 12:48:59.339205040 (211h22m53.770285161s) [upload=219856]: Got next segment. Inline: false
Aug 17 12:48:59.339233935 (211h22m53.770314066s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:48:59.339238494 (211h22m53.770318625s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:48:59.792012791 (211h22m54.223092972s) [seg_pos={0 0}, upload=219856]: Begin upload segment...
Aug 17 12:48:59.792067756 (211h22m54.223147877s) [seg_pos={0 0}, upload=219856]: Done begin upload segment.
Aug 17 12:48:59.792103335 (211h22m54.223183626s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792150955 (211h22m54.223231086s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792534739 (211h22m54.223614871s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792639320 (211h22m54.223719441s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792932521 (211h22m54.224012652s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792941668 (211h22m54.224021789s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793220431 (211h22m54.224300563s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793389987 (211h22m54.224470118s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793739905 (211h22m54.224820026s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794120764 (211h22m54.225200895s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794374339 (211h22m54.22545449s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794615581 (211h22m54.225695712s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794882863 (211h22m54.225962994s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795118173 (211h22m54.226198304s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795434578 (211h22m54.226514709s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795705126 (211h22m54.226785247s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795936508 (211h22m54.227016639s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.796134738 (211h22m54.227214859s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:49:00.966553166 (211h22m55.397633297s) [upload=219856]: Next returned nil segment
Aug 17 12:49:00.966570840 (211h22m55.397650961s) [upload=219856]: Waiting for error group managing segments...
Aug 17 12:49:01.273716496 (211h22m55.704796627s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.717690875 (211h22m56.148771006s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.719311826 (211h22m56.150391957s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.730446992 (211h22m56.161527123s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.773187100 (211h22m56.204267241s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.790053271 (211h22m56.221133412s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.793522348 (211h22m56.22460248s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.808845849 (211h22m56.23992598s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.809657812 (211h22m56.240737953s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.814856199 (211h22m56.24593634s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.828320931 (211h22m56.259401062s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.871317750 (211h22m56.302397881s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.873258053 (211h22m56.304338194s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894803607 (211h22m56.325883738s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894839566 (211h22m56.325919707s) [seg_pos={0 0}, upload=219856]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:49:01.894988481 (211h22m56.326068612s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1afoGj5ZD9twztzCN957MdgkWwydWT3pkGkXXtStw3P6hZBoqK): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895072743 (211h22m56.326152874s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895159759 (211h22m56.32623989s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895209995 (211h22m56.326290126s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123zeRoJ5g7juzsV7qQeNacC5BB7jZpfDBnznFhySGWfyPGJ4oa): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895226236 (211h22m56.326306367s) [seg_pos={0 0}, upload=219856]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:49:01.895304385 (211h22m56.326384516s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:49:01.895310256 (211h22m56.326390397s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:49:02.199248463 (211h22m56.630328605s) [upload=219856]: Done uploading segments...
Aug 17 12:49:02.199273301 (211h22m56.630353442s) [upload=219856]: Upload finished. err: <nil>
Duration: 5.953256344s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X........................X..............................X..] duration:
5.805081737s
FAIL (2025-08-17 12:50:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1399fc4536ca16926e32e7bf2c2badd0596203ae10986aa416b86b23f752988f != before 671413ef0c49d08abc8815ea448f79a85d58f19b3ddeaf6d2a52f995ab429586
======LOGS======
Aug 17 12:48:59.338926527 (211h22m53.770006658s) [upload=219856]: Starting upload
Aug 17 12:48:59.338998545 (211h22m53.770078666s) [upload=219856]: Done starting upload
Aug 17 12:48:59.339091643 (211h22m53.770171774s) [upload=219856]: Uploading segments...
Aug 17 12:48:59.339205040 (211h22m53.770285161s) [upload=219856]: Got next segment. Inline: false
Aug 17 12:48:59.339233935 (211h22m53.770314066s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:48:59.339238494 (211h22m53.770318625s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:48:59.792012791 (211h22m54.223092972s) [seg_pos={0 0}, upload=219856]: Begin upload segment...
Aug 17 12:48:59.792067756 (211h22m54.223147877s) [seg_pos={0 0}, upload=219856]: Done begin upload segment.
Aug 17 12:48:59.792103335 (211h22m54.223183626s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792150955 (211h22m54.223231086s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792534739 (211h22m54.223614871s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792639320 (211h22m54.223719441s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792932521 (211h22m54.224012652s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792941668 (211h22m54.224021789s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793220431 (211h22m54.224300563s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793389987 (211h22m54.224470118s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793739905 (211h22m54.224820026s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794120764 (211h22m54.225200895s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794374339 (211h22m54.22545449s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794615581 (211h22m54.225695712s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794882863 (211h22m54.225962994s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795118173 (211h22m54.226198304s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795434578 (211h22m54.226514709s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795705126 (211h22m54.226785247s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795936508 (211h22m54.227016639s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.796134738 (211h22m54.227214859s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:49:00.966553166 (211h22m55.397633297s) [upload=219856]: Next returned nil segment
Aug 17 12:49:00.966570840 (211h22m55.397650961s) [upload=219856]: Waiting for error group managing segments...
Aug 17 12:49:01.273716496 (211h22m55.704796627s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.717690875 (211h22m56.148771006s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.719311826 (211h22m56.150391957s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.730446992 (211h22m56.161527123s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.773187100 (211h22m56.204267241s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.790053271 (211h22m56.221133412s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.793522348 (211h22m56.22460248s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.808845849 (211h22m56.23992598s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.809657812 (211h22m56.240737953s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.814856199 (211h22m56.24593634s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.828320931 (211h22m56.259401062s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.871317750 (211h22m56.302397881s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.873258053 (211h22m56.304338194s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894803607 (211h22m56.325883738s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894839566 (211h22m56.325919707s) [seg_pos={0 0}, upload=219856]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:49:01.894988481 (211h22m56.326068612s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1afoGj5ZD9twztzCN957MdgkWwydWT3pkGkXXtStw3P6hZBoqK): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895072743 (211h22m56.326152874s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895159759 (211h22m56.32623989s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895209995 (211h22m56.326290126s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123zeRoJ5g7juzsV7qQeNacC5BB7jZpfDBnznFhySGWfyPGJ4oa): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895226236 (211h22m56.326306367s) [seg_pos={0 0}, upload=219856]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:49:01.895304385 (211h22m56.326384516s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:49:01.895310256 (211h22m56.326390397s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:49:02.199248463 (211h22m56.630328605s) [upload=219856]: Done uploading segments...
Aug 17 12:49:02.199273301 (211h22m56.630353442s) [upload=219856]: Upload finished. err: <nil>
Duration: 5.805106594s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X........................X..............................X.] duration:
5.804675011s
FAIL (2025-08-17 12:49:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1399fc4536ca16926e32e7bf2c2badd0596203ae10986aa416b86b23f752988f != before 671413ef0c49d08abc8815ea448f79a85d58f19b3ddeaf6d2a52f995ab429586
======LOGS======
Aug 17 12:48:59.338926527 (211h22m53.770006658s) [upload=219856]: Starting upload
Aug 17 12:48:59.338998545 (211h22m53.770078666s) [upload=219856]: Done starting upload
Aug 17 12:48:59.339091643 (211h22m53.770171774s) [upload=219856]: Uploading segments...
Aug 17 12:48:59.339205040 (211h22m53.770285161s) [upload=219856]: Got next segment. Inline: false
Aug 17 12:48:59.339233935 (211h22m53.770314066s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:48:59.339238494 (211h22m53.770318625s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:48:59.792012791 (211h22m54.223092972s) [seg_pos={0 0}, upload=219856]: Begin upload segment...
Aug 17 12:48:59.792067756 (211h22m54.223147877s) [seg_pos={0 0}, upload=219856]: Done begin upload segment.
Aug 17 12:48:59.792103335 (211h22m54.223183626s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792150955 (211h22m54.223231086s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792534739 (211h22m54.223614871s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792639320 (211h22m54.223719441s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792932521 (211h22m54.224012652s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792941668 (211h22m54.224021789s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793220431 (211h22m54.224300563s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793389987 (211h22m54.224470118s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793739905 (211h22m54.224820026s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794120764 (211h22m54.225200895s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794374339 (211h22m54.22545449s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794615581 (211h22m54.225695712s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794882863 (211h22m54.225962994s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795118173 (211h22m54.226198304s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795434578 (211h22m54.226514709s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795705126 (211h22m54.226785247s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795936508 (211h22m54.227016639s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.796134738 (211h22m54.227214859s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:49:00.966553166 (211h22m55.397633297s) [upload=219856]: Next returned nil segment
Aug 17 12:49:00.966570840 (211h22m55.397650961s) [upload=219856]: Waiting for error group managing segments...
Aug 17 12:49:01.273716496 (211h22m55.704796627s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.717690875 (211h22m56.148771006s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.719311826 (211h22m56.150391957s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.730446992 (211h22m56.161527123s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.773187100 (211h22m56.204267241s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.790053271 (211h22m56.221133412s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.793522348 (211h22m56.22460248s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.808845849 (211h22m56.23992598s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.809657812 (211h22m56.240737953s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.814856199 (211h22m56.24593634s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.828320931 (211h22m56.259401062s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.871317750 (211h22m56.302397881s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.873258053 (211h22m56.304338194s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894803607 (211h22m56.325883738s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894839566 (211h22m56.325919707s) [seg_pos={0 0}, upload=219856]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:49:01.894988481 (211h22m56.326068612s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1afoGj5ZD9twztzCN957MdgkWwydWT3pkGkXXtStw3P6hZBoqK): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895072743 (211h22m56.326152874s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895159759 (211h22m56.32623989s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895209995 (211h22m56.326290126s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123zeRoJ5g7juzsV7qQeNacC5BB7jZpfDBnznFhySGWfyPGJ4oa): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895226236 (211h22m56.326306367s) [seg_pos={0 0}, upload=219856]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:49:01.895304385 (211h22m56.326384516s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:49:01.895310256 (211h22m56.326390397s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:49:02.199248463 (211h22m56.630328605s) [upload=219856]: Done uploading segments...
Aug 17 12:49:02.199273301 (211h22m56.630353442s) [upload=219856]: Upload finished. err: <nil>
Duration: 5.804699728s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X........................X..............................X] duration:
5.913217403s
FAIL (2025-08-17 12:49:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 1399fc4536ca16926e32e7bf2c2badd0596203ae10986aa416b86b23f752988f != before 671413ef0c49d08abc8815ea448f79a85d58f19b3ddeaf6d2a52f995ab429586
======LOGS======
Aug 17 12:48:59.338926527 (211h22m53.770006658s) [upload=219856]: Starting upload
Aug 17 12:48:59.338998545 (211h22m53.770078666s) [upload=219856]: Done starting upload
Aug 17 12:48:59.339091643 (211h22m53.770171774s) [upload=219856]: Uploading segments...
Aug 17 12:48:59.339205040 (211h22m53.770285161s) [upload=219856]: Got next segment. Inline: false
Aug 17 12:48:59.339233935 (211h22m53.770314066s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 12:48:59.339238494 (211h22m53.770318625s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 12:48:59.792012791 (211h22m54.223092972s) [seg_pos={0 0}, upload=219856]: Begin upload segment...
Aug 17 12:48:59.792067756 (211h22m54.223147877s) [seg_pos={0 0}, upload=219856]: Done begin upload segment.
Aug 17 12:48:59.792103335 (211h22m54.223183626s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792150955 (211h22m54.223231086s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792534739 (211h22m54.223614871s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792639320 (211h22m54.223719441s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792932521 (211h22m54.224012652s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.792941668 (211h22m54.224021789s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793220431 (211h22m54.224300563s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793389987 (211h22m54.224470118s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.793739905 (211h22m54.224820026s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794120764 (211h22m54.225200895s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794374339 (211h22m54.22545449s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794615581 (211h22m54.225695712s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.794882863 (211h22m54.225962994s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795118173 (211h22m54.226198304s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795434578 (211h22m54.226514709s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795705126 (211h22m54.226785247s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.795936508 (211h22m54.227016639s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:48:59.796134738 (211h22m54.227214859s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Uploading piece...
Aug 17 12:49:00.966553166 (211h22m55.397633297s) [upload=219856]: Next returned nil segment
Aug 17 12:49:00.966570840 (211h22m55.397650961s) [upload=219856]: Waiting for error group managing segments...
Aug 17 12:49:01.273716496 (211h22m55.704796627s) [noise=true , address=66.23.193.175:4563 , piece_id=X3M7PDJSA7FJT5SOPNXYEYJVDOUJ4TCRCI2GCM4LEZOGGGN6NVZA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.717690875 (211h22m56.148771006s) [noise=true , address=104.36.82.59:4312 , piece_id=HDEA5Z5WLEB56VWTRGGUDSIEN2HHC375RF52WZ3JVX2WXY5TTGBA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.719311826 (211h22m56.150391957s) [noise=true , address=79.127.219.48:4101 , piece_id=C5WQZ2YO4YTUQCWH52DASHFKETPAIACUVJGCDICPT3MI3WNB2YMA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.730446992 (211h22m56.161527123s) [noise=true , address=104.36.82.44:4899 , piece_id=Z7S4PROHSRCKQDYUJIJPA62VGZMUN6NHHS2FH6TZP2NFE7RAII3Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.773187100 (211h22m56.204267241s) [noise=true , address=45.91.116.14:4203 , piece_id=AZ2ENIE2YNLRZ53OCXX45SES3VTGD7JGEK4IIUBV2MHEWQGI3NOA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.790053271 (211h22m56.221133412s) [noise=true , address=104.36.82.5:4844 , piece_id=7R7FBC3ALSZA5BAI2HVPOU3P5XSJH6GRGRD73ABXAGGNBJHDA6GA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.793522348 (211h22m56.22460248s) [noise=true , address=104.36.82.23:4465 , piece_id=WXYZ73DEZZ2YNMA3ZYNM5WQIYBJ5BM7NOSCE2ZKXEBLCL5TKFZAQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.808845849 (211h22m56.23992598s) [noise=true , address=77.90.31.13:4632 , piece_id=73KGRSOIBLXOT3FOUUGV65GOT2AB7SY7XM6DOWZGLPSH5POHOBEQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.809657812 (211h22m56.240737953s) [noise=true , address=104.36.82.34:4554 , piece_id=SPMW6KCCLZOON2Q7YRB3SWMJ5AEG4CTOLRBBI3QVNH53JLC6GG4A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.814856199 (211h22m56.24593634s) [noise=true , address=77.90.31.11:4580 , piece_id=LSTM2EQZLSWXS7G3SVVATQTLFF2EDZXMGWQF72BKVPGDJMFOXN7A, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.828320931 (211h22m56.259401062s) [noise=true , address=104.36.82.44:4885 , piece_id=XJ5RF5ISUHUM75S4HJEEFPYYKYP6Z3Z6KZNWO3LUXWYLFAF7ZHHA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.871317750 (211h22m56.302397881s) [noise=true , address=104.36.82.58:4279 , piece_id=J5E3AQOSZHTKMIVIJDOX4AR3WSJDQ7E62T6RIZTX4EXS536MLOLQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.873258053 (211h22m56.304338194s) [noise=true , address=104.36.82.60:4366 , piece_id=J6V2I3LAENMNWCSWEXBLOQDBBDGCZO6R6WYF4VDXG755YWJ3XHBQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894803607 (211h22m56.325883738s) [noise=true , address=79.127.201.215:4347 , piece_id=Y6MLOJSCHXGAA4PHHTWWPUFBGLGE7YGUC6Z3WGKL3UIWSOMKWU7Q, seg_pos={0 0}, upload=219856]: Done uploading piece. err: <nil>
Aug 17 12:49:01.894839566 (211h22m56.325919707s) [seg_pos={0 0}, upload=219856]: Segment reached optimal threshold of 14 pieces.
Aug 17 12:49:01.894988481 (211h22m56.326068612s) [noise=true , address=77.90.31.14:4677 , piece_id=4S6XKKCCQJMCS65W2AR2ENUQ35N4O7QDOZNZHTQW4HHPK5NWZQGA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1afoGj5ZD9twztzCN957MdgkWwydWT3pkGkXXtStw3P6hZBoqK): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895072743 (211h22m56.326152874s) [noise=true , address=104.36.82.44:4871 , piece_id=I4N4K2TFQVYN44HQMWHOEKUZCWTDT75VQB3JXMOUNKIUP6JPGHWA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12t3N84zSSMtzRBs1H47Szc2xAHwqmyr9szJahRkxMYDLto8DAx): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895159759 (211h22m56.32623989s) [noise=true , address=77.90.31.18:4836 , piece_id=7Y5J2XWT2MCTGNTEZ6UF2SKYYGVJLEKBSXSH42INKN4OIGBVDMWQ, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ga6Vu6VGDGdHP3xxTY9ywyUSXSjo7fybEEzcYcqFbiWGmWENv): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895209995 (211h22m56.326290126s) [noise=true , address=104.36.82.17:4362 , piece_id=KHC7IU7J6HUAX7FNQTQH5KG6LIH6NSJA3LQTA5YQLZCRDDHSA6VA, seg_pos={0 0}, upload=219856]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123zeRoJ5g7juzsV7qQeNacC5BB7jZpfDBnznFhySGWfyPGJ4oa): protocol: expected piece hash; context canceled; EOF
Aug 17 12:49:01.895226236 (211h22m56.326306367s) [seg_pos={0 0}, upload=219856]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 12:49:01.895304385 (211h22m56.326384516s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 12:49:01.895310256 (211h22m56.326390397s) [upload=219856]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 12:49:02.199248463 (211h22m56.630328605s) [upload=219856]: Done uploading segments...
Aug 17 12:49:02.199273301 (211h22m56.630353442s) [upload=219856]: Upload finished. err: <nil>
Duration: 5.913240747s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X........................X..............................] duration:
6.037410541s
FAIL (2025-08-17 12:47:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:26:17.915382322 (211h0m12.346462443s) [upload=219462]: Starting upload Aug 17 12:26:17.915463698 (211h0m12.346543829s) [upload=219462]: Done starting upload Aug 17 12:26:17.915503575 (211h0m12.346583706s) [upload=219462]: Uploading segments... Aug 17 12:26:17.917932091 (211h0m12.349012222s) [upload=219462]: Got next segment. Inline: false Aug 17 12:26:17.917978049 (211h0m12.34905818s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:26:17.918017815 (211h0m12.349097946s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 12:26:18.136214768 (211h0m12.56729489s) [upload=219462]: Next segment err: metaclient: Too Many Requests Aug 17 12:26:18.136243884 (211h0m12.567324015s) [upload=219462]: Done uploading segments... Aug 17 12:26:18.136258362 (211h0m12.567338493s) [upload=219462]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.037448824s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X....X........................X.............................] duration:
5.944919912s
FAIL (2025-08-17 12:47:34 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:26:17.915382322 (211h0m12.346462443s) [upload=219462]: Starting upload Aug 17 12:26:17.915463698 (211h0m12.346543829s) [upload=219462]: Done starting upload Aug 17 12:26:17.915503575 (211h0m12.346583706s) [upload=219462]: Uploading segments... Aug 17 12:26:17.917932091 (211h0m12.349012222s) [upload=219462]: Got next segment. Inline: false Aug 17 12:26:17.917978049 (211h0m12.34905818s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:26:17.918017815 (211h0m12.349097946s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 12:26:18.136214768 (211h0m12.56729489s) [upload=219462]: Next segment err: metaclient: Too Many Requests Aug 17 12:26:18.136243884 (211h0m12.567324015s) [upload=219462]: Done uploading segments... Aug 17 12:26:18.136258362 (211h0m12.567338493s) [upload=219462]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.944950109s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X....X........................X............................] duration:
5.743373448s
FAIL (2025-08-17 12:46:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:26:17.915382322 (211h0m12.346462443s) [upload=219462]: Starting upload Aug 17 12:26:17.915463698 (211h0m12.346543829s) [upload=219462]: Done starting upload Aug 17 12:26:17.915503575 (211h0m12.346583706s) [upload=219462]: Uploading segments... Aug 17 12:26:17.917932091 (211h0m12.349012222s) [upload=219462]: Got next segment. Inline: false Aug 17 12:26:17.917978049 (211h0m12.34905818s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:26:17.918017815 (211h0m12.349097946s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 12:26:18.136214768 (211h0m12.56729489s) [upload=219462]: Next segment err: metaclient: Too Many Requests Aug 17 12:26:18.136243884 (211h0m12.567324015s) [upload=219462]: Done uploading segments... Aug 17 12:26:18.136258362 (211h0m12.567338493s) [upload=219462]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.743396673s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X....X........................X...........................] duration:
5.923561626s
FAIL (2025-08-17 12:45:58 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:26:17.915382322 (211h0m12.346462443s) [upload=219462]: Starting upload Aug 17 12:26:17.915463698 (211h0m12.346543829s) [upload=219462]: Done starting upload Aug 17 12:26:17.915503575 (211h0m12.346583706s) [upload=219462]: Uploading segments... Aug 17 12:26:17.917932091 (211h0m12.349012222s) [upload=219462]: Got next segment. Inline: false Aug 17 12:26:17.917978049 (211h0m12.34905818s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:26:17.918017815 (211h0m12.349097946s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 12:26:18.136214768 (211h0m12.56729489s) [upload=219462]: Next segment err: metaclient: Too Many Requests Aug 17 12:26:18.136243884 (211h0m12.567324015s) [upload=219462]: Done uploading segments... Aug 17 12:26:18.136258362 (211h0m12.567338493s) [upload=219462]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.923584882s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X..X....X........................X..........................] duration:
5.874399863s
FAIL (2025-08-17 12:45:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:26:17.915382322 (211h0m12.346462443s) [upload=219462]: Starting upload Aug 17 12:26:17.915463698 (211h0m12.346543829s) [upload=219462]: Done starting upload Aug 17 12:26:17.915503575 (211h0m12.346583706s) [upload=219462]: Uploading segments... Aug 17 12:26:17.917932091 (211h0m12.349012222s) [upload=219462]: Got next segment. Inline: false Aug 17 12:26:17.917978049 (211h0m12.34905818s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:26:17.918017815 (211h0m12.349097946s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 12:26:18.136214768 (211h0m12.56729489s) [upload=219462]: Next segment err: metaclient: Too Many Requests Aug 17 12:26:18.136243884 (211h0m12.567324015s) [upload=219462]: Done uploading segments... Aug 17 12:26:18.136258362 (211h0m12.567338493s) [upload=219462]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.874423217s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..X....X........................X.........................] duration:
5.779036862s
FAIL (2025-08-17 12:45:09 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:26:17.915382322 (211h0m12.346462443s) [upload=219462]: Starting upload Aug 17 12:26:17.915463698 (211h0m12.346543829s) [upload=219462]: Done starting upload Aug 17 12:26:17.915503575 (211h0m12.346583706s) [upload=219462]: Uploading segments... Aug 17 12:26:17.917932091 (211h0m12.349012222s) [upload=219462]: Got next segment. Inline: false Aug 17 12:26:17.917978049 (211h0m12.34905818s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:26:17.918017815 (211h0m12.349097946s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 12:26:18.136214768 (211h0m12.56729489s) [upload=219462]: Next segment err: metaclient: Too Many Requests Aug 17 12:26:18.136243884 (211h0m12.567324015s) [upload=219462]: Done uploading segments... Aug 17 12:26:18.136258362 (211h0m12.567338493s) [upload=219462]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.779066098s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.854790989s
FAIL (2025-08-17 12:44:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:00:49.024543390 (210h34m43.455623521s) [upload=219015]: Starting upload Aug 17 12:00:49.024585411 (210h34m43.455665542s) [upload=219015]: Done starting upload Aug 17 12:00:49.024628794 (210h34m43.455708925s) [upload=219015]: Uploading segments... Aug 17 12:00:49.024661818 (210h34m43.455741949s) [upload=219015]: Got next segment. Inline: true Aug 17 12:00:49.024665384 (210h34m43.455745515s) [upload=219015]: Waiting for error group managing segments... Aug 17 12:00:49.024695101 (210h34m43.455775232s) [upload=219015]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:00:49.024698928 (210h34m43.455779059s) [upload=219015]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 17 12:00:49.024701182 (210h34m43.455781313s) [upload=219015]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 17 12:00:49.243529634 (210h34m43.674609765s) [upload=219015]: Done uploading segments... Aug 17 12:00:49.243546808 (210h34m43.674626939s) [upload=219015]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.854820406s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..X....X........................X........................] duration:
6.030121325s
FAIL (2025-08-17 12:43:55 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 17 12:26:17.915382322 (211h0m12.346462443s) [upload=219462]: Starting upload Aug 17 12:26:17.915463698 (211h0m12.346543829s) [upload=219462]: Done starting upload Aug 17 12:26:17.915503575 (211h0m12.346583706s) [upload=219462]: Uploading segments... Aug 17 12:26:17.917932091 (211h0m12.349012222s) [upload=219462]: Got next segment. Inline: false Aug 17 12:26:17.917978049 (211h0m12.34905818s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 17 12:26:17.918017815 (211h0m12.349097946s) [upload=219462]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 17 12:26:18.136214768 (211h0m12.56729489s) [upload=219462]: Next segment err: metaclient: Too Many Requests Aug 17 12:26:18.136243884 (211h0m12.567324015s) [upload=219462]: Done uploading segments... Aug 17 12:26:18.136258362 (211h0m12.567338493s) [upload=219462]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.030155331s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|