Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.........X.X..............X............X...X..............X.] duration:
5.908745488s
FAIL (2025-08-12 01:20:26 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 01:19:51.916409816 (79h53m46.347489947s) [upload=83242]: Starting upload
Aug 12 01:19:51.916486844 (79h53m46.347566975s) [upload=83242]: Done starting upload
Aug 12 01:19:51.916602124 (79h53m46.347682255s) [upload=83242]: Uploading segments...
Aug 12 01:19:51.916748645 (79h53m46.347828796s) [upload=83242]: Got next segment. Inline: false
Aug 12 01:19:51.916811044 (79h53m46.347891175s) [upload=83242]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:19:51.916818528 (79h53m46.347898669s) [upload=83242]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:19:52.403056108 (79h53m46.834136229s) [seg_pos={0 0}, upload=83242]: Begin upload segment...
Aug 12 01:19:52.403102766 (79h53m46.834182897s) [seg_pos={0 0}, upload=83242]: Done begin upload segment.
Aug 12 01:19:52.403121623 (79h53m46.834201754s) [noise=true , address=104.36.82.43:4852 , piece_id=MGHA5PTXPPFWVKQEKWLMCH4JUILWQGEZNIBFXBCNIWRST5HQFQZA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.403128485 (79h53m46.834208616s) [noise=true , address=104.36.82.22:4521 , piece_id=G45W4AG52MUYOL56WILLVU6DFSCG4HGM4A2GYAEEVTRJ3RRXC2FQ, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.403465210 (79h53m46.834545341s) [noise=true , address=104.36.82.13:4192 , piece_id=BNYMRGJJITJ7NREPV3XFR2XBKDVXKXZ6MYIXGOMJLMOZTLWOSX7Q, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404072011 (79h53m46.835152142s) [noise=true , address=79.127.205.233:4629 , piece_id=2WIFOF23F5YO7HSCHVXXYWKY7GPEHZ2P6N7NNQVA3KV3NKUTHV2A, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404084685 (79h53m46.835164806s) [noise=true , address=104.36.82.44:4870 , piece_id=4F4BNOG3BK3PIVKRMHPLVZUH2TY2DQPXRYY4OWLCHLDJXN5DMZBQ, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404378888 (79h53m46.835459009s) [noise=true , address=64.49.13.140:4514 , piece_id=7AOUOGUHPI644C4FLNPOTNXDTECVT6HLS3EXLMG4HDKNA77IRI7Q, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404482437 (79h53m46.835562568s) [noise=true , address=77.90.31.13:4650 , piece_id=6XMSJXKNBZAF5B2JN7NXV3VWPGMQE6TZ3ZOVRWJ6BTNMJPNUFVGA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404719139 (79h53m46.83579927s) [noise=true , address=104.36.82.19:4419 , piece_id=L6KHJKTEYQU6GA7LWCR5TOUMCQLH5CD4RP3GCIKQ5KOHQU4BEVQQ, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404746872 (79h53m46.835827003s) [noise=true , address=104.36.82.2:4748 , piece_id=LV4K2Q6OP4LHMZG6HPJJO7FEN4CBMS7J55JVHABFHQBG5S7MN3SA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404999134 (79h53m46.836079266s) [noise=true , address=104.36.82.8:4984 , piece_id=IL432WO2UEGQUSWHFDOFFESOR7PTBNT3VPHPC4J7ZEKFUSI5AGXA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.405080871 (79h53m46.836161002s) [noise=true , address=66.23.193.175:4554 , piece_id=7R455QVGK5FCXLH54FXN6CZS7ZPIAYH5ICEIFFHER4MHGW7UGJBA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.405271115 (79h53m46.836351246s) [noise=true , address=77.90.31.17:4776 , piece_id=ZFWWQNFP3VTAEOOTRROW3DOKVYCJOGUKQF5RQJ5ARLLDYMZ4QITA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.405482470 (79h53m46.836562601s) [noise=true , address=104.36.82.37:4660 , piece_id=VVX3EWKVSP3DDQIQW43LN7MRJDJS2ZSR4ZRN7NAKRIVE2KXVXNWA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.405772355 (79h53m46.836852496s) [noise=true , address=66.23.193.175:4563 , piece_id=QTSAUJ33STMRFZ6CR4ZOI2BLHBS4LJJLGTXZTUEX7OLC3QUK6BVQ, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.406078811 (79h53m46.837158942s) [noise=true , address=104.36.82.17:4340 , piece_id=CH5UNGMDY4G7BCQYNA2GBCQCA4PBM2BULSW5VHUHWEG4RPCYZOJA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.406353336 (79h53m46.837433467s) [noise=true , address=104.36.82.60:4365 , piece_id=35OKKALYMTD2I3OTI5KYKVYD4NTPHHBKA7SJO5TIN7LWSM4APMUA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.406578256 (79h53m46.837658387s) [noise=true , address=64.49.13.26:4955 , piece_id=Y2AVAZ4GWDZM2MTBDD5RYVREFOMADCHHAQCU6GNGKCKIBKSF4ZPA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.406703647 (79h53m46.837783778s) [noise=true , address=104.36.82.34:4548 , piece_id=3PDE32TAYC3KBFY6OZHXLVAR2HRGRFCARCCS44N2A6WPF4F6NNVQ, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:53.518553568 (79h53m47.949633699s) [upload=83242]: Next returned nil segment
Aug 12 01:19:53.518573546 (79h53m47.949653677s) [upload=83242]: Waiting for error group managing segments...
Aug 12 01:19:53.802085357 (79h53m48.233165488s) [noise=true , address=66.23.193.175:4563 , piece_id=QTSAUJ33STMRFZ6CR4ZOI2BLHBS4LJJLGTXZTUEX7OLC3QUK6BVQ, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:53.827629042 (79h53m48.258709173s) [noise=true , address=79.127.205.233:4629 , piece_id=2WIFOF23F5YO7HSCHVXXYWKY7GPEHZ2P6N7NNQVA3KV3NKUTHV2A, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:53.865648026 (79h53m48.296728157s) [noise=true , address=66.23.193.175:4554 , piece_id=7R455QVGK5FCXLH54FXN6CZS7ZPIAYH5ICEIFFHER4MHGW7UGJBA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:53.889471810 (79h53m48.320551931s) [noise=true , address=64.49.13.26:4955 , piece_id=Y2AVAZ4GWDZM2MTBDD5RYVREFOMADCHHAQCU6GNGKCKIBKSF4ZPA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:53.910358033 (79h53m48.341438164s) [noise=true , address=64.49.13.140:4514 , piece_id=7AOUOGUHPI644C4FLNPOTNXDTECVT6HLS3EXLMG4HDKNA77IRI7Q, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.385691358 (79h53m48.816771489s) [noise=true , address=104.36.82.19:4419 , piece_id=L6KHJKTEYQU6GA7LWCR5TOUMCQLH5CD4RP3GCIKQ5KOHQU4BEVQQ, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.415146746 (79h53m48.846226877s) [noise=true , address=104.36.82.17:4340 , piece_id=CH5UNGMDY4G7BCQYNA2GBCQCA4PBM2BULSW5VHUHWEG4RPCYZOJA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.420078673 (79h53m48.851158804s) [noise=true , address=104.36.82.13:4192 , piece_id=BNYMRGJJITJ7NREPV3XFR2XBKDVXKXZ6MYIXGOMJLMOZTLWOSX7Q, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.425427217 (79h53m48.856507348s) [noise=true , address=104.36.82.8:4984 , piece_id=IL432WO2UEGQUSWHFDOFFESOR7PTBNT3VPHPC4J7ZEKFUSI5AGXA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.435951754 (79h53m48.867031885s) [noise=true , address=104.36.82.2:4748 , piece_id=LV4K2Q6OP4LHMZG6HPJJO7FEN4CBMS7J55JVHABFHQBG5S7MN3SA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.455601221 (79h53m48.886681352s) [noise=true , address=77.90.31.17:4776 , piece_id=ZFWWQNFP3VTAEOOTRROW3DOKVYCJOGUKQF5RQJ5ARLLDYMZ4QITA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.468123320 (79h53m48.899203451s) [noise=true , address=104.36.82.22:4521 , piece_id=G45W4AG52MUYOL56WILLVU6DFSCG4HGM4A2GYAEEVTRJ3RRXC2FQ, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.538989673 (79h53m48.970069804s) [noise=true , address=104.36.82.60:4365 , piece_id=35OKKALYMTD2I3OTI5KYKVYD4NTPHHBKA7SJO5TIN7LWSM4APMUA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.554918520 (79h53m48.985998641s) [noise=true , address=104.36.82.44:4870 , piece_id=4F4BNOG3BK3PIVKRMHPLVZUH2TY2DQPXRYY4OWLCHLDJXN5DMZBQ, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.554954500 (79h53m48.986034631s) [seg_pos={0 0}, upload=83242]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:19:54.555146908 (79h53m48.986227039s) [noise=true , address=104.36.82.34:4548 , piece_id=3PDE32TAYC3KBFY6OZHXLVAR2HRGRFCARCCS44N2A6WPF4F6NNVQ, seg_pos={0 0}, upload=83242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid): protocol: expected piece hash; context canceled; EOF
Aug 12 01:19:54.555203616 (79h53m48.986283747s) [noise=true , address=104.36.82.43:4852 , piece_id=MGHA5PTXPPFWVKQEKWLMCH4JUILWQGEZNIBFXBCNIWRST5HQFQZA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CWXaz1RJdY28Y4jCshs5Ti4GhJKR1LJL1pBBEWGWrzbfZXfav): protocol: expected piece hash; context canceled; EOF
Aug 12 01:19:54.555259674 (79h53m48.986339805s) [noise=true , address=104.36.82.37:4660 , piece_id=VVX3EWKVSP3DDQIQW43LN7MRJDJS2ZSR4ZRN7NAKRIVE2KXVXNWA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Z6kr1c9wkLhK2JduYore9jqCBdygpnr4xqFTondrKxRKCZ9oS): protocol: expected piece hash; context canceled; EOF
Aug 12 01:19:54.555398579 (79h53m48.98647871s) [noise=true , address=77.90.31.13:4650 , piece_id=6XMSJXKNBZAF5B2JN7NXV3VWPGMQE6TZ3ZOVRWJ6BTNMJPNUFVGA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 12 01:19:54.555436822 (79h53m48.986516953s) [seg_pos={0 0}, upload=83242]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:19:54.555533808 (79h53m48.986613939s) [upload=83242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:19:54.555538627 (79h53m48.986618748s) [upload=83242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:19:54.899701646 (79h53m49.330781778s) [upload=83242]: Done uploading segments...
Aug 12 01:19:54.899730151 (79h53m49.330810282s) [upload=83242]: Upload finished. err: <nil>
Duration: 5.908777831s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [......X.X..............................X...X...............X] duration:
2.328760928s
FAIL (2025-08-12 01:20:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3a0bd74dbf6c2eeb09e87f59ec941dc67d502eebc557fa90c7922e5bfde62988 != before 4cc16bc1893196e936ba2f304d7690fbff5df2a9ec69b7bbde5cc7bce516c763 ======LOGS====== Aug 12 01:20:16.459208626 (79h54m10.890288757s) [upload=83247]: Starting upload Aug 12 01:20:16.459271146 (79h54m10.890351277s) [upload=83247]: Done starting upload Aug 12 01:20:16.459344706 (79h54m10.890424837s) [upload=83247]: Uploading segments... Aug 12 01:20:16.459410242 (79h54m10.890490403s) [upload=83247]: Got next segment. Inline: true Aug 12 01:20:16.459418808 (79h54m10.890498959s) [upload=83247]: Waiting for error group managing segments... Aug 12 01:20:16.459482400 (79h54m10.890562541s) [upload=83247]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:20:16.459490645 (79h54m10.890570786s) [upload=83247]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:20:16.459497158 (79h54m10.890577309s) [upload=83247]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:20:17.427429005 (79h54m11.858509136s) [upload=83247]: Done uploading segments... Aug 12 01:20:17.427447309 (79h54m11.85852743s) [upload=83247]: Upload finished. err: <nil>
Duration: 2.328788802s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..........X.X..............X............X...X..............X] duration:
4.307858568s
FAIL (2025-08-12 01:19:55 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 01:19:51.916409816 (79h53m46.347489947s) [upload=83242]: Starting upload
Aug 12 01:19:51.916486844 (79h53m46.347566975s) [upload=83242]: Done starting upload
Aug 12 01:19:51.916602124 (79h53m46.347682255s) [upload=83242]: Uploading segments...
Aug 12 01:19:51.916748645 (79h53m46.347828796s) [upload=83242]: Got next segment. Inline: false
Aug 12 01:19:51.916811044 (79h53m46.347891175s) [upload=83242]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:19:51.916818528 (79h53m46.347898669s) [upload=83242]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:19:52.403056108 (79h53m46.834136229s) [seg_pos={0 0}, upload=83242]: Begin upload segment...
Aug 12 01:19:52.403102766 (79h53m46.834182897s) [seg_pos={0 0}, upload=83242]: Done begin upload segment.
Aug 12 01:19:52.403121623 (79h53m46.834201754s) [noise=true , address=104.36.82.43:4852 , piece_id=MGHA5PTXPPFWVKQEKWLMCH4JUILWQGEZNIBFXBCNIWRST5HQFQZA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.403128485 (79h53m46.834208616s) [noise=true , address=104.36.82.22:4521 , piece_id=G45W4AG52MUYOL56WILLVU6DFSCG4HGM4A2GYAEEVTRJ3RRXC2FQ, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.403465210 (79h53m46.834545341s) [noise=true , address=104.36.82.13:4192 , piece_id=BNYMRGJJITJ7NREPV3XFR2XBKDVXKXZ6MYIXGOMJLMOZTLWOSX7Q, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404072011 (79h53m46.835152142s) [noise=true , address=79.127.205.233:4629 , piece_id=2WIFOF23F5YO7HSCHVXXYWKY7GPEHZ2P6N7NNQVA3KV3NKUTHV2A, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404084685 (79h53m46.835164806s) [noise=true , address=104.36.82.44:4870 , piece_id=4F4BNOG3BK3PIVKRMHPLVZUH2TY2DQPXRYY4OWLCHLDJXN5DMZBQ, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404378888 (79h53m46.835459009s) [noise=true , address=64.49.13.140:4514 , piece_id=7AOUOGUHPI644C4FLNPOTNXDTECVT6HLS3EXLMG4HDKNA77IRI7Q, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404482437 (79h53m46.835562568s) [noise=true , address=77.90.31.13:4650 , piece_id=6XMSJXKNBZAF5B2JN7NXV3VWPGMQE6TZ3ZOVRWJ6BTNMJPNUFVGA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404719139 (79h53m46.83579927s) [noise=true , address=104.36.82.19:4419 , piece_id=L6KHJKTEYQU6GA7LWCR5TOUMCQLH5CD4RP3GCIKQ5KOHQU4BEVQQ, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404746872 (79h53m46.835827003s) [noise=true , address=104.36.82.2:4748 , piece_id=LV4K2Q6OP4LHMZG6HPJJO7FEN4CBMS7J55JVHABFHQBG5S7MN3SA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.404999134 (79h53m46.836079266s) [noise=true , address=104.36.82.8:4984 , piece_id=IL432WO2UEGQUSWHFDOFFESOR7PTBNT3VPHPC4J7ZEKFUSI5AGXA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.405080871 (79h53m46.836161002s) [noise=true , address=66.23.193.175:4554 , piece_id=7R455QVGK5FCXLH54FXN6CZS7ZPIAYH5ICEIFFHER4MHGW7UGJBA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.405271115 (79h53m46.836351246s) [noise=true , address=77.90.31.17:4776 , piece_id=ZFWWQNFP3VTAEOOTRROW3DOKVYCJOGUKQF5RQJ5ARLLDYMZ4QITA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.405482470 (79h53m46.836562601s) [noise=true , address=104.36.82.37:4660 , piece_id=VVX3EWKVSP3DDQIQW43LN7MRJDJS2ZSR4ZRN7NAKRIVE2KXVXNWA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.405772355 (79h53m46.836852496s) [noise=true , address=66.23.193.175:4563 , piece_id=QTSAUJ33STMRFZ6CR4ZOI2BLHBS4LJJLGTXZTUEX7OLC3QUK6BVQ, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.406078811 (79h53m46.837158942s) [noise=true , address=104.36.82.17:4340 , piece_id=CH5UNGMDY4G7BCQYNA2GBCQCA4PBM2BULSW5VHUHWEG4RPCYZOJA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.406353336 (79h53m46.837433467s) [noise=true , address=104.36.82.60:4365 , piece_id=35OKKALYMTD2I3OTI5KYKVYD4NTPHHBKA7SJO5TIN7LWSM4APMUA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.406578256 (79h53m46.837658387s) [noise=true , address=64.49.13.26:4955 , piece_id=Y2AVAZ4GWDZM2MTBDD5RYVREFOMADCHHAQCU6GNGKCKIBKSF4ZPA, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:52.406703647 (79h53m46.837783778s) [noise=true , address=104.36.82.34:4548 , piece_id=3PDE32TAYC3KBFY6OZHXLVAR2HRGRFCARCCS44N2A6WPF4F6NNVQ, seg_pos={0 0}, upload=83242]: Uploading piece...
Aug 12 01:19:53.518553568 (79h53m47.949633699s) [upload=83242]: Next returned nil segment
Aug 12 01:19:53.518573546 (79h53m47.949653677s) [upload=83242]: Waiting for error group managing segments...
Aug 12 01:19:53.802085357 (79h53m48.233165488s) [noise=true , address=66.23.193.175:4563 , piece_id=QTSAUJ33STMRFZ6CR4ZOI2BLHBS4LJJLGTXZTUEX7OLC3QUK6BVQ, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:53.827629042 (79h53m48.258709173s) [noise=true , address=79.127.205.233:4629 , piece_id=2WIFOF23F5YO7HSCHVXXYWKY7GPEHZ2P6N7NNQVA3KV3NKUTHV2A, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:53.865648026 (79h53m48.296728157s) [noise=true , address=66.23.193.175:4554 , piece_id=7R455QVGK5FCXLH54FXN6CZS7ZPIAYH5ICEIFFHER4MHGW7UGJBA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:53.889471810 (79h53m48.320551931s) [noise=true , address=64.49.13.26:4955 , piece_id=Y2AVAZ4GWDZM2MTBDD5RYVREFOMADCHHAQCU6GNGKCKIBKSF4ZPA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:53.910358033 (79h53m48.341438164s) [noise=true , address=64.49.13.140:4514 , piece_id=7AOUOGUHPI644C4FLNPOTNXDTECVT6HLS3EXLMG4HDKNA77IRI7Q, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.385691358 (79h53m48.816771489s) [noise=true , address=104.36.82.19:4419 , piece_id=L6KHJKTEYQU6GA7LWCR5TOUMCQLH5CD4RP3GCIKQ5KOHQU4BEVQQ, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.415146746 (79h53m48.846226877s) [noise=true , address=104.36.82.17:4340 , piece_id=CH5UNGMDY4G7BCQYNA2GBCQCA4PBM2BULSW5VHUHWEG4RPCYZOJA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.420078673 (79h53m48.851158804s) [noise=true , address=104.36.82.13:4192 , piece_id=BNYMRGJJITJ7NREPV3XFR2XBKDVXKXZ6MYIXGOMJLMOZTLWOSX7Q, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.425427217 (79h53m48.856507348s) [noise=true , address=104.36.82.8:4984 , piece_id=IL432WO2UEGQUSWHFDOFFESOR7PTBNT3VPHPC4J7ZEKFUSI5AGXA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.435951754 (79h53m48.867031885s) [noise=true , address=104.36.82.2:4748 , piece_id=LV4K2Q6OP4LHMZG6HPJJO7FEN4CBMS7J55JVHABFHQBG5S7MN3SA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.455601221 (79h53m48.886681352s) [noise=true , address=77.90.31.17:4776 , piece_id=ZFWWQNFP3VTAEOOTRROW3DOKVYCJOGUKQF5RQJ5ARLLDYMZ4QITA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.468123320 (79h53m48.899203451s) [noise=true , address=104.36.82.22:4521 , piece_id=G45W4AG52MUYOL56WILLVU6DFSCG4HGM4A2GYAEEVTRJ3RRXC2FQ, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.538989673 (79h53m48.970069804s) [noise=true , address=104.36.82.60:4365 , piece_id=35OKKALYMTD2I3OTI5KYKVYD4NTPHHBKA7SJO5TIN7LWSM4APMUA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.554918520 (79h53m48.985998641s) [noise=true , address=104.36.82.44:4870 , piece_id=4F4BNOG3BK3PIVKRMHPLVZUH2TY2DQPXRYY4OWLCHLDJXN5DMZBQ, seg_pos={0 0}, upload=83242]: Done uploading piece. err: <nil>
Aug 12 01:19:54.554954500 (79h53m48.986034631s) [seg_pos={0 0}, upload=83242]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:19:54.555146908 (79h53m48.986227039s) [noise=true , address=104.36.82.34:4548 , piece_id=3PDE32TAYC3KBFY6OZHXLVAR2HRGRFCARCCS44N2A6WPF4F6NNVQ, seg_pos={0 0}, upload=83242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19rx4nU8dUTtPXvMonzZSBkn5Z5cnBXrndvU7t8ewUmfYLBqid): protocol: expected piece hash; context canceled; EOF
Aug 12 01:19:54.555203616 (79h53m48.986283747s) [noise=true , address=104.36.82.43:4852 , piece_id=MGHA5PTXPPFWVKQEKWLMCH4JUILWQGEZNIBFXBCNIWRST5HQFQZA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1CWXaz1RJdY28Y4jCshs5Ti4GhJKR1LJL1pBBEWGWrzbfZXfav): protocol: expected piece hash; context canceled; EOF
Aug 12 01:19:54.555259674 (79h53m48.986339805s) [noise=true , address=104.36.82.37:4660 , piece_id=VVX3EWKVSP3DDQIQW43LN7MRJDJS2ZSR4ZRN7NAKRIVE2KXVXNWA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Z6kr1c9wkLhK2JduYore9jqCBdygpnr4xqFTondrKxRKCZ9oS): protocol: expected piece hash; context canceled; EOF
Aug 12 01:19:54.555398579 (79h53m48.98647871s) [noise=true , address=77.90.31.13:4650 , piece_id=6XMSJXKNBZAF5B2JN7NXV3VWPGMQE6TZ3ZOVRWJ6BTNMJPNUFVGA, seg_pos={0 0}, upload=83242]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FNXVNAv3KeiRqTnsvQkMobyRcNFmPAAjVqSNvgs6MPJH4smVU): protocol: expected piece hash; context canceled; EOF
Aug 12 01:19:54.555436822 (79h53m48.986516953s) [seg_pos={0 0}, upload=83242]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:19:54.555533808 (79h53m48.986613939s) [upload=83242]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:19:54.555538627 (79h53m48.986618748s) [upload=83242]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:19:54.899701646 (79h53m49.330781778s) [upload=83242]: Done uploading segments...
Aug 12 01:19:54.899730151 (79h53m49.330810282s) [upload=83242]: Upload finished. err: <nil>
Duration: 4.307897533s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...........X.X..............X............X...X..............] duration:
5.748471358s
FAIL (2025-08-12 01:19:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 5.748500663s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X.X..............................X...X...............] duration:
1.905678167s
FAIL (2025-08-12 01:19:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.905704466s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X.X..............X............X...X.............] duration:
5.973878454s
FAIL (2025-08-12 01:19:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 5.973902931s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X.X..............................X...X..............] duration:
1.867787598s
FAIL (2025-08-12 01:18:28 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.86781471s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X.X..............X............X...X............] duration:
6.118336104s
FAIL (2025-08-12 01:18:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 6.118363126s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X.X..............X............X...X...........] duration:
5.940674403s
FAIL (2025-08-12 01:17:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 5.940698068s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X.X..............................X...X.............] duration:
1.916291231s
FAIL (2025-08-12 01:17:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.916313605s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............X.X..............X............X...X..........] duration:
5.684595698s
FAIL (2025-08-12 01:17:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 5.684637849s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X.X..............................X...X............] duration:
1.861410657s
FAIL (2025-08-12 01:17:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.861439041s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X.X..............................X...X...........] duration:
1.84423347s
FAIL (2025-08-12 01:16:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.844260282s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [................X.X..............X............X...X.........] duration:
5.842662509s
FAIL (2025-08-12 01:16:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 5.842690021s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.................X.X..............X............X...X........] duration:
5.926096787s
FAIL (2025-08-12 01:15:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 5.92611864s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..................X.X..............X............X...X.......] duration:
5.879728748s
FAIL (2025-08-12 01:15:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 5.879754727s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X.X..............................X...X..........] duration:
1.990246896s
FAIL (2025-08-12 01:15:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.990273588s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...................X.X..............X............X...X......] duration:
5.798681888s
FAIL (2025-08-12 01:14:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 5.798705384s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X.X..............................X...X.........] duration:
1.866231541s
FAIL (2025-08-12 01:14:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.866260035s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [....................X.X..............X............X...X.....] duration:
5.676779152s
FAIL (2025-08-12 01:13:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 5.676808196s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X.X..............................X...X........] duration:
1.957860855s
FAIL (2025-08-12 01:13:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.957906243s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X.X..............................X...X.......] duration:
1.84012217s
FAIL (2025-08-12 01:12:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.840167457s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.....................X.X..............X............X...X....] duration:
6.011130359s
FAIL (2025-08-12 01:12:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 6.011155479s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X.X..............................X...X......] duration:
1.872074446s
FAIL (2025-08-12 01:12:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.872104604s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [......................X.X..............X............X...X...] duration:
5.886787429s
FAIL (2025-08-12 01:11:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 5.886841432s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X.X..............................X...X.....] duration:
1.936447344s
FAIL (2025-08-12 01:11:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.936468595s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.......................X.X..............X............X...X..] duration:
5.937350492s
FAIL (2025-08-12 01:10:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 5.937373286s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [........................X.X..............X............X...X.] duration:
6.510909132s
FAIL (2025-08-12 01:10:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 6.510937739s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X.X..............................X...X....] duration:
2.207854989s
FAIL (2025-08-12 01:10:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.207879917s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.........................X.X..............X............X...X] duration:
5.958974555s
FAIL (2025-08-12 01:09:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5cbef769196364f98a12186dd2f35a89a0cd11c51c7fc674477d921bdb631f14 != before 989207324c60c23ce2f43d10bf860c4222a884e97710c5921a1c93a696d59129
======LOGS======
Aug 12 01:09:40.762130132 (79h43m35.193210253s) [upload=83064]: Starting upload
Aug 12 01:09:40.762183484 (79h43m35.193263615s) [upload=83064]: Done starting upload
Aug 12 01:09:40.762319054 (79h43m35.193399185s) [upload=83064]: Uploading segments...
Aug 12 01:09:40.762412353 (79h43m35.193492484s) [upload=83064]: Got next segment. Inline: false
Aug 12 01:09:40.762449303 (79h43m35.193529434s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:09:40.762454503 (79h43m35.193534624s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:09:41.262224706 (79h43m35.693304828s) [seg_pos={0 0}, upload=83064]: Begin upload segment...
Aug 12 01:09:41.262277648 (79h43m35.693357779s) [seg_pos={0 0}, upload=83064]: Done begin upload segment.
Aug 12 01:09:41.262292607 (79h43m35.693372738s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262300261 (79h43m35.693380392s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262338445 (79h43m35.693418576s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262632106 (79h43m35.693712237s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.262887245 (79h43m35.693967376s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263130771 (79h43m35.694210902s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263370489 (79h43m35.69445062s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263614696 (79h43m35.694694827s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.263894872 (79h43m35.694975003s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264185899 (79h43m35.69526603s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264584763 (79h43m35.695664894s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.264829782 (79h43m35.695909903s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265027410 (79h43m35.696107541s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265219377 (79h43m35.696299508s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265413889 (79h43m35.69649402s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265610095 (79h43m35.696690216s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.265830446 (79h43m35.696910567s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:41.266064224 (79h43m35.697144345s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Uploading piece...
Aug 12 01:09:42.392495812 (79h43m36.823575944s) [upload=83064]: Next returned nil segment
Aug 12 01:09:42.392515510 (79h43m36.823595641s) [upload=83064]: Waiting for error group managing segments...
Aug 12 01:09:42.707836575 (79h43m37.138916696s) [noise=true , address=64.49.13.170:4720 , piece_id=I5OOPO66VTU77QLXUGWZ6VGH3SDTXCQ7F3JH3LG2SGNPBEF6GDRQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.713618929 (79h43m37.14469905s) [noise=true , address=79.127.205.233:4624 , piece_id=WHTKYN5KQERNATWF7CCP35W2HGWWEZCSO7US74AMG2CMY5KVDBCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:42.756939647 (79h43m37.188019779s) [noise=true , address=66.23.193.175:4554 , piece_id=L5SVJYF7NLD55FK6DBQOYGS5HDSEUPTJGTY46OWLRJTADNADGVKQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.236504771 (79h43m37.667584902s) [noise=true , address=104.36.82.43:4868 , piece_id=3SYNOO2M5HT27S55C3ZQVAPDNMIXGS4DSJWELIARZE46KFLVWYLQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.245153299 (79h43m37.67623343s) [noise=true , address=104.36.82.8:4000 , piece_id=OANISOJMSBIMYGOG3BO7HLCMVXBC6LATB4GW5ACZVYMETBYEQHCQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.257071312 (79h43m37.688151443s) [noise=true , address=104.36.82.38:4710 , piece_id=CCFX2KX5EVPXFFSKJQQKXITT772JR53GHC4A4VHR3LKUKPFI3SZQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.261570011 (79h43m37.692650142s) [noise=true , address=104.36.82.60:4369 , piece_id=Z5WI6AYKFZRA2N35IVI2DE566VKXQZ6K4UZL6IA4QG4D4BUEZLLA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.294812466 (79h43m37.725892597s) [noise=true , address=104.36.82.37:4677 , piece_id=4GRM443KAWQHPKBDCAT3FHCY2Q2ZIEGN2QPYVCWYBVQQINNYGDFA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.310773104 (79h43m37.741853265s) [noise=true , address=104.36.82.59:4303 , piece_id=3PFDYIZWMAKWTZ2VXPMKT5GQSFCE53KZPDHCXKK3Y7HRUHTGWWXQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.322550939 (79h43m37.75363107s) [noise=true , address=104.36.82.9:4032 , piece_id=J2TVGPXHQ5GJLPOIW7NU3UI3FTNTUHNUSOSR5RESBKZRLEX7Q4MQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.330597294 (79h43m37.761677425s) [noise=true , address=104.36.82.45:4930 , piece_id=XWIX526YIYPJPSSXR7YKSBXWOGUIRZWDDNIDSNBGN6VNI4IUJ5OQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.362155908 (79h43m37.793236089s) [noise=true , address=104.36.82.3:4780 , piece_id=ZJ6DI4GNDF5TIUZY2DJFBEOG5G6H7YBZNSYUIJXHFWGIIX3KG6JA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.380729186 (79h43m37.811809317s) [noise=true , address=104.36.82.44:4897 , piece_id=GLCZDVKPRGQVSN6DMFDUBNHAU525RYWXPRZNCFVIXALHDQREHJ2A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388810469 (79h43m37.8198906s) [noise=true , address=79.127.201.215:4352 , piece_id=TYGJNKUGZOR4IFOS76DCTFZUDGPI37LMOYBM6OCPG74K2NOUONJA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: <nil>
Aug 12 01:09:43.388829444 (79h43m37.819909575s) [seg_pos={0 0}, upload=83064]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:09:43.388944164 (79h43m37.820024296s) [noise=true , address=104.36.82.23:4452 , piece_id=GLLYLCXF4GVAFVAR6QZ26A2ATT237TGNTOQBMYFNFP33VIWK2DEQ, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sAh1mLmzbtmc4o2FAZssW8Y7iDDNmNTCXdCS8xrH8PBVQqxG5): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389003157 (79h43m37.820083288s) [noise=true , address=104.36.82.61:4398 , piece_id=QZAS735MWPRYHKOCDOPYRGXD663EIH3FWRCZ5CQPDPWT2HXEHLAA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLDKxBsLsm82kEhXK3m5zmV2CkKcrMo7raqQx84UzK7z5P4tj): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389055077 (79h43m37.820135208s) [noise=true , address=104.36.82.10:4110 , piece_id=PEEOWOUTSSGJWXWEEAU5DK5DFXTABAVIYMWMGSUJHR6UJEAYNCRA, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ADbnPJGRTw2NqRzhy7ptojGYoNdJgqmjuWBSjcrQK53Wm7LXi): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389067450 (79h43m37.820147571s) [noise=true , address=104.36.82.34:4564 , piece_id=QG7Y2S74RRPQC4ES62G77LNAJU5VAMZDJFE5OJSQOWRU7H7C566A, seg_pos={0 0}, upload=83064]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:121WW4uBQe8bGQKkasQQKT3k4EAdzncsG1ebNvgKf8S5SyNttCc): protocol: expected piece hash; context canceled; EOF
Aug 12 01:09:43.389111795 (79h43m37.820191926s) [seg_pos={0 0}, upload=83064]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:09:43.389193702 (79h43m37.820273833s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:09:43.389198320 (79h43m37.820278452s) [upload=83064]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:09:43.784687035 (79h43m38.215767166s) [upload=83064]: Done uploading segments...
Aug 12 01:09:43.784706021 (79h43m38.215786152s) [upload=83064]: Upload finished. err: <nil>
Duration: 5.958995916s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..........................X.X..............X............X...] duration:
6.225969001s
FAIL (2025-08-12 01:09:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:06:46.580896282 (79h40m41.011976413s) [upload=83013]: Starting upload
Aug 12 01:06:46.580941678 (79h40m41.012021809s) [upload=83013]: Done starting upload
Aug 12 01:06:46.581072288 (79h40m41.012152409s) [upload=83013]: Uploading segments...
Aug 12 01:06:46.581190676 (79h40m41.012270807s) [upload=83013]: Got next segment. Inline: false
Aug 12 01:06:46.581240851 (79h40m41.012320982s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:06:46.581245901 (79h40m41.012326032s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:06:47.034837441 (79h40m41.465917572s) [seg_pos={0 0}, upload=83013]: Begin upload segment...
Aug 12 01:06:47.034874913 (79h40m41.465955034s) [seg_pos={0 0}, upload=83013]: Done begin upload segment.
Aug 12 01:06:47.034899981 (79h40m41.465980112s) [noise=true , address=104.36.82.46:4507 , piece_id=QSISVJDVA5CBNGU4XNORRMRRQAKJ2LJIHCQE6I2AB2SFQNKVKFFQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035000654 (79h40m41.466080785s) [noise=true , address=104.36.82.60:4352 , piece_id=R4VGACQOXFQSTNUQUM4T37OFQ4VFGVCIT66LWHJPO6ZA75HELZ3A, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035191629 (79h40m41.46627175s) [noise=true , address=104.36.82.2:4742 , piece_id=OK6IMN3VYSAHIP6ZWGC2E7TGJ6DZAOGYD4RRX6AUJQ56MOROSB7Q, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035406289 (79h40m41.46648642s) [noise=true , address=104.36.82.39:4746 , piece_id=ZQRPINZHQJRC5UC34QVGSWKLQ5X4HBCGUYV5KRVTL7JJBSVNLNBA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035418854 (79h40m41.466498985s) [noise=true , address=104.36.82.13:4214 , piece_id=6OC2MS2U3XG3R6WHFMDVU43EVKAXCOCRKHMZCGIMJYTCCHTRRQAQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035637983 (79h40m41.466718114s) [noise=true , address=104.36.82.23:4459 , piece_id=5KS7YCE4YCXLCJIBKLQM3X35RLENU2GL2NK5ZEQTD5A4TPO7227A, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035676917 (79h40m41.466757048s) [noise=true , address=104.36.82.35:4591 , piece_id=K3JVORHQZJQQ3RIVTITYXZOWAU7QBNK2UUPTYKGGX6NSRQWJFEWQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035861120 (79h40m41.466941241s) [noise=true , address=64.49.13.138:4491 , piece_id=H4GSXIIEFTJGHMMFOAUYPUB4PM52RM3K6FPGZODHTO2G6IFUYT2Q, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036005786 (79h40m41.467085917s) [noise=true , address=77.90.31.11:4563 , piece_id=UVYNFTEN624XMCVATFKAU4YF4DNZJVC5M7UMUFD6B2YH5RR7QEUA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036092211 (79h40m41.467172343s) [noise=true , address=156.146.43.225:4467 , piece_id=AXIOEQCLCFFIHSVZVZFGGTLA5LWXIMZKMQEH37PXDPQDREEDTKTQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036283057 (79h40m41.467363188s) [noise=true , address=104.36.82.4:4833 , piece_id=OTLE46L2IYXPDEJ6ZJHU4ITCJMDLWTZV6OZEI6HY4B6YED4RVNWA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036312393 (79h40m41.467392524s) [noise=true , address=104.36.82.37:4678 , piece_id=EBN3CEPDHQYTKK27L36WQZTVREDRKHQQWK3VJSRR7BX6LZKIQMEA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036603680 (79h40m41.467683812s) [noise=true , address=104.36.82.47:4534 , piece_id=EHHSA7RIGG2CBBYSV6JFVZVQSOTYDC53JLWDB5EHMKXRM3K2CR6A, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036618529 (79h40m41.46769866s) [noise=true , address=77.90.31.15:4707 , piece_id=EKWOXV33FTDWRCECU5ZSLCT3R2VKSDJ5WMITMJHNPY4TJ75DW2DA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036833179 (79h40m41.4679133s) [noise=true , address=79.127.220.101:4064 , piece_id=BJAOMTKF7RF7GW4VW37A3MYIMULNRKHDYLXOA7VGNFTREV4Z4RXA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.037041709 (79h40m41.46812184s) [noise=true , address=104.36.82.2:4739 , piece_id=XEIP7FRV5PBHA4YXEARSLWNLJSPXP42YVA2CSFE4DLGDMPJLHSGQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.037504033 (79h40m41.468584164s) [noise=true , address=104.36.82.38:4712 , piece_id=Z7KYXNG5UD2HC35A7JTB2WQ2PYURGA4TBLIC2CNEI2WRP53YLQCQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.037721920 (79h40m41.468802051s) [noise=true , address=77.90.31.19:4873 , piece_id=24E6YA7BOI5DSSWSRBJHYINEEXTV4MYEQRXJQFS6D4FKAYFU7RAA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:48.219514923 (79h40m42.650595055s) [upload=83013]: Next returned nil segment
Aug 12 01:06:48.219531996 (79h40m42.650612127s) [upload=83013]: Waiting for error group managing segments...
Aug 12 01:06:48.653264063 (79h40m43.084344194s) [noise=true , address=64.49.13.138:4491 , piece_id=H4GSXIIEFTJGHMMFOAUYPUB4PM52RM3K6FPGZODHTO2G6IFUYT2Q, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:48.907677479 (79h40m43.33875761s) [noise=true , address=79.127.220.101:4064 , piece_id=BJAOMTKF7RF7GW4VW37A3MYIMULNRKHDYLXOA7VGNFTREV4Z4RXA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:48.991232080 (79h40m43.422312212s) [noise=true , address=104.36.82.35:4591 , piece_id=K3JVORHQZJQQ3RIVTITYXZOWAU7QBNK2UUPTYKGGX6NSRQWJFEWQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:48.999722095 (79h40m43.430802216s) [noise=true , address=104.36.82.47:4534 , piece_id=EHHSA7RIGG2CBBYSV6JFVZVQSOTYDC53JLWDB5EHMKXRM3K2CR6A, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.029195007 (79h40m43.460275138s) [noise=true , address=104.36.82.38:4712 , piece_id=Z7KYXNG5UD2HC35A7JTB2WQ2PYURGA4TBLIC2CNEI2WRP53YLQCQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.080948291 (79h40m43.512028412s) [noise=true , address=104.36.82.39:4746 , piece_id=ZQRPINZHQJRC5UC34QVGSWKLQ5X4HBCGUYV5KRVTL7JJBSVNLNBA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.086365866 (79h40m43.517445997s) [noise=true , address=104.36.82.37:4678 , piece_id=EBN3CEPDHQYTKK27L36WQZTVREDRKHQQWK3VJSRR7BX6LZKIQMEA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.100518455 (79h40m43.531598577s) [noise=true , address=104.36.82.13:4214 , piece_id=6OC2MS2U3XG3R6WHFMDVU43EVKAXCOCRKHMZCGIMJYTCCHTRRQAQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.106936205 (79h40m43.538016336s) [noise=true , address=77.90.31.15:4707 , piece_id=EKWOXV33FTDWRCECU5ZSLCT3R2VKSDJ5WMITMJHNPY4TJ75DW2DA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.115294538 (79h40m43.546374669s) [noise=true , address=104.36.82.2:4742 , piece_id=OK6IMN3VYSAHIP6ZWGC2E7TGJ6DZAOGYD4RRX6AUJQ56MOROSB7Q, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.124780127 (79h40m43.555860258s) [noise=true , address=104.36.82.2:4739 , piece_id=XEIP7FRV5PBHA4YXEARSLWNLJSPXP42YVA2CSFE4DLGDMPJLHSGQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.133772954 (79h40m43.564853085s) [noise=true , address=156.146.43.225:4467 , piece_id=AXIOEQCLCFFIHSVZVZFGGTLA5LWXIMZKMQEH37PXDPQDREEDTKTQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.135662469 (79h40m43.5667426s) [noise=true , address=104.36.82.46:4507 , piece_id=QSISVJDVA5CBNGU4XNORRMRRQAKJ2LJIHCQE6I2AB2SFQNKVKFFQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.140946940 (79h40m43.572027061s) [noise=true , address=104.36.82.60:4352 , piece_id=R4VGACQOXFQSTNUQUM4T37OFQ4VFGVCIT66LWHJPO6ZA75HELZ3A, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.140963753 (79h40m43.572043884s) [seg_pos={0 0}, upload=83013]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:06:49.141102318 (79h40m43.572182449s) [noise=true , address=77.90.31.19:4873 , piece_id=24E6YA7BOI5DSSWSRBJHYINEEXTV4MYEQRXJQFS6D4FKAYFU7RAA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122JpURwWNSDakKSHma7tqooTbiTewq6RQcCD8avQX8SKGeRcYV): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141158645 (79h40m43.572238776s) [noise=true , address=77.90.31.11:4563 , piece_id=UVYNFTEN624XMCVATFKAU4YF4DNZJVC5M7UMUFD6B2YH5RR7QEUA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141214222 (79h40m43.572294353s) [noise=true , address=104.36.82.23:4459 , piece_id=5KS7YCE4YCXLCJIBKLQM3X35RLENU2GL2NK5ZEQTD5A4TPO7227A, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141264278 (79h40m43.572344409s) [noise=true , address=104.36.82.4:4833 , piece_id=OTLE46L2IYXPDEJ6ZJHU4ITCJMDLWTZV6OZEI6HY4B6YED4RVNWA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141273605 (79h40m43.572353736s) [seg_pos={0 0}, upload=83013]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:06:49.141325004 (79h40m43.572405125s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:06:49.141328951 (79h40m43.572409082s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:06:50.174749021 (79h40m44.605829142s) [upload=83013]: Done uploading segments...
Aug 12 01:06:50.174768309 (79h40m44.60584843s) [upload=83013]: Upload finished. err: <nil>
Duration: 6.225997587s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X..................X.X..............................X...X...] duration:
1.933203596s
FAIL (2025-08-12 01:09:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.933234594s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.X..................X.X..............................X...X..] duration:
1.879040121s
FAIL (2025-08-12 01:08:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.879067113s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...........................X.X..............X............X..] duration:
6.047462428s
FAIL (2025-08-12 01:08:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:06:46.580896282 (79h40m41.011976413s) [upload=83013]: Starting upload
Aug 12 01:06:46.580941678 (79h40m41.012021809s) [upload=83013]: Done starting upload
Aug 12 01:06:46.581072288 (79h40m41.012152409s) [upload=83013]: Uploading segments...
Aug 12 01:06:46.581190676 (79h40m41.012270807s) [upload=83013]: Got next segment. Inline: false
Aug 12 01:06:46.581240851 (79h40m41.012320982s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:06:46.581245901 (79h40m41.012326032s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:06:47.034837441 (79h40m41.465917572s) [seg_pos={0 0}, upload=83013]: Begin upload segment...
Aug 12 01:06:47.034874913 (79h40m41.465955034s) [seg_pos={0 0}, upload=83013]: Done begin upload segment.
Aug 12 01:06:47.034899981 (79h40m41.465980112s) [noise=true , address=104.36.82.46:4507 , piece_id=QSISVJDVA5CBNGU4XNORRMRRQAKJ2LJIHCQE6I2AB2SFQNKVKFFQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035000654 (79h40m41.466080785s) [noise=true , address=104.36.82.60:4352 , piece_id=R4VGACQOXFQSTNUQUM4T37OFQ4VFGVCIT66LWHJPO6ZA75HELZ3A, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035191629 (79h40m41.46627175s) [noise=true , address=104.36.82.2:4742 , piece_id=OK6IMN3VYSAHIP6ZWGC2E7TGJ6DZAOGYD4RRX6AUJQ56MOROSB7Q, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035406289 (79h40m41.46648642s) [noise=true , address=104.36.82.39:4746 , piece_id=ZQRPINZHQJRC5UC34QVGSWKLQ5X4HBCGUYV5KRVTL7JJBSVNLNBA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035418854 (79h40m41.466498985s) [noise=true , address=104.36.82.13:4214 , piece_id=6OC2MS2U3XG3R6WHFMDVU43EVKAXCOCRKHMZCGIMJYTCCHTRRQAQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035637983 (79h40m41.466718114s) [noise=true , address=104.36.82.23:4459 , piece_id=5KS7YCE4YCXLCJIBKLQM3X35RLENU2GL2NK5ZEQTD5A4TPO7227A, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035676917 (79h40m41.466757048s) [noise=true , address=104.36.82.35:4591 , piece_id=K3JVORHQZJQQ3RIVTITYXZOWAU7QBNK2UUPTYKGGX6NSRQWJFEWQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035861120 (79h40m41.466941241s) [noise=true , address=64.49.13.138:4491 , piece_id=H4GSXIIEFTJGHMMFOAUYPUB4PM52RM3K6FPGZODHTO2G6IFUYT2Q, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036005786 (79h40m41.467085917s) [noise=true , address=77.90.31.11:4563 , piece_id=UVYNFTEN624XMCVATFKAU4YF4DNZJVC5M7UMUFD6B2YH5RR7QEUA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036092211 (79h40m41.467172343s) [noise=true , address=156.146.43.225:4467 , piece_id=AXIOEQCLCFFIHSVZVZFGGTLA5LWXIMZKMQEH37PXDPQDREEDTKTQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036283057 (79h40m41.467363188s) [noise=true , address=104.36.82.4:4833 , piece_id=OTLE46L2IYXPDEJ6ZJHU4ITCJMDLWTZV6OZEI6HY4B6YED4RVNWA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036312393 (79h40m41.467392524s) [noise=true , address=104.36.82.37:4678 , piece_id=EBN3CEPDHQYTKK27L36WQZTVREDRKHQQWK3VJSRR7BX6LZKIQMEA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036603680 (79h40m41.467683812s) [noise=true , address=104.36.82.47:4534 , piece_id=EHHSA7RIGG2CBBYSV6JFVZVQSOTYDC53JLWDB5EHMKXRM3K2CR6A, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036618529 (79h40m41.46769866s) [noise=true , address=77.90.31.15:4707 , piece_id=EKWOXV33FTDWRCECU5ZSLCT3R2VKSDJ5WMITMJHNPY4TJ75DW2DA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036833179 (79h40m41.4679133s) [noise=true , address=79.127.220.101:4064 , piece_id=BJAOMTKF7RF7GW4VW37A3MYIMULNRKHDYLXOA7VGNFTREV4Z4RXA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.037041709 (79h40m41.46812184s) [noise=true , address=104.36.82.2:4739 , piece_id=XEIP7FRV5PBHA4YXEARSLWNLJSPXP42YVA2CSFE4DLGDMPJLHSGQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.037504033 (79h40m41.468584164s) [noise=true , address=104.36.82.38:4712 , piece_id=Z7KYXNG5UD2HC35A7JTB2WQ2PYURGA4TBLIC2CNEI2WRP53YLQCQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.037721920 (79h40m41.468802051s) [noise=true , address=77.90.31.19:4873 , piece_id=24E6YA7BOI5DSSWSRBJHYINEEXTV4MYEQRXJQFS6D4FKAYFU7RAA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:48.219514923 (79h40m42.650595055s) [upload=83013]: Next returned nil segment
Aug 12 01:06:48.219531996 (79h40m42.650612127s) [upload=83013]: Waiting for error group managing segments...
Aug 12 01:06:48.653264063 (79h40m43.084344194s) [noise=true , address=64.49.13.138:4491 , piece_id=H4GSXIIEFTJGHMMFOAUYPUB4PM52RM3K6FPGZODHTO2G6IFUYT2Q, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:48.907677479 (79h40m43.33875761s) [noise=true , address=79.127.220.101:4064 , piece_id=BJAOMTKF7RF7GW4VW37A3MYIMULNRKHDYLXOA7VGNFTREV4Z4RXA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:48.991232080 (79h40m43.422312212s) [noise=true , address=104.36.82.35:4591 , piece_id=K3JVORHQZJQQ3RIVTITYXZOWAU7QBNK2UUPTYKGGX6NSRQWJFEWQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:48.999722095 (79h40m43.430802216s) [noise=true , address=104.36.82.47:4534 , piece_id=EHHSA7RIGG2CBBYSV6JFVZVQSOTYDC53JLWDB5EHMKXRM3K2CR6A, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.029195007 (79h40m43.460275138s) [noise=true , address=104.36.82.38:4712 , piece_id=Z7KYXNG5UD2HC35A7JTB2WQ2PYURGA4TBLIC2CNEI2WRP53YLQCQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.080948291 (79h40m43.512028412s) [noise=true , address=104.36.82.39:4746 , piece_id=ZQRPINZHQJRC5UC34QVGSWKLQ5X4HBCGUYV5KRVTL7JJBSVNLNBA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.086365866 (79h40m43.517445997s) [noise=true , address=104.36.82.37:4678 , piece_id=EBN3CEPDHQYTKK27L36WQZTVREDRKHQQWK3VJSRR7BX6LZKIQMEA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.100518455 (79h40m43.531598577s) [noise=true , address=104.36.82.13:4214 , piece_id=6OC2MS2U3XG3R6WHFMDVU43EVKAXCOCRKHMZCGIMJYTCCHTRRQAQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.106936205 (79h40m43.538016336s) [noise=true , address=77.90.31.15:4707 , piece_id=EKWOXV33FTDWRCECU5ZSLCT3R2VKSDJ5WMITMJHNPY4TJ75DW2DA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.115294538 (79h40m43.546374669s) [noise=true , address=104.36.82.2:4742 , piece_id=OK6IMN3VYSAHIP6ZWGC2E7TGJ6DZAOGYD4RRX6AUJQ56MOROSB7Q, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.124780127 (79h40m43.555860258s) [noise=true , address=104.36.82.2:4739 , piece_id=XEIP7FRV5PBHA4YXEARSLWNLJSPXP42YVA2CSFE4DLGDMPJLHSGQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.133772954 (79h40m43.564853085s) [noise=true , address=156.146.43.225:4467 , piece_id=AXIOEQCLCFFIHSVZVZFGGTLA5LWXIMZKMQEH37PXDPQDREEDTKTQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.135662469 (79h40m43.5667426s) [noise=true , address=104.36.82.46:4507 , piece_id=QSISVJDVA5CBNGU4XNORRMRRQAKJ2LJIHCQE6I2AB2SFQNKVKFFQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.140946940 (79h40m43.572027061s) [noise=true , address=104.36.82.60:4352 , piece_id=R4VGACQOXFQSTNUQUM4T37OFQ4VFGVCIT66LWHJPO6ZA75HELZ3A, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.140963753 (79h40m43.572043884s) [seg_pos={0 0}, upload=83013]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:06:49.141102318 (79h40m43.572182449s) [noise=true , address=77.90.31.19:4873 , piece_id=24E6YA7BOI5DSSWSRBJHYINEEXTV4MYEQRXJQFS6D4FKAYFU7RAA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122JpURwWNSDakKSHma7tqooTbiTewq6RQcCD8avQX8SKGeRcYV): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141158645 (79h40m43.572238776s) [noise=true , address=77.90.31.11:4563 , piece_id=UVYNFTEN624XMCVATFKAU4YF4DNZJVC5M7UMUFD6B2YH5RR7QEUA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141214222 (79h40m43.572294353s) [noise=true , address=104.36.82.23:4459 , piece_id=5KS7YCE4YCXLCJIBKLQM3X35RLENU2GL2NK5ZEQTD5A4TPO7227A, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141264278 (79h40m43.572344409s) [noise=true , address=104.36.82.4:4833 , piece_id=OTLE46L2IYXPDEJ6ZJHU4ITCJMDLWTZV6OZEI6HY4B6YED4RVNWA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141273605 (79h40m43.572353736s) [seg_pos={0 0}, upload=83013]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:06:49.141325004 (79h40m43.572405125s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:06:49.141328951 (79h40m43.572409082s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:06:50.174749021 (79h40m44.605829142s) [upload=83013]: Done uploading segments...
Aug 12 01:06:50.174768309 (79h40m44.60584843s) [upload=83013]: Upload finished. err: <nil>
Duration: 6.047501683s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..X..................X.X..............................X...X.] duration:
1.931764064s
FAIL (2025-08-12 01:07:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.931788732s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...X..................X.X..............................X...X] duration:
884.836718ms
FAIL (2025-08-12 01:07:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 01:07:22.214657607 (79h41m16.645737738s) [upload=83023]: Starting upload Aug 12 01:07:22.214713735 (79h41m16.645793856s) [upload=83023]: Done starting upload Aug 12 01:07:22.214782787 (79h41m16.645862918s) [upload=83023]: Uploading segments... Aug 12 01:07:22.214821451 (79h41m16.645901582s) [upload=83023]: Got next segment. Inline: true Aug 12 01:07:22.214825289 (79h41m16.64590542s) [upload=83023]: Waiting for error group managing segments... Aug 12 01:07:22.214860015 (79h41m16.645940146s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:07:22.214864023 (79h41m16.645944154s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:07:22.214870034 (79h41m16.645950165s) [upload=83023]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:07:22.427456610 (79h41m16.858536741s) [upload=83023]: Done uploading segments... Aug 12 01:07:22.427472841 (79h41m16.858552972s) [upload=83023]: Upload finished. err: metaclient: Too Many Requests
Duration: 884.857568ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [............................X.X..............X............X.] duration:
5.866899551s
FAIL (2025-08-12 01:07:17 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:06:46.580896282 (79h40m41.011976413s) [upload=83013]: Starting upload
Aug 12 01:06:46.580941678 (79h40m41.012021809s) [upload=83013]: Done starting upload
Aug 12 01:06:46.581072288 (79h40m41.012152409s) [upload=83013]: Uploading segments...
Aug 12 01:06:46.581190676 (79h40m41.012270807s) [upload=83013]: Got next segment. Inline: false
Aug 12 01:06:46.581240851 (79h40m41.012320982s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:06:46.581245901 (79h40m41.012326032s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:06:47.034837441 (79h40m41.465917572s) [seg_pos={0 0}, upload=83013]: Begin upload segment...
Aug 12 01:06:47.034874913 (79h40m41.465955034s) [seg_pos={0 0}, upload=83013]: Done begin upload segment.
Aug 12 01:06:47.034899981 (79h40m41.465980112s) [noise=true , address=104.36.82.46:4507 , piece_id=QSISVJDVA5CBNGU4XNORRMRRQAKJ2LJIHCQE6I2AB2SFQNKVKFFQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035000654 (79h40m41.466080785s) [noise=true , address=104.36.82.60:4352 , piece_id=R4VGACQOXFQSTNUQUM4T37OFQ4VFGVCIT66LWHJPO6ZA75HELZ3A, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035191629 (79h40m41.46627175s) [noise=true , address=104.36.82.2:4742 , piece_id=OK6IMN3VYSAHIP6ZWGC2E7TGJ6DZAOGYD4RRX6AUJQ56MOROSB7Q, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035406289 (79h40m41.46648642s) [noise=true , address=104.36.82.39:4746 , piece_id=ZQRPINZHQJRC5UC34QVGSWKLQ5X4HBCGUYV5KRVTL7JJBSVNLNBA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035418854 (79h40m41.466498985s) [noise=true , address=104.36.82.13:4214 , piece_id=6OC2MS2U3XG3R6WHFMDVU43EVKAXCOCRKHMZCGIMJYTCCHTRRQAQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035637983 (79h40m41.466718114s) [noise=true , address=104.36.82.23:4459 , piece_id=5KS7YCE4YCXLCJIBKLQM3X35RLENU2GL2NK5ZEQTD5A4TPO7227A, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035676917 (79h40m41.466757048s) [noise=true , address=104.36.82.35:4591 , piece_id=K3JVORHQZJQQ3RIVTITYXZOWAU7QBNK2UUPTYKGGX6NSRQWJFEWQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035861120 (79h40m41.466941241s) [noise=true , address=64.49.13.138:4491 , piece_id=H4GSXIIEFTJGHMMFOAUYPUB4PM52RM3K6FPGZODHTO2G6IFUYT2Q, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036005786 (79h40m41.467085917s) [noise=true , address=77.90.31.11:4563 , piece_id=UVYNFTEN624XMCVATFKAU4YF4DNZJVC5M7UMUFD6B2YH5RR7QEUA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036092211 (79h40m41.467172343s) [noise=true , address=156.146.43.225:4467 , piece_id=AXIOEQCLCFFIHSVZVZFGGTLA5LWXIMZKMQEH37PXDPQDREEDTKTQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036283057 (79h40m41.467363188s) [noise=true , address=104.36.82.4:4833 , piece_id=OTLE46L2IYXPDEJ6ZJHU4ITCJMDLWTZV6OZEI6HY4B6YED4RVNWA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036312393 (79h40m41.467392524s) [noise=true , address=104.36.82.37:4678 , piece_id=EBN3CEPDHQYTKK27L36WQZTVREDRKHQQWK3VJSRR7BX6LZKIQMEA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036603680 (79h40m41.467683812s) [noise=true , address=104.36.82.47:4534 , piece_id=EHHSA7RIGG2CBBYSV6JFVZVQSOTYDC53JLWDB5EHMKXRM3K2CR6A, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036618529 (79h40m41.46769866s) [noise=true , address=77.90.31.15:4707 , piece_id=EKWOXV33FTDWRCECU5ZSLCT3R2VKSDJ5WMITMJHNPY4TJ75DW2DA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036833179 (79h40m41.4679133s) [noise=true , address=79.127.220.101:4064 , piece_id=BJAOMTKF7RF7GW4VW37A3MYIMULNRKHDYLXOA7VGNFTREV4Z4RXA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.037041709 (79h40m41.46812184s) [noise=true , address=104.36.82.2:4739 , piece_id=XEIP7FRV5PBHA4YXEARSLWNLJSPXP42YVA2CSFE4DLGDMPJLHSGQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.037504033 (79h40m41.468584164s) [noise=true , address=104.36.82.38:4712 , piece_id=Z7KYXNG5UD2HC35A7JTB2WQ2PYURGA4TBLIC2CNEI2WRP53YLQCQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.037721920 (79h40m41.468802051s) [noise=true , address=77.90.31.19:4873 , piece_id=24E6YA7BOI5DSSWSRBJHYINEEXTV4MYEQRXJQFS6D4FKAYFU7RAA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:48.219514923 (79h40m42.650595055s) [upload=83013]: Next returned nil segment
Aug 12 01:06:48.219531996 (79h40m42.650612127s) [upload=83013]: Waiting for error group managing segments...
Aug 12 01:06:48.653264063 (79h40m43.084344194s) [noise=true , address=64.49.13.138:4491 , piece_id=H4GSXIIEFTJGHMMFOAUYPUB4PM52RM3K6FPGZODHTO2G6IFUYT2Q, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:48.907677479 (79h40m43.33875761s) [noise=true , address=79.127.220.101:4064 , piece_id=BJAOMTKF7RF7GW4VW37A3MYIMULNRKHDYLXOA7VGNFTREV4Z4RXA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:48.991232080 (79h40m43.422312212s) [noise=true , address=104.36.82.35:4591 , piece_id=K3JVORHQZJQQ3RIVTITYXZOWAU7QBNK2UUPTYKGGX6NSRQWJFEWQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:48.999722095 (79h40m43.430802216s) [noise=true , address=104.36.82.47:4534 , piece_id=EHHSA7RIGG2CBBYSV6JFVZVQSOTYDC53JLWDB5EHMKXRM3K2CR6A, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.029195007 (79h40m43.460275138s) [noise=true , address=104.36.82.38:4712 , piece_id=Z7KYXNG5UD2HC35A7JTB2WQ2PYURGA4TBLIC2CNEI2WRP53YLQCQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.080948291 (79h40m43.512028412s) [noise=true , address=104.36.82.39:4746 , piece_id=ZQRPINZHQJRC5UC34QVGSWKLQ5X4HBCGUYV5KRVTL7JJBSVNLNBA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.086365866 (79h40m43.517445997s) [noise=true , address=104.36.82.37:4678 , piece_id=EBN3CEPDHQYTKK27L36WQZTVREDRKHQQWK3VJSRR7BX6LZKIQMEA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.100518455 (79h40m43.531598577s) [noise=true , address=104.36.82.13:4214 , piece_id=6OC2MS2U3XG3R6WHFMDVU43EVKAXCOCRKHMZCGIMJYTCCHTRRQAQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.106936205 (79h40m43.538016336s) [noise=true , address=77.90.31.15:4707 , piece_id=EKWOXV33FTDWRCECU5ZSLCT3R2VKSDJ5WMITMJHNPY4TJ75DW2DA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.115294538 (79h40m43.546374669s) [noise=true , address=104.36.82.2:4742 , piece_id=OK6IMN3VYSAHIP6ZWGC2E7TGJ6DZAOGYD4RRX6AUJQ56MOROSB7Q, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.124780127 (79h40m43.555860258s) [noise=true , address=104.36.82.2:4739 , piece_id=XEIP7FRV5PBHA4YXEARSLWNLJSPXP42YVA2CSFE4DLGDMPJLHSGQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.133772954 (79h40m43.564853085s) [noise=true , address=156.146.43.225:4467 , piece_id=AXIOEQCLCFFIHSVZVZFGGTLA5LWXIMZKMQEH37PXDPQDREEDTKTQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.135662469 (79h40m43.5667426s) [noise=true , address=104.36.82.46:4507 , piece_id=QSISVJDVA5CBNGU4XNORRMRRQAKJ2LJIHCQE6I2AB2SFQNKVKFFQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.140946940 (79h40m43.572027061s) [noise=true , address=104.36.82.60:4352 , piece_id=R4VGACQOXFQSTNUQUM4T37OFQ4VFGVCIT66LWHJPO6ZA75HELZ3A, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.140963753 (79h40m43.572043884s) [seg_pos={0 0}, upload=83013]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:06:49.141102318 (79h40m43.572182449s) [noise=true , address=77.90.31.19:4873 , piece_id=24E6YA7BOI5DSSWSRBJHYINEEXTV4MYEQRXJQFS6D4FKAYFU7RAA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122JpURwWNSDakKSHma7tqooTbiTewq6RQcCD8avQX8SKGeRcYV): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141158645 (79h40m43.572238776s) [noise=true , address=77.90.31.11:4563 , piece_id=UVYNFTEN624XMCVATFKAU4YF4DNZJVC5M7UMUFD6B2YH5RR7QEUA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141214222 (79h40m43.572294353s) [noise=true , address=104.36.82.23:4459 , piece_id=5KS7YCE4YCXLCJIBKLQM3X35RLENU2GL2NK5ZEQTD5A4TPO7227A, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141264278 (79h40m43.572344409s) [noise=true , address=104.36.82.4:4833 , piece_id=OTLE46L2IYXPDEJ6ZJHU4ITCJMDLWTZV6OZEI6HY4B6YED4RVNWA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141273605 (79h40m43.572353736s) [seg_pos={0 0}, upload=83013]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:06:49.141325004 (79h40m43.572405125s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:06:49.141328951 (79h40m43.572409082s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:06:50.174749021 (79h40m44.605829142s) [upload=83013]: Done uploading segments...
Aug 12 01:06:50.174768309 (79h40m44.60584843s) [upload=83013]: Upload finished. err: <nil>
Duration: 5.866923548s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.............................X.X..............X............X] duration:
4.702439281s
FAIL (2025-08-12 01:06:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 01:06:46.580896282 (79h40m41.011976413s) [upload=83013]: Starting upload
Aug 12 01:06:46.580941678 (79h40m41.012021809s) [upload=83013]: Done starting upload
Aug 12 01:06:46.581072288 (79h40m41.012152409s) [upload=83013]: Uploading segments...
Aug 12 01:06:46.581190676 (79h40m41.012270807s) [upload=83013]: Got next segment. Inline: false
Aug 12 01:06:46.581240851 (79h40m41.012320982s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 01:06:46.581245901 (79h40m41.012326032s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 01:06:47.034837441 (79h40m41.465917572s) [seg_pos={0 0}, upload=83013]: Begin upload segment...
Aug 12 01:06:47.034874913 (79h40m41.465955034s) [seg_pos={0 0}, upload=83013]: Done begin upload segment.
Aug 12 01:06:47.034899981 (79h40m41.465980112s) [noise=true , address=104.36.82.46:4507 , piece_id=QSISVJDVA5CBNGU4XNORRMRRQAKJ2LJIHCQE6I2AB2SFQNKVKFFQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035000654 (79h40m41.466080785s) [noise=true , address=104.36.82.60:4352 , piece_id=R4VGACQOXFQSTNUQUM4T37OFQ4VFGVCIT66LWHJPO6ZA75HELZ3A, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035191629 (79h40m41.46627175s) [noise=true , address=104.36.82.2:4742 , piece_id=OK6IMN3VYSAHIP6ZWGC2E7TGJ6DZAOGYD4RRX6AUJQ56MOROSB7Q, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035406289 (79h40m41.46648642s) [noise=true , address=104.36.82.39:4746 , piece_id=ZQRPINZHQJRC5UC34QVGSWKLQ5X4HBCGUYV5KRVTL7JJBSVNLNBA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035418854 (79h40m41.466498985s) [noise=true , address=104.36.82.13:4214 , piece_id=6OC2MS2U3XG3R6WHFMDVU43EVKAXCOCRKHMZCGIMJYTCCHTRRQAQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035637983 (79h40m41.466718114s) [noise=true , address=104.36.82.23:4459 , piece_id=5KS7YCE4YCXLCJIBKLQM3X35RLENU2GL2NK5ZEQTD5A4TPO7227A, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035676917 (79h40m41.466757048s) [noise=true , address=104.36.82.35:4591 , piece_id=K3JVORHQZJQQ3RIVTITYXZOWAU7QBNK2UUPTYKGGX6NSRQWJFEWQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.035861120 (79h40m41.466941241s) [noise=true , address=64.49.13.138:4491 , piece_id=H4GSXIIEFTJGHMMFOAUYPUB4PM52RM3K6FPGZODHTO2G6IFUYT2Q, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036005786 (79h40m41.467085917s) [noise=true , address=77.90.31.11:4563 , piece_id=UVYNFTEN624XMCVATFKAU4YF4DNZJVC5M7UMUFD6B2YH5RR7QEUA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036092211 (79h40m41.467172343s) [noise=true , address=156.146.43.225:4467 , piece_id=AXIOEQCLCFFIHSVZVZFGGTLA5LWXIMZKMQEH37PXDPQDREEDTKTQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036283057 (79h40m41.467363188s) [noise=true , address=104.36.82.4:4833 , piece_id=OTLE46L2IYXPDEJ6ZJHU4ITCJMDLWTZV6OZEI6HY4B6YED4RVNWA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036312393 (79h40m41.467392524s) [noise=true , address=104.36.82.37:4678 , piece_id=EBN3CEPDHQYTKK27L36WQZTVREDRKHQQWK3VJSRR7BX6LZKIQMEA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036603680 (79h40m41.467683812s) [noise=true , address=104.36.82.47:4534 , piece_id=EHHSA7RIGG2CBBYSV6JFVZVQSOTYDC53JLWDB5EHMKXRM3K2CR6A, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036618529 (79h40m41.46769866s) [noise=true , address=77.90.31.15:4707 , piece_id=EKWOXV33FTDWRCECU5ZSLCT3R2VKSDJ5WMITMJHNPY4TJ75DW2DA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.036833179 (79h40m41.4679133s) [noise=true , address=79.127.220.101:4064 , piece_id=BJAOMTKF7RF7GW4VW37A3MYIMULNRKHDYLXOA7VGNFTREV4Z4RXA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.037041709 (79h40m41.46812184s) [noise=true , address=104.36.82.2:4739 , piece_id=XEIP7FRV5PBHA4YXEARSLWNLJSPXP42YVA2CSFE4DLGDMPJLHSGQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.037504033 (79h40m41.468584164s) [noise=true , address=104.36.82.38:4712 , piece_id=Z7KYXNG5UD2HC35A7JTB2WQ2PYURGA4TBLIC2CNEI2WRP53YLQCQ, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:47.037721920 (79h40m41.468802051s) [noise=true , address=77.90.31.19:4873 , piece_id=24E6YA7BOI5DSSWSRBJHYINEEXTV4MYEQRXJQFS6D4FKAYFU7RAA, seg_pos={0 0}, upload=83013]: Uploading piece...
Aug 12 01:06:48.219514923 (79h40m42.650595055s) [upload=83013]: Next returned nil segment
Aug 12 01:06:48.219531996 (79h40m42.650612127s) [upload=83013]: Waiting for error group managing segments...
Aug 12 01:06:48.653264063 (79h40m43.084344194s) [noise=true , address=64.49.13.138:4491 , piece_id=H4GSXIIEFTJGHMMFOAUYPUB4PM52RM3K6FPGZODHTO2G6IFUYT2Q, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:48.907677479 (79h40m43.33875761s) [noise=true , address=79.127.220.101:4064 , piece_id=BJAOMTKF7RF7GW4VW37A3MYIMULNRKHDYLXOA7VGNFTREV4Z4RXA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:48.991232080 (79h40m43.422312212s) [noise=true , address=104.36.82.35:4591 , piece_id=K3JVORHQZJQQ3RIVTITYXZOWAU7QBNK2UUPTYKGGX6NSRQWJFEWQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:48.999722095 (79h40m43.430802216s) [noise=true , address=104.36.82.47:4534 , piece_id=EHHSA7RIGG2CBBYSV6JFVZVQSOTYDC53JLWDB5EHMKXRM3K2CR6A, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.029195007 (79h40m43.460275138s) [noise=true , address=104.36.82.38:4712 , piece_id=Z7KYXNG5UD2HC35A7JTB2WQ2PYURGA4TBLIC2CNEI2WRP53YLQCQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.080948291 (79h40m43.512028412s) [noise=true , address=104.36.82.39:4746 , piece_id=ZQRPINZHQJRC5UC34QVGSWKLQ5X4HBCGUYV5KRVTL7JJBSVNLNBA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.086365866 (79h40m43.517445997s) [noise=true , address=104.36.82.37:4678 , piece_id=EBN3CEPDHQYTKK27L36WQZTVREDRKHQQWK3VJSRR7BX6LZKIQMEA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.100518455 (79h40m43.531598577s) [noise=true , address=104.36.82.13:4214 , piece_id=6OC2MS2U3XG3R6WHFMDVU43EVKAXCOCRKHMZCGIMJYTCCHTRRQAQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.106936205 (79h40m43.538016336s) [noise=true , address=77.90.31.15:4707 , piece_id=EKWOXV33FTDWRCECU5ZSLCT3R2VKSDJ5WMITMJHNPY4TJ75DW2DA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.115294538 (79h40m43.546374669s) [noise=true , address=104.36.82.2:4742 , piece_id=OK6IMN3VYSAHIP6ZWGC2E7TGJ6DZAOGYD4RRX6AUJQ56MOROSB7Q, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.124780127 (79h40m43.555860258s) [noise=true , address=104.36.82.2:4739 , piece_id=XEIP7FRV5PBHA4YXEARSLWNLJSPXP42YVA2CSFE4DLGDMPJLHSGQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.133772954 (79h40m43.564853085s) [noise=true , address=156.146.43.225:4467 , piece_id=AXIOEQCLCFFIHSVZVZFGGTLA5LWXIMZKMQEH37PXDPQDREEDTKTQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.135662469 (79h40m43.5667426s) [noise=true , address=104.36.82.46:4507 , piece_id=QSISVJDVA5CBNGU4XNORRMRRQAKJ2LJIHCQE6I2AB2SFQNKVKFFQ, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.140946940 (79h40m43.572027061s) [noise=true , address=104.36.82.60:4352 , piece_id=R4VGACQOXFQSTNUQUM4T37OFQ4VFGVCIT66LWHJPO6ZA75HELZ3A, seg_pos={0 0}, upload=83013]: Done uploading piece. err: <nil>
Aug 12 01:06:49.140963753 (79h40m43.572043884s) [seg_pos={0 0}, upload=83013]: Segment reached optimal threshold of 14 pieces.
Aug 12 01:06:49.141102318 (79h40m43.572182449s) [noise=true , address=77.90.31.19:4873 , piece_id=24E6YA7BOI5DSSWSRBJHYINEEXTV4MYEQRXJQFS6D4FKAYFU7RAA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122JpURwWNSDakKSHma7tqooTbiTewq6RQcCD8avQX8SKGeRcYV): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141158645 (79h40m43.572238776s) [noise=true , address=77.90.31.11:4563 , piece_id=UVYNFTEN624XMCVATFKAU4YF4DNZJVC5M7UMUFD6B2YH5RR7QEUA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141214222 (79h40m43.572294353s) [noise=true , address=104.36.82.23:4459 , piece_id=5KS7YCE4YCXLCJIBKLQM3X35RLENU2GL2NK5ZEQTD5A4TPO7227A, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hGJmw1LEAdN7C4j5ScEfhugkFneArUxcAuneCMGwsKNjQpn2N): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141264278 (79h40m43.572344409s) [noise=true , address=104.36.82.4:4833 , piece_id=OTLE46L2IYXPDEJ6ZJHU4ITCJMDLWTZV6OZEI6HY4B6YED4RVNWA, seg_pos={0 0}, upload=83013]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jfQbLaQjEXhVTbTPuawAQAbKJSN5RA8kBqz6JVDATQEGAsZ6K): protocol: expected piece hash; context canceled; EOF
Aug 12 01:06:49.141273605 (79h40m43.572353736s) [seg_pos={0 0}, upload=83013]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 01:06:49.141325004 (79h40m43.572405125s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 01:06:49.141328951 (79h40m43.572409082s) [upload=83013]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 01:06:50.174749021 (79h40m44.605829142s) [upload=83013]: Done uploading segments...
Aug 12 01:06:50.174768309 (79h40m44.60584843s) [upload=83013]: Upload finished. err: <nil>
Duration: 4.702466144s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X..................X.X..............................X...] duration:
1.868397513s
FAIL (2025-08-12 01:06:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ec6e1f6501936263346ad191127bf4bfb961c17d90560241d39a277573790b73 != before f010c8e2ffcde3fcf248da05131217bc00453ab1b340fd8e29e0e9a7ac9b732d ======LOGS====== Aug 12 01:03:49.944921732 (79h37m44.376001863s) [upload=82962]: Starting upload Aug 12 01:03:49.944969864 (79h37m44.376049995s) [upload=82962]: Done starting upload Aug 12 01:03:49.945017946 (79h37m44.376098067s) [upload=82962]: Uploading segments... Aug 12 01:03:49.945056230 (79h37m44.376136361s) [upload=82962]: Got next segment. Inline: true Aug 12 01:03:49.945059686 (79h37m44.376139807s) [upload=82962]: Waiting for error group managing segments... Aug 12 01:03:49.945094593 (79h37m44.376174714s) [upload=82962]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:03:49.945098711 (79h37m44.376178842s) [upload=82962]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:03:49.945101195 (79h37m44.376181326s) [upload=82962]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:03:50.387180365 (79h37m44.818260497s) [upload=82962]: Done uploading segments... Aug 12 01:03:50.387234078 (79h37m44.818314209s) [upload=82962]: Upload finished. err: <nil>
Duration: 1.868415878s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X..................X.X..............................X..] duration:
2.01752797s
FAIL (2025-08-12 01:05:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ec6e1f6501936263346ad191127bf4bfb961c17d90560241d39a277573790b73 != before f010c8e2ffcde3fcf248da05131217bc00453ab1b340fd8e29e0e9a7ac9b732d ======LOGS====== Aug 12 01:03:49.944921732 (79h37m44.376001863s) [upload=82962]: Starting upload Aug 12 01:03:49.944969864 (79h37m44.376049995s) [upload=82962]: Done starting upload Aug 12 01:03:49.945017946 (79h37m44.376098067s) [upload=82962]: Uploading segments... Aug 12 01:03:49.945056230 (79h37m44.376136361s) [upload=82962]: Got next segment. Inline: true Aug 12 01:03:49.945059686 (79h37m44.376139807s) [upload=82962]: Waiting for error group managing segments... Aug 12 01:03:49.945094593 (79h37m44.376174714s) [upload=82962]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:03:49.945098711 (79h37m44.376178842s) [upload=82962]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:03:49.945101195 (79h37m44.376181326s) [upload=82962]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:03:50.387180365 (79h37m44.818260497s) [upload=82962]: Done uploading segments... Aug 12 01:03:50.387234078 (79h37m44.818314209s) [upload=82962]: Upload finished. err: <nil>
Duration: 2.017546735s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............................X.X..............X............] duration:
5.797192958s
FAIL (2025-08-12 01:05:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 00:57:09.982949505 (79h31m4.414029636s) [upload=82851]: Starting upload Aug 12 00:57:09.982991335 (79h31m4.414071466s) [upload=82851]: Done starting upload Aug 12 00:57:09.983156180 (79h31m4.414236311s) [upload=82851]: Uploading segments... Aug 12 00:57:09.983188182 (79h31m4.414268313s) [upload=82851]: Got next segment. Inline: false Aug 12 00:57:09.983210174 (79h31m4.414290295s) [upload=82851]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:57:09.983214212 (79h31m4.414294343s) [upload=82851]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 00:57:10.196768148 (79h31m4.627848289s) [upload=82851]: Next segment err: metaclient: Too Many Requests Aug 12 00:57:10.196794709 (79h31m4.62787484s) [upload=82851]: Done uploading segments... Aug 12 00:57:10.196811541 (79h31m4.627891672s) [upload=82851]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.797280314s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............................X.X..............X...........] duration:
6.626472533s
FAIL (2025-08-12 01:05:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 00:57:09.982949505 (79h31m4.414029636s) [upload=82851]: Starting upload Aug 12 00:57:09.982991335 (79h31m4.414071466s) [upload=82851]: Done starting upload Aug 12 00:57:09.983156180 (79h31m4.414236311s) [upload=82851]: Uploading segments... Aug 12 00:57:09.983188182 (79h31m4.414268313s) [upload=82851]: Got next segment. Inline: false Aug 12 00:57:09.983210174 (79h31m4.414290295s) [upload=82851]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:57:09.983214212 (79h31m4.414294343s) [upload=82851]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 00:57:10.196768148 (79h31m4.627848289s) [upload=82851]: Next segment err: metaclient: Too Many Requests Aug 12 00:57:10.196794709 (79h31m4.62787484s) [upload=82851]: Done uploading segments... Aug 12 00:57:10.196811541 (79h31m4.627891672s) [upload=82851]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.626495747s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X..................X.X..............................X.] duration:
1.894636054s
FAIL (2025-08-12 01:04:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ec6e1f6501936263346ad191127bf4bfb961c17d90560241d39a277573790b73 != before f010c8e2ffcde3fcf248da05131217bc00453ab1b340fd8e29e0e9a7ac9b732d ======LOGS====== Aug 12 01:03:49.944921732 (79h37m44.376001863s) [upload=82962]: Starting upload Aug 12 01:03:49.944969864 (79h37m44.376049995s) [upload=82962]: Done starting upload Aug 12 01:03:49.945017946 (79h37m44.376098067s) [upload=82962]: Uploading segments... Aug 12 01:03:49.945056230 (79h37m44.376136361s) [upload=82962]: Got next segment. Inline: true Aug 12 01:03:49.945059686 (79h37m44.376139807s) [upload=82962]: Waiting for error group managing segments... Aug 12 01:03:49.945094593 (79h37m44.376174714s) [upload=82962]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:03:49.945098711 (79h37m44.376178842s) [upload=82962]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:03:49.945101195 (79h37m44.376181326s) [upload=82962]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:03:50.387180365 (79h37m44.818260497s) [upload=82962]: Done uploading segments... Aug 12 01:03:50.387234078 (79h37m44.818314209s) [upload=82962]: Upload finished. err: <nil>
Duration: 1.894658588s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X...............................X.X..............X..........] duration:
5.952579298s
FAIL (2025-08-12 01:04:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 00:57:09.982949505 (79h31m4.414029636s) [upload=82851]: Starting upload Aug 12 00:57:09.982991335 (79h31m4.414071466s) [upload=82851]: Done starting upload Aug 12 00:57:09.983156180 (79h31m4.414236311s) [upload=82851]: Uploading segments... Aug 12 00:57:09.983188182 (79h31m4.414268313s) [upload=82851]: Got next segment. Inline: false Aug 12 00:57:09.983210174 (79h31m4.414290295s) [upload=82851]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:57:09.983214212 (79h31m4.414294343s) [upload=82851]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 00:57:10.196768148 (79h31m4.627848289s) [upload=82851]: Next segment err: metaclient: Too Many Requests Aug 12 00:57:10.196794709 (79h31m4.62787484s) [upload=82851]: Done uploading segments... Aug 12 00:57:10.196811541 (79h31m4.627891672s) [upload=82851]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.952618123s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X..................X.X..............................X] duration:
1.849114474s
FAIL (2025-08-12 01:03:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after ec6e1f6501936263346ad191127bf4bfb961c17d90560241d39a277573790b73 != before f010c8e2ffcde3fcf248da05131217bc00453ab1b340fd8e29e0e9a7ac9b732d ======LOGS====== Aug 12 01:03:49.944921732 (79h37m44.376001863s) [upload=82962]: Starting upload Aug 12 01:03:49.944969864 (79h37m44.376049995s) [upload=82962]: Done starting upload Aug 12 01:03:49.945017946 (79h37m44.376098067s) [upload=82962]: Uploading segments... Aug 12 01:03:49.945056230 (79h37m44.376136361s) [upload=82962]: Got next segment. Inline: true Aug 12 01:03:49.945059686 (79h37m44.376139807s) [upload=82962]: Waiting for error group managing segments... Aug 12 01:03:49.945094593 (79h37m44.376174714s) [upload=82962]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 01:03:49.945098711 (79h37m44.376178842s) [upload=82962]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 01:03:49.945101195 (79h37m44.376181326s) [upload=82962]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 01:03:50.387180365 (79h37m44.818260497s) [upload=82962]: Done uploading segments... Aug 12 01:03:50.387234078 (79h37m44.818314209s) [upload=82962]: Upload finished. err: <nil>
Duration: 1.84913228s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X...............................X.X..............X.........] duration:
5.996574656s
FAIL (2025-08-12 01:03:17 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 00:57:09.982949505 (79h31m4.414029636s) [upload=82851]: Starting upload Aug 12 00:57:09.982991335 (79h31m4.414071466s) [upload=82851]: Done starting upload Aug 12 00:57:09.983156180 (79h31m4.414236311s) [upload=82851]: Uploading segments... Aug 12 00:57:09.983188182 (79h31m4.414268313s) [upload=82851]: Got next segment. Inline: false Aug 12 00:57:09.983210174 (79h31m4.414290295s) [upload=82851]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:57:09.983214212 (79h31m4.414294343s) [upload=82851]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 00:57:10.196768148 (79h31m4.627848289s) [upload=82851]: Next segment err: metaclient: Too Many Requests Aug 12 00:57:10.196794709 (79h31m4.62787484s) [upload=82851]: Done uploading segments... Aug 12 00:57:10.196811541 (79h31m4.627891672s) [upload=82851]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.996608981s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.......X..................X.X..............................] duration:
2.111971024s
FAIL (2025-08-12 01:02:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 00:45:40.488327896 (79h19m34.919408047s) [upload=82643]: Starting upload Aug 12 00:45:40.488423559 (79h19m34.91950369s) [upload=82643]: Done starting upload Aug 12 00:45:40.488511647 (79h19m34.919591808s) [upload=82643]: Uploading segments... Aug 12 00:45:40.488567864 (79h19m34.919647995s) [upload=82643]: Got next segment. Inline: true Aug 12 00:45:40.488572654 (79h19m34.919652775s) [upload=82643]: Waiting for error group managing segments... Aug 12 00:45:40.488610867 (79h19m34.919690998s) [upload=82643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:45:40.488615295 (79h19m34.919695427s) [upload=82643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 00:45:40.488617930 (79h19m34.919698061s) [upload=82643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 00:45:40.768759673 (79h19m35.199839804s) [upload=82643]: Done uploading segments... Aug 12 00:45:40.768781605 (79h19m35.199861736s) [upload=82643]: Upload finished. err: <nil>
Duration: 2.111999959s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X...............................X.X..............X........] duration:
6.213780069s
FAIL (2025-08-12 01:02:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 00:57:09.982949505 (79h31m4.414029636s) [upload=82851]: Starting upload Aug 12 00:57:09.982991335 (79h31m4.414071466s) [upload=82851]: Done starting upload Aug 12 00:57:09.983156180 (79h31m4.414236311s) [upload=82851]: Uploading segments... Aug 12 00:57:09.983188182 (79h31m4.414268313s) [upload=82851]: Got next segment. Inline: false Aug 12 00:57:09.983210174 (79h31m4.414290295s) [upload=82851]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:57:09.983214212 (79h31m4.414294343s) [upload=82851]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 00:57:10.196768148 (79h31m4.627848289s) [upload=82851]: Next segment err: metaclient: Too Many Requests Aug 12 00:57:10.196794709 (79h31m4.62787484s) [upload=82851]: Done uploading segments... Aug 12 00:57:10.196811541 (79h31m4.627891672s) [upload=82851]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.21380174s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X.......X..................X.X.............................] duration:
2.045131715s
FAIL (2025-08-12 01:02:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 12 00:45:40.488327896 (79h19m34.919408047s) [upload=82643]: Starting upload Aug 12 00:45:40.488423559 (79h19m34.91950369s) [upload=82643]: Done starting upload Aug 12 00:45:40.488511647 (79h19m34.919591808s) [upload=82643]: Uploading segments... Aug 12 00:45:40.488567864 (79h19m34.919647995s) [upload=82643]: Got next segment. Inline: true Aug 12 00:45:40.488572654 (79h19m34.919652775s) [upload=82643]: Waiting for error group managing segments... Aug 12 00:45:40.488610867 (79h19m34.919690998s) [upload=82643]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:45:40.488615295 (79h19m34.919695427s) [upload=82643]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 00:45:40.488617930 (79h19m34.919698061s) [upload=82643]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 00:45:40.768759673 (79h19m35.199839804s) [upload=82643]: Done uploading segments... Aug 12 00:45:40.768781605 (79h19m35.199861736s) [upload=82643]: Upload finished. err: <nil>
Duration: 2.045158307s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X...............................X.X..............X.......] duration:
6.344067036s
FAIL (2025-08-12 01:01:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 00:57:09.982949505 (79h31m4.414029636s) [upload=82851]: Starting upload Aug 12 00:57:09.982991335 (79h31m4.414071466s) [upload=82851]: Done starting upload Aug 12 00:57:09.983156180 (79h31m4.414236311s) [upload=82851]: Uploading segments... Aug 12 00:57:09.983188182 (79h31m4.414268313s) [upload=82851]: Got next segment. Inline: false Aug 12 00:57:09.983210174 (79h31m4.414290295s) [upload=82851]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 00:57:09.983214212 (79h31m4.414294343s) [upload=82851]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 12 00:57:10.196768148 (79h31m4.627848289s) [upload=82851]: Next segment err: metaclient: Too Many Requests Aug 12 00:57:10.196794709 (79h31m4.62787484s) [upload=82851]: Done uploading segments... Aug 12 00:57:10.196811541 (79h31m4.627891672s) [upload=82851]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.344094388s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|