Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................................X....................X..X.X] duration:
4.103471786s
FAIL (2025-08-10 12:08:59 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 10 12:08:56.494933546 (42h42m50.926013677s) [upload=44562]: Starting upload
Aug 10 12:08:56.494972130 (42h42m50.926052261s) [upload=44562]: Done starting upload
Aug 10 12:08:56.495127878 (42h42m50.926207999s) [upload=44562]: Uploading segments...
Aug 10 12:08:56.495162033 (42h42m50.926242154s) [upload=44562]: Got next segment. Inline: false
Aug 10 12:08:56.495191940 (42h42m50.926272071s) [upload=44562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:08:56.495195807 (42h42m50.926275938s) [upload=44562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:08:56.946527857 (42h42m51.377607988s) [seg_pos={0 0}, upload=44562]: Begin upload segment...
Aug 10 12:08:56.946572102 (42h42m51.377652233s) [seg_pos={0 0}, upload=44562]: Done begin upload segment.
Aug 10 12:08:56.946592631 (42h42m51.377672762s) [noise=true , address=104.36.82.2:4740 , piece_id=LLXRL3RA7SRIXWUJ3IILRWXVDUSVQD4A5FHYO6O6FSCYMWLLPTKA, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.946654750 (42h42m51.377734941s) [noise=true , address=104.36.82.34:4562 , piece_id=57ZAPDJPVT64D3KWI2UJLBCGZG42TMI7UGWCACN72CWO5EOVYD7A, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.946963460 (42h42m51.378043591s) [noise=true , address=104.36.82.39:4750 , piece_id=RVWTVWG2BMELXSXQJ76RTCHU2DFH74EQ6ZTRXMRXRFBQKOU7UBFA, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.947236092 (42h42m51.378316223s) [noise=true , address=64.49.13.137:4495 , piece_id=FTETT54QAAALO6YTEK2Z3MYVI747CXQF6IFA3T2XL73J3H3QDLAA, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.947503564 (42h42m51.378583695s) [noise=true , address=104.36.82.62:4434 , piece_id=ZM55Y44EUHUDMWLS4JJ4N2WYQS3F4GTA6DNFPU2WVE2WMKKBU5WA, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.947655134 (42h42m51.378735285s) [noise=true , address=104.36.82.9:4012 , piece_id=37BIVMWFXV25F6EBVIBVMM5QVA6MILFRN3ZJHCS35IIRF57OBEVA, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.947785794 (42h42m51.378865925s) [noise=true , address=104.36.82.17:4352 , piece_id=E6HM4BULQXZIMLJHNWZB5EED6LD3EDZF2RAQASHY4OLZVDDDEZLQ, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.948002589 (42h42m51.37908272s) [noise=true , address=104.36.82.60:4358 , piece_id=HYRNCYCIRRCSU5BTMZA7JX4BISE6GXLU37LDG3MWW6KLEPY5L56Q, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.948221377 (42h42m51.379301508s) [noise=true , address=104.36.82.35:4591 , piece_id=DWWNTTMWZFONGJUY3ZQJG5EHRGB4YFSCLNQRI36VDMNZB62LUFHA, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.948400069 (42h42m51.3794802s) [noise=true , address=104.36.82.44:4881 , piece_id=CJJ3RSRVED4QYRRRR6TDSDBADFFL44T2MWB5SFUB27645CCCZ74Q, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.948441869 (42h42m51.379522s) [noise=true , address=104.36.82.43:4833 , piece_id=YU7QJ4FOJTNOHWZCUTL5WIY2QINN7MUN7AOHCH25TRDPRRJRY6EQ, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.948674454 (42h42m51.379754585s) [noise=true , address=104.36.82.6:4883 , piece_id=PH2PJAXZEWCUFLY7F3PTHJVUHN3BD3GD4H6BSZWJ7TV3YVRF4WSA, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.948918681 (42h42m51.379998802s) [noise=true , address=104.36.82.23:4461 , piece_id=PIZ2IWQSH2OV5YAS5QKOVZG3PRWGZIQ7HKNXOQEY5AEOO6MOZSXQ, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.949092965 (42h42m51.380173096s) [noise=true , address=104.36.82.36:4646 , piece_id=BAUR2AHBTLQAW4WXGNFVCYEAL2NF2LB7I6FHBC5FQWR7IN7NMMOA, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.949168619 (42h42m51.38024875s) [noise=true , address=104.36.82.5:4849 , piece_id=XMXTAMJ5CZUKW5WOUJWZ6DX4BFZ5WDICUYBNWY6CWZZ42ST4MNUA, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.949737268 (42h42m51.380817419s) [noise=true , address=104.36.82.8:4979 , piece_id=TI5NWQ6MVGJPZ5KW72KT6XTJ6KJUVIOZ35BVPB3IK6OOML2SFCOA, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.950325783 (42h42m51.381405924s) [noise=true , address=64.49.13.139:4469 , piece_id=IYQERXYUU6Q2HI24AWEFJM3KAUZNYLAZLAM4DF4XNFBHCM2AFKBQ, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:56.950796213 (42h42m51.381876354s) [noise=true , address=104.36.82.22:4527 , piece_id=WFPTATCOT7LYTJF5XL7PF3SGD4OWWROYBSOJGGXM73NGRS4A6URA, seg_pos={0 0}, upload=44562]: Uploading piece...
Aug 10 12:08:58.050815405 (42h42m52.481895536s) [upload=44562]: Next returned nil segment
Aug 10 12:08:58.050838518 (42h42m52.481918649s) [upload=44562]: Waiting for error group managing segments...
Aug 10 12:08:58.337435729 (42h42m52.76851585s) [noise=true , address=64.49.13.139:4469 , piece_id=IYQERXYUU6Q2HI24AWEFJM3KAUZNYLAZLAM4DF4XNFBHCM2AFKBQ, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.349468321 (42h42m52.780548452s) [noise=true , address=64.49.13.137:4495 , piece_id=FTETT54QAAALO6YTEK2Z3MYVI747CXQF6IFA3T2XL73J3H3QDLAA, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.895286221 (42h42m53.326366352s) [noise=true , address=104.36.82.39:4750 , piece_id=RVWTVWG2BMELXSXQJ76RTCHU2DFH74EQ6ZTRXMRXRFBQKOU7UBFA, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.904281161 (42h42m53.335361282s) [noise=true , address=104.36.82.9:4012 , piece_id=37BIVMWFXV25F6EBVIBVMM5QVA6MILFRN3ZJHCS35IIRF57OBEVA, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.907254661 (42h42m53.338334792s) [noise=true , address=104.36.82.43:4833 , piece_id=YU7QJ4FOJTNOHWZCUTL5WIY2QINN7MUN7AOHCH25TRDPRRJRY6EQ, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.908992256 (42h42m53.340072387s) [noise=true , address=104.36.82.17:4352 , piece_id=E6HM4BULQXZIMLJHNWZB5EED6LD3EDZF2RAQASHY4OLZVDDDEZLQ, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.915034647 (42h42m53.346114778s) [noise=true , address=104.36.82.23:4461 , piece_id=PIZ2IWQSH2OV5YAS5QKOVZG3PRWGZIQ7HKNXOQEY5AEOO6MOZSXQ, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.916666759 (42h42m53.34774689s) [noise=true , address=104.36.82.35:4591 , piece_id=DWWNTTMWZFONGJUY3ZQJG5EHRGB4YFSCLNQRI36VDMNZB62LUFHA, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.937282393 (42h42m53.368362524s) [noise=true , address=104.36.82.22:4527 , piece_id=WFPTATCOT7LYTJF5XL7PF3SGD4OWWROYBSOJGGXM73NGRS4A6URA, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.939512981 (42h42m53.370593102s) [noise=true , address=104.36.82.44:4881 , piece_id=CJJ3RSRVED4QYRRRR6TDSDBADFFL44T2MWB5SFUB27645CCCZ74Q, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.957481380 (42h42m53.388561501s) [noise=true , address=104.36.82.62:4434 , piece_id=ZM55Y44EUHUDMWLS4JJ4N2WYQS3F4GTA6DNFPU2WVE2WMKKBU5WA, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.965468853 (42h42m53.396549024s) [noise=true , address=104.36.82.8:4979 , piece_id=TI5NWQ6MVGJPZ5KW72KT6XTJ6KJUVIOZ35BVPB3IK6OOML2SFCOA, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.977719322 (42h42m53.408799453s) [noise=true , address=104.36.82.5:4849 , piece_id=XMXTAMJ5CZUKW5WOUJWZ6DX4BFZ5WDICUYBNWY6CWZZ42ST4MNUA, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.990975825 (42h42m53.422055956s) [noise=true , address=104.36.82.34:4562 , piece_id=57ZAPDJPVT64D3KWI2UJLBCGZG42TMI7UGWCACN72CWO5EOVYD7A, seg_pos={0 0}, upload=44562]: Done uploading piece. err: <nil>
Aug 10 12:08:58.990999210 (42h42m53.422079331s) [seg_pos={0 0}, upload=44562]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:08:58.991137184 (42h42m53.422217315s) [noise=true , address=104.36.82.6:4883 , piece_id=PH2PJAXZEWCUFLY7F3PTHJVUHN3BD3GD4H6BSZWJ7TV3YVRF4WSA, seg_pos={0 0}, upload=44562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12o2mgPVCn34Zny7hdDtGfQQwxXWKaEfKRXGrtkuat6mMstZiZ1): protocol: expected piece hash; context canceled; EOF
Aug 10 12:08:58.991215454 (42h42m53.422295575s) [noise=true , address=104.36.82.2:4740 , piece_id=LLXRL3RA7SRIXWUJ3IILRWXVDUSVQD4A5FHYO6O6FSCYMWLLPTKA, seg_pos={0 0}, upload=44562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wgQDbE17gP8c6kbKnNyywSkY8Hk7mchcMaymLBQzPwRsSB8QE): protocol: expected piece hash; context canceled; EOF
Aug 10 12:08:58.991251043 (42h42m53.422331174s) [noise=true , address=104.36.82.36:4646 , piece_id=BAUR2AHBTLQAW4WXGNFVCYEAL2NF2LB7I6FHBC5FQWR7IN7NMMOA, seg_pos={0 0}, upload=44562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zA8TqySnmGc9bVQnNNMSZEPbv9Gf1Wa1BwYrKjc2ZGgtyEmrh): protocol: expected piece hash; context canceled; EOF
Aug 10 12:08:58.991275168 (42h42m53.422355299s) [noise=true , address=104.36.82.60:4358 , piece_id=HYRNCYCIRRCSU5BTMZA7JX4BISE6GXLU37LDG3MWW6KLEPY5L56Q, seg_pos={0 0}, upload=44562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dwCNEcA9o51ZN3UaN3Frxdawwf8DXBj86iQMywjW8XP4ESmw1): protocol: expected piece hash; context canceled; EOF
Aug 10 12:08:58.991295247 (42h42m53.422375368s) [seg_pos={0 0}, upload=44562]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 12:08:58.991355442 (42h42m53.422435573s) [upload=44562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:08:58.991359670 (42h42m53.422439801s) [upload=44562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:08:59.279099607 (42h42m53.710179748s) [upload=44562]: Done uploading segments...
Aug 10 12:08:59.279117361 (42h42m53.710197492s) [upload=44562]: Upload finished. err: <nil>
Duration: 4.103498146s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X......................X..................XX...............] duration:
1.969856292s
FAIL (2025-08-10 12:08:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.969881091s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X......................X..................XX..............] duration:
1.96070377s
FAIL (2025-08-10 12:08:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.960731163s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................................X....................X..X.] duration:
5.566452304s
FAIL (2025-08-10 12:07:57 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:07:03.088513239 (42h40m57.51959337s) [upload=44527]: Starting upload Aug 10 12:07:03.088561351 (42h40m57.519641482s) [upload=44527]: Done starting upload Aug 10 12:07:03.088630703 (42h40m57.519710834s) [upload=44527]: Uploading segments... Aug 10 12:07:03.088765000 (42h40m57.519845131s) [upload=44527]: Got next segment. Inline: false Aug 10 12:07:03.088790990 (42h40m57.519871121s) [upload=44527]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:07:03.088795539 (42h40m57.51987567s) [upload=44527]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 12:07:03.361480041 (42h40m57.792560172s) [upload=44527]: Next segment err: metaclient: Too Many Requests Aug 10 12:07:03.361498356 (42h40m57.792578487s) [upload=44527]: Done uploading segments... Aug 10 12:07:03.361512914 (42h40m57.792593045s) [upload=44527]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.566478864s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X......................X..................XX.............] duration:
1.952793134s
FAIL (2025-08-10 12:07:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.952847118s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X......................X..................XX............] duration:
1.996196923s
FAIL (2025-08-10 12:07:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.996219356s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................................X....................X..X] duration:
923.759612ms
FAIL (2025-08-10 12:07:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 12:07:03.088513239 (42h40m57.51959337s) [upload=44527]: Starting upload Aug 10 12:07:03.088561351 (42h40m57.519641482s) [upload=44527]: Done starting upload Aug 10 12:07:03.088630703 (42h40m57.519710834s) [upload=44527]: Uploading segments... Aug 10 12:07:03.088765000 (42h40m57.519845131s) [upload=44527]: Got next segment. Inline: false Aug 10 12:07:03.088790990 (42h40m57.519871121s) [upload=44527]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 12:07:03.088795539 (42h40m57.51987567s) [upload=44527]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 10 12:07:03.361480041 (42h40m57.792560172s) [upload=44527]: Next segment err: metaclient: Too Many Requests Aug 10 12:07:03.361498356 (42h40m57.792578487s) [upload=44527]: Done uploading segments... Aug 10 12:07:03.361512914 (42h40m57.792593045s) [upload=44527]: Upload finished. err: metaclient: Too Many Requests
Duration: 923.780773ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X....................X..] duration:
5.609376951s
FAIL (2025-08-10 12:06:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:05:47.576501104 (42h39m42.007581235s) [upload=44506]: Starting upload
Aug 10 12:05:47.576539968 (42h39m42.007620089s) [upload=44506]: Done starting upload
Aug 10 12:05:47.576707570 (42h39m42.007787691s) [upload=44506]: Uploading segments...
Aug 10 12:05:47.576739481 (42h39m42.007819612s) [upload=44506]: Got next segment. Inline: false
Aug 10 12:05:47.576762976 (42h39m42.007843107s) [upload=44506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:05:47.576767214 (42h39m42.007847345s) [upload=44506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:05:48.026675278 (42h39m42.457755409s) [seg_pos={0 0}, upload=44506]: Begin upload segment...
Aug 10 12:05:48.026725774 (42h39m42.457805905s) [seg_pos={0 0}, upload=44506]: Done begin upload segment.
Aug 10 12:05:48.026747295 (42h39m42.457827426s) [noise=true , address=104.36.82.19:4428 , piece_id=QMVX2TWV3JNWGRYOFW5GCZAKUMLIQRVJERYGU4DOTTI55G4V66KA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.026754380 (42h39m42.457834511s) [noise=true , address=104.36.82.59:4305 , piece_id=BQMNO3AP7LJDIJLNMS7EW3GE6WA3L46H5A24NYK3PCEBYUJMHRNQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.026786882 (42h39m42.457867003s) [noise=true , address=45.91.116.6:4997 , piece_id=ZGRXRRD4UN6ZWXRFE47DWT2RNXDYKM2Y4BELNETDSJIGDUCGFEYQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027105661 (42h39m42.458185792s) [noise=true , address=45.91.116.10:4113 , piece_id=AOEKCJGI7JH6BROMJ6WKYVYYPFVCMP7EI3V2GGVSFQPBLQTTBKZQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027108687 (42h39m42.458188808s) [noise=true , address=104.36.82.5:4871 , piece_id=UN2OETOS7NKTQYE3V64YQF4TVSCMNTEBPBMLOZKPCCSTGKSD7YQQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027371941 (42h39m42.458452072s) [noise=true , address=104.36.82.13:4195 , piece_id=JT7LMFXNK4HJQPBYMP5X45PO3DB6GT3X62FMKZUZKJNONBDE7BKQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027403862 (42h39m42.458483993s) [noise=true , address=104.36.82.60:4339 , piece_id=VR45XW4M7UQVUV4QYKMFDVASBCZ46JACDGKCN6QR2KIV3IEBY2TA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027633010 (42h39m42.458713141s) [noise=true , address=104.36.82.46:4496 , piece_id=C4P7YHYBQGZ3F7F7O7Z4MIESPINXXR53XDYMOC4RD2N4U5DDSNSA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027670873 (42h39m42.458751004s) [noise=true , address=104.36.82.45:4929 , piece_id=6TGFKUE2ZZNTAQTBDGOKSGCRITXZF4FKKTK34TYH4S5G23NYTMDA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027890002 (42h39m42.458970133s) [noise=true , address=104.36.82.60:4361 , piece_id=P4SVAIC6PYQLJ3B4SIWMK2PHLT5CB6BJKLVI54OHC5U4VUQWDWKQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027936301 (42h39m42.459016432s) [noise=true , address=104.36.82.18:4387 , piece_id=JMBWRVJOX7SRLREQ3R7VWKBRNPO7ZOXVXBY6IM5SAVML5IFC6QBQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028156913 (42h39m42.459237044s) [noise=true , address=104.36.82.61:4382 , piece_id=RSVOFVVXUBF76KAZ2FEE3AGNK2LCPLDC5VMJC5B5A5SC66EGLNBQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028188313 (42h39m42.459268444s) [noise=true , address=104.36.82.50:4040 , piece_id=R4I5ML3Z4U5QYF2OSSHEYQ4FZBB7IGEN6YDO563UI7QSHQ5FGJSQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028443210 (42h39m42.459523341s) [noise=true , address=104.36.82.21:4504 , piece_id=5JVY3LNHFJD5QYDNR3FBRRQGGP7Y7A7RFV432JMS3TN44BWAZ3YA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028645397 (42h39m42.459725528s) [noise=true , address=104.36.82.42:4800 , piece_id=K3DEKXIKAYHI4346JBBKZ4JBV66B2BBBXCUR5B2EX52NEVFQBQSA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028867552 (42h39m42.459947683s) [noise=true , address=104.36.82.62:4420 , piece_id=W6Z7QLLHPF47JINVRHYHIRBYWVHYVFMCAPU7I755FMKGO6XSBFCA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.029133852 (42h39m42.460213983s) [noise=true , address=104.36.82.36:4629 , piece_id=KFC47PJBSGJTNUV6PMF7EDSZ4FEVKFAZXSMHGLYIEF55I4ZXSCJQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.029350617 (42h39m42.460430738s) [noise=true , address=64.49.13.155:4923 , piece_id=4V4X7ZERG3NKBCW72T75UXTDWMCFFSWDRI7AMHSD36QGDD5HUF7Q, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:49.171872018 (42h39m43.602952139s) [upload=44506]: Next returned nil segment
Aug 10 12:05:49.171888139 (42h39m43.60296827s) [upload=44506]: Waiting for error group managing segments...
Aug 10 12:05:49.459684143 (42h39m43.890764274s) [noise=true , address=64.49.13.155:4923 , piece_id=4V4X7ZERG3NKBCW72T75UXTDWMCFFSWDRI7AMHSD36QGDD5HUF7Q, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.966207230 (42h39m44.397287361s) [noise=true , address=104.36.82.50:4040 , piece_id=R4I5ML3Z4U5QYF2OSSHEYQ4FZBB7IGEN6YDO563UI7QSHQ5FGJSQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.970774048 (42h39m44.401854179s) [noise=true , address=104.36.82.19:4428 , piece_id=QMVX2TWV3JNWGRYOFW5GCZAKUMLIQRVJERYGU4DOTTI55G4V66KA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.973256507 (42h39m44.404336628s) [noise=true , address=45.91.116.6:4997 , piece_id=ZGRXRRD4UN6ZWXRFE47DWT2RNXDYKM2Y4BELNETDSJIGDUCGFEYQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.973394341 (42h39m44.404474472s) [noise=true , address=104.36.82.5:4871 , piece_id=UN2OETOS7NKTQYE3V64YQF4TVSCMNTEBPBMLOZKPCCSTGKSD7YQQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.982214697 (42h39m44.413294818s) [noise=true , address=104.36.82.62:4420 , piece_id=W6Z7QLLHPF47JINVRHYHIRBYWVHYVFMCAPU7I755FMKGO6XSBFCA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.982638558 (42h39m44.413718689s) [noise=true , address=104.36.82.46:4496 , piece_id=C4P7YHYBQGZ3F7F7O7Z4MIESPINXXR53XDYMOC4RD2N4U5DDSNSA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.985069069 (42h39m44.4161492s) [noise=true , address=104.36.82.42:4800 , piece_id=K3DEKXIKAYHI4346JBBKZ4JBV66B2BBBXCUR5B2EX52NEVFQBQSA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.007011621 (42h39m44.438091752s) [noise=true , address=104.36.82.60:4339 , piece_id=VR45XW4M7UQVUV4QYKMFDVASBCZ46JACDGKCN6QR2KIV3IEBY2TA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.011638585 (42h39m44.442718706s) [noise=true , address=104.36.82.59:4305 , piece_id=BQMNO3AP7LJDIJLNMS7EW3GE6WA3L46H5A24NYK3PCEBYUJMHRNQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.012182805 (42h39m44.443262936s) [noise=true , address=104.36.82.13:4195 , piece_id=JT7LMFXNK4HJQPBYMP5X45PO3DB6GT3X62FMKZUZKJNONBDE7BKQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.023702276 (42h39m44.454782407s) [noise=true , address=104.36.82.21:4504 , piece_id=5JVY3LNHFJD5QYDNR3FBRRQGGP7Y7A7RFV432JMS3TN44BWAZ3YA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.024521994 (42h39m44.455602125s) [noise=true , address=45.91.116.10:4113 , piece_id=AOEKCJGI7JH6BROMJ6WKYVYYPFVCMP7EI3V2GGVSFQPBLQTTBKZQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.042820846 (42h39m44.473900977s) [noise=true , address=104.36.82.60:4361 , piece_id=P4SVAIC6PYQLJ3B4SIWMK2PHLT5CB6BJKLVI54OHC5U4VUQWDWKQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.042845784 (42h39m44.473925915s) [seg_pos={0 0}, upload=44506]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:05:50.042966524 (42h39m44.474046655s) [noise=true , address=104.36.82.36:4629 , piece_id=KFC47PJBSGJTNUV6PMF7EDSZ4FEVKFAZXSMHGLYIEF55I4ZXSCJQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uxMhTiH446Ku7h1PutqVh7fSCzwKHR7oypYBzGWELLNP7ojf6): protocol: expected piece hash; context canceled; EOF
Aug 10 12:05:50.043037070 (42h39m44.474117201s) [noise=true , address=104.36.82.61:4382 , piece_id=RSVOFVVXUBF76KAZ2FEE3AGNK2LCPLDC5VMJC5B5A5SC66EGLNBQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SN5izFGjg4t9qkUVEwF71nNgK2Fjpzo3wuZPJae5qc6QLN8Nf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:05:50.043085302 (42h39m44.474165433s) [noise=true , address=104.36.82.18:4387 , piece_id=JMBWRVJOX7SRLREQ3R7VWKBRNPO7ZOXVXBY6IM5SAVML5IFC6QBQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1idhhqhMLNNdqYUVgARJhhuTjF4kcxPUc9e3ymVMYZDiWGAxwm): protocol: expected piece hash; context canceled; EOF
Aug 10 12:05:50.043117814 (42h39m44.474197945s) [noise=true , address=104.36.82.45:4929 , piece_id=6TGFKUE2ZZNTAQTBDGOKSGCRITXZF4FKKTK34TYH4S5G23NYTMDA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF
Aug 10 12:05:50.043131891 (42h39m44.474212042s) [seg_pos={0 0}, upload=44506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 12:05:50.043241971 (42h39m44.474322112s) [upload=44506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:05:50.043249126 (42h39m44.474329267s) [upload=44506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:05:50.415499947 (42h39m44.846580068s) [upload=44506]: Done uploading segments...
Aug 10 12:05:50.415518713 (42h39m44.846598844s) [upload=44506]: Upload finished. err: <nil>
Duration: 5.609405427s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X....................X.] duration:
5.745983805s
FAIL (2025-08-10 12:06:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:05:47.576501104 (42h39m42.007581235s) [upload=44506]: Starting upload
Aug 10 12:05:47.576539968 (42h39m42.007620089s) [upload=44506]: Done starting upload
Aug 10 12:05:47.576707570 (42h39m42.007787691s) [upload=44506]: Uploading segments...
Aug 10 12:05:47.576739481 (42h39m42.007819612s) [upload=44506]: Got next segment. Inline: false
Aug 10 12:05:47.576762976 (42h39m42.007843107s) [upload=44506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:05:47.576767214 (42h39m42.007847345s) [upload=44506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:05:48.026675278 (42h39m42.457755409s) [seg_pos={0 0}, upload=44506]: Begin upload segment...
Aug 10 12:05:48.026725774 (42h39m42.457805905s) [seg_pos={0 0}, upload=44506]: Done begin upload segment.
Aug 10 12:05:48.026747295 (42h39m42.457827426s) [noise=true , address=104.36.82.19:4428 , piece_id=QMVX2TWV3JNWGRYOFW5GCZAKUMLIQRVJERYGU4DOTTI55G4V66KA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.026754380 (42h39m42.457834511s) [noise=true , address=104.36.82.59:4305 , piece_id=BQMNO3AP7LJDIJLNMS7EW3GE6WA3L46H5A24NYK3PCEBYUJMHRNQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.026786882 (42h39m42.457867003s) [noise=true , address=45.91.116.6:4997 , piece_id=ZGRXRRD4UN6ZWXRFE47DWT2RNXDYKM2Y4BELNETDSJIGDUCGFEYQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027105661 (42h39m42.458185792s) [noise=true , address=45.91.116.10:4113 , piece_id=AOEKCJGI7JH6BROMJ6WKYVYYPFVCMP7EI3V2GGVSFQPBLQTTBKZQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027108687 (42h39m42.458188808s) [noise=true , address=104.36.82.5:4871 , piece_id=UN2OETOS7NKTQYE3V64YQF4TVSCMNTEBPBMLOZKPCCSTGKSD7YQQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027371941 (42h39m42.458452072s) [noise=true , address=104.36.82.13:4195 , piece_id=JT7LMFXNK4HJQPBYMP5X45PO3DB6GT3X62FMKZUZKJNONBDE7BKQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027403862 (42h39m42.458483993s) [noise=true , address=104.36.82.60:4339 , piece_id=VR45XW4M7UQVUV4QYKMFDVASBCZ46JACDGKCN6QR2KIV3IEBY2TA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027633010 (42h39m42.458713141s) [noise=true , address=104.36.82.46:4496 , piece_id=C4P7YHYBQGZ3F7F7O7Z4MIESPINXXR53XDYMOC4RD2N4U5DDSNSA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027670873 (42h39m42.458751004s) [noise=true , address=104.36.82.45:4929 , piece_id=6TGFKUE2ZZNTAQTBDGOKSGCRITXZF4FKKTK34TYH4S5G23NYTMDA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027890002 (42h39m42.458970133s) [noise=true , address=104.36.82.60:4361 , piece_id=P4SVAIC6PYQLJ3B4SIWMK2PHLT5CB6BJKLVI54OHC5U4VUQWDWKQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027936301 (42h39m42.459016432s) [noise=true , address=104.36.82.18:4387 , piece_id=JMBWRVJOX7SRLREQ3R7VWKBRNPO7ZOXVXBY6IM5SAVML5IFC6QBQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028156913 (42h39m42.459237044s) [noise=true , address=104.36.82.61:4382 , piece_id=RSVOFVVXUBF76KAZ2FEE3AGNK2LCPLDC5VMJC5B5A5SC66EGLNBQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028188313 (42h39m42.459268444s) [noise=true , address=104.36.82.50:4040 , piece_id=R4I5ML3Z4U5QYF2OSSHEYQ4FZBB7IGEN6YDO563UI7QSHQ5FGJSQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028443210 (42h39m42.459523341s) [noise=true , address=104.36.82.21:4504 , piece_id=5JVY3LNHFJD5QYDNR3FBRRQGGP7Y7A7RFV432JMS3TN44BWAZ3YA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028645397 (42h39m42.459725528s) [noise=true , address=104.36.82.42:4800 , piece_id=K3DEKXIKAYHI4346JBBKZ4JBV66B2BBBXCUR5B2EX52NEVFQBQSA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028867552 (42h39m42.459947683s) [noise=true , address=104.36.82.62:4420 , piece_id=W6Z7QLLHPF47JINVRHYHIRBYWVHYVFMCAPU7I755FMKGO6XSBFCA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.029133852 (42h39m42.460213983s) [noise=true , address=104.36.82.36:4629 , piece_id=KFC47PJBSGJTNUV6PMF7EDSZ4FEVKFAZXSMHGLYIEF55I4ZXSCJQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.029350617 (42h39m42.460430738s) [noise=true , address=64.49.13.155:4923 , piece_id=4V4X7ZERG3NKBCW72T75UXTDWMCFFSWDRI7AMHSD36QGDD5HUF7Q, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:49.171872018 (42h39m43.602952139s) [upload=44506]: Next returned nil segment
Aug 10 12:05:49.171888139 (42h39m43.60296827s) [upload=44506]: Waiting for error group managing segments...
Aug 10 12:05:49.459684143 (42h39m43.890764274s) [noise=true , address=64.49.13.155:4923 , piece_id=4V4X7ZERG3NKBCW72T75UXTDWMCFFSWDRI7AMHSD36QGDD5HUF7Q, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.966207230 (42h39m44.397287361s) [noise=true , address=104.36.82.50:4040 , piece_id=R4I5ML3Z4U5QYF2OSSHEYQ4FZBB7IGEN6YDO563UI7QSHQ5FGJSQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.970774048 (42h39m44.401854179s) [noise=true , address=104.36.82.19:4428 , piece_id=QMVX2TWV3JNWGRYOFW5GCZAKUMLIQRVJERYGU4DOTTI55G4V66KA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.973256507 (42h39m44.404336628s) [noise=true , address=45.91.116.6:4997 , piece_id=ZGRXRRD4UN6ZWXRFE47DWT2RNXDYKM2Y4BELNETDSJIGDUCGFEYQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.973394341 (42h39m44.404474472s) [noise=true , address=104.36.82.5:4871 , piece_id=UN2OETOS7NKTQYE3V64YQF4TVSCMNTEBPBMLOZKPCCSTGKSD7YQQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.982214697 (42h39m44.413294818s) [noise=true , address=104.36.82.62:4420 , piece_id=W6Z7QLLHPF47JINVRHYHIRBYWVHYVFMCAPU7I755FMKGO6XSBFCA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.982638558 (42h39m44.413718689s) [noise=true , address=104.36.82.46:4496 , piece_id=C4P7YHYBQGZ3F7F7O7Z4MIESPINXXR53XDYMOC4RD2N4U5DDSNSA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.985069069 (42h39m44.4161492s) [noise=true , address=104.36.82.42:4800 , piece_id=K3DEKXIKAYHI4346JBBKZ4JBV66B2BBBXCUR5B2EX52NEVFQBQSA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.007011621 (42h39m44.438091752s) [noise=true , address=104.36.82.60:4339 , piece_id=VR45XW4M7UQVUV4QYKMFDVASBCZ46JACDGKCN6QR2KIV3IEBY2TA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.011638585 (42h39m44.442718706s) [noise=true , address=104.36.82.59:4305 , piece_id=BQMNO3AP7LJDIJLNMS7EW3GE6WA3L46H5A24NYK3PCEBYUJMHRNQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.012182805 (42h39m44.443262936s) [noise=true , address=104.36.82.13:4195 , piece_id=JT7LMFXNK4HJQPBYMP5X45PO3DB6GT3X62FMKZUZKJNONBDE7BKQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.023702276 (42h39m44.454782407s) [noise=true , address=104.36.82.21:4504 , piece_id=5JVY3LNHFJD5QYDNR3FBRRQGGP7Y7A7RFV432JMS3TN44BWAZ3YA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.024521994 (42h39m44.455602125s) [noise=true , address=45.91.116.10:4113 , piece_id=AOEKCJGI7JH6BROMJ6WKYVYYPFVCMP7EI3V2GGVSFQPBLQTTBKZQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.042820846 (42h39m44.473900977s) [noise=true , address=104.36.82.60:4361 , piece_id=P4SVAIC6PYQLJ3B4SIWMK2PHLT5CB6BJKLVI54OHC5U4VUQWDWKQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.042845784 (42h39m44.473925915s) [seg_pos={0 0}, upload=44506]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:05:50.042966524 (42h39m44.474046655s) [noise=true , address=104.36.82.36:4629 , piece_id=KFC47PJBSGJTNUV6PMF7EDSZ4FEVKFAZXSMHGLYIEF55I4ZXSCJQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uxMhTiH446Ku7h1PutqVh7fSCzwKHR7oypYBzGWELLNP7ojf6): protocol: expected piece hash; context canceled; EOF
Aug 10 12:05:50.043037070 (42h39m44.474117201s) [noise=true , address=104.36.82.61:4382 , piece_id=RSVOFVVXUBF76KAZ2FEE3AGNK2LCPLDC5VMJC5B5A5SC66EGLNBQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SN5izFGjg4t9qkUVEwF71nNgK2Fjpzo3wuZPJae5qc6QLN8Nf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:05:50.043085302 (42h39m44.474165433s) [noise=true , address=104.36.82.18:4387 , piece_id=JMBWRVJOX7SRLREQ3R7VWKBRNPO7ZOXVXBY6IM5SAVML5IFC6QBQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1idhhqhMLNNdqYUVgARJhhuTjF4kcxPUc9e3ymVMYZDiWGAxwm): protocol: expected piece hash; context canceled; EOF
Aug 10 12:05:50.043117814 (42h39m44.474197945s) [noise=true , address=104.36.82.45:4929 , piece_id=6TGFKUE2ZZNTAQTBDGOKSGCRITXZF4FKKTK34TYH4S5G23NYTMDA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF
Aug 10 12:05:50.043131891 (42h39m44.474212042s) [seg_pos={0 0}, upload=44506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 12:05:50.043241971 (42h39m44.474322112s) [upload=44506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:05:50.043249126 (42h39m44.474329267s) [upload=44506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:05:50.415499947 (42h39m44.846580068s) [upload=44506]: Done uploading segments...
Aug 10 12:05:50.415518713 (42h39m44.846598844s) [upload=44506]: Upload finished. err: <nil>
Duration: 5.746016068s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X......................X..................XX...........] duration:
1.813503179s
FAIL (2025-08-10 12:06:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.813529219s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X....................X] duration:
3.941794788s
FAIL (2025-08-10 12:05:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 10 12:05:47.576501104 (42h39m42.007581235s) [upload=44506]: Starting upload
Aug 10 12:05:47.576539968 (42h39m42.007620089s) [upload=44506]: Done starting upload
Aug 10 12:05:47.576707570 (42h39m42.007787691s) [upload=44506]: Uploading segments...
Aug 10 12:05:47.576739481 (42h39m42.007819612s) [upload=44506]: Got next segment. Inline: false
Aug 10 12:05:47.576762976 (42h39m42.007843107s) [upload=44506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 12:05:47.576767214 (42h39m42.007847345s) [upload=44506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 12:05:48.026675278 (42h39m42.457755409s) [seg_pos={0 0}, upload=44506]: Begin upload segment...
Aug 10 12:05:48.026725774 (42h39m42.457805905s) [seg_pos={0 0}, upload=44506]: Done begin upload segment.
Aug 10 12:05:48.026747295 (42h39m42.457827426s) [noise=true , address=104.36.82.19:4428 , piece_id=QMVX2TWV3JNWGRYOFW5GCZAKUMLIQRVJERYGU4DOTTI55G4V66KA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.026754380 (42h39m42.457834511s) [noise=true , address=104.36.82.59:4305 , piece_id=BQMNO3AP7LJDIJLNMS7EW3GE6WA3L46H5A24NYK3PCEBYUJMHRNQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.026786882 (42h39m42.457867003s) [noise=true , address=45.91.116.6:4997 , piece_id=ZGRXRRD4UN6ZWXRFE47DWT2RNXDYKM2Y4BELNETDSJIGDUCGFEYQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027105661 (42h39m42.458185792s) [noise=true , address=45.91.116.10:4113 , piece_id=AOEKCJGI7JH6BROMJ6WKYVYYPFVCMP7EI3V2GGVSFQPBLQTTBKZQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027108687 (42h39m42.458188808s) [noise=true , address=104.36.82.5:4871 , piece_id=UN2OETOS7NKTQYE3V64YQF4TVSCMNTEBPBMLOZKPCCSTGKSD7YQQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027371941 (42h39m42.458452072s) [noise=true , address=104.36.82.13:4195 , piece_id=JT7LMFXNK4HJQPBYMP5X45PO3DB6GT3X62FMKZUZKJNONBDE7BKQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027403862 (42h39m42.458483993s) [noise=true , address=104.36.82.60:4339 , piece_id=VR45XW4M7UQVUV4QYKMFDVASBCZ46JACDGKCN6QR2KIV3IEBY2TA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027633010 (42h39m42.458713141s) [noise=true , address=104.36.82.46:4496 , piece_id=C4P7YHYBQGZ3F7F7O7Z4MIESPINXXR53XDYMOC4RD2N4U5DDSNSA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027670873 (42h39m42.458751004s) [noise=true , address=104.36.82.45:4929 , piece_id=6TGFKUE2ZZNTAQTBDGOKSGCRITXZF4FKKTK34TYH4S5G23NYTMDA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027890002 (42h39m42.458970133s) [noise=true , address=104.36.82.60:4361 , piece_id=P4SVAIC6PYQLJ3B4SIWMK2PHLT5CB6BJKLVI54OHC5U4VUQWDWKQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.027936301 (42h39m42.459016432s) [noise=true , address=104.36.82.18:4387 , piece_id=JMBWRVJOX7SRLREQ3R7VWKBRNPO7ZOXVXBY6IM5SAVML5IFC6QBQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028156913 (42h39m42.459237044s) [noise=true , address=104.36.82.61:4382 , piece_id=RSVOFVVXUBF76KAZ2FEE3AGNK2LCPLDC5VMJC5B5A5SC66EGLNBQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028188313 (42h39m42.459268444s) [noise=true , address=104.36.82.50:4040 , piece_id=R4I5ML3Z4U5QYF2OSSHEYQ4FZBB7IGEN6YDO563UI7QSHQ5FGJSQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028443210 (42h39m42.459523341s) [noise=true , address=104.36.82.21:4504 , piece_id=5JVY3LNHFJD5QYDNR3FBRRQGGP7Y7A7RFV432JMS3TN44BWAZ3YA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028645397 (42h39m42.459725528s) [noise=true , address=104.36.82.42:4800 , piece_id=K3DEKXIKAYHI4346JBBKZ4JBV66B2BBBXCUR5B2EX52NEVFQBQSA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.028867552 (42h39m42.459947683s) [noise=true , address=104.36.82.62:4420 , piece_id=W6Z7QLLHPF47JINVRHYHIRBYWVHYVFMCAPU7I755FMKGO6XSBFCA, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.029133852 (42h39m42.460213983s) [noise=true , address=104.36.82.36:4629 , piece_id=KFC47PJBSGJTNUV6PMF7EDSZ4FEVKFAZXSMHGLYIEF55I4ZXSCJQ, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:48.029350617 (42h39m42.460430738s) [noise=true , address=64.49.13.155:4923 , piece_id=4V4X7ZERG3NKBCW72T75UXTDWMCFFSWDRI7AMHSD36QGDD5HUF7Q, seg_pos={0 0}, upload=44506]: Uploading piece...
Aug 10 12:05:49.171872018 (42h39m43.602952139s) [upload=44506]: Next returned nil segment
Aug 10 12:05:49.171888139 (42h39m43.60296827s) [upload=44506]: Waiting for error group managing segments...
Aug 10 12:05:49.459684143 (42h39m43.890764274s) [noise=true , address=64.49.13.155:4923 , piece_id=4V4X7ZERG3NKBCW72T75UXTDWMCFFSWDRI7AMHSD36QGDD5HUF7Q, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.966207230 (42h39m44.397287361s) [noise=true , address=104.36.82.50:4040 , piece_id=R4I5ML3Z4U5QYF2OSSHEYQ4FZBB7IGEN6YDO563UI7QSHQ5FGJSQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.970774048 (42h39m44.401854179s) [noise=true , address=104.36.82.19:4428 , piece_id=QMVX2TWV3JNWGRYOFW5GCZAKUMLIQRVJERYGU4DOTTI55G4V66KA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.973256507 (42h39m44.404336628s) [noise=true , address=45.91.116.6:4997 , piece_id=ZGRXRRD4UN6ZWXRFE47DWT2RNXDYKM2Y4BELNETDSJIGDUCGFEYQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.973394341 (42h39m44.404474472s) [noise=true , address=104.36.82.5:4871 , piece_id=UN2OETOS7NKTQYE3V64YQF4TVSCMNTEBPBMLOZKPCCSTGKSD7YQQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.982214697 (42h39m44.413294818s) [noise=true , address=104.36.82.62:4420 , piece_id=W6Z7QLLHPF47JINVRHYHIRBYWVHYVFMCAPU7I755FMKGO6XSBFCA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.982638558 (42h39m44.413718689s) [noise=true , address=104.36.82.46:4496 , piece_id=C4P7YHYBQGZ3F7F7O7Z4MIESPINXXR53XDYMOC4RD2N4U5DDSNSA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:49.985069069 (42h39m44.4161492s) [noise=true , address=104.36.82.42:4800 , piece_id=K3DEKXIKAYHI4346JBBKZ4JBV66B2BBBXCUR5B2EX52NEVFQBQSA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.007011621 (42h39m44.438091752s) [noise=true , address=104.36.82.60:4339 , piece_id=VR45XW4M7UQVUV4QYKMFDVASBCZ46JACDGKCN6QR2KIV3IEBY2TA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.011638585 (42h39m44.442718706s) [noise=true , address=104.36.82.59:4305 , piece_id=BQMNO3AP7LJDIJLNMS7EW3GE6WA3L46H5A24NYK3PCEBYUJMHRNQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.012182805 (42h39m44.443262936s) [noise=true , address=104.36.82.13:4195 , piece_id=JT7LMFXNK4HJQPBYMP5X45PO3DB6GT3X62FMKZUZKJNONBDE7BKQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.023702276 (42h39m44.454782407s) [noise=true , address=104.36.82.21:4504 , piece_id=5JVY3LNHFJD5QYDNR3FBRRQGGP7Y7A7RFV432JMS3TN44BWAZ3YA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.024521994 (42h39m44.455602125s) [noise=true , address=45.91.116.10:4113 , piece_id=AOEKCJGI7JH6BROMJ6WKYVYYPFVCMP7EI3V2GGVSFQPBLQTTBKZQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.042820846 (42h39m44.473900977s) [noise=true , address=104.36.82.60:4361 , piece_id=P4SVAIC6PYQLJ3B4SIWMK2PHLT5CB6BJKLVI54OHC5U4VUQWDWKQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: <nil>
Aug 10 12:05:50.042845784 (42h39m44.473925915s) [seg_pos={0 0}, upload=44506]: Segment reached optimal threshold of 14 pieces.
Aug 10 12:05:50.042966524 (42h39m44.474046655s) [noise=true , address=104.36.82.36:4629 , piece_id=KFC47PJBSGJTNUV6PMF7EDSZ4FEVKFAZXSMHGLYIEF55I4ZXSCJQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1uxMhTiH446Ku7h1PutqVh7fSCzwKHR7oypYBzGWELLNP7ojf6): protocol: expected piece hash; context canceled; EOF
Aug 10 12:05:50.043037070 (42h39m44.474117201s) [noise=true , address=104.36.82.61:4382 , piece_id=RSVOFVVXUBF76KAZ2FEE3AGNK2LCPLDC5VMJC5B5A5SC66EGLNBQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SN5izFGjg4t9qkUVEwF71nNgK2Fjpzo3wuZPJae5qc6QLN8Nf): protocol: expected piece hash; context canceled; EOF
Aug 10 12:05:50.043085302 (42h39m44.474165433s) [noise=true , address=104.36.82.18:4387 , piece_id=JMBWRVJOX7SRLREQ3R7VWKBRNPO7ZOXVXBY6IM5SAVML5IFC6QBQ, seg_pos={0 0}, upload=44506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1idhhqhMLNNdqYUVgARJhhuTjF4kcxPUc9e3ymVMYZDiWGAxwm): protocol: expected piece hash; context canceled; EOF
Aug 10 12:05:50.043117814 (42h39m44.474197945s) [noise=true , address=104.36.82.45:4929 , piece_id=6TGFKUE2ZZNTAQTBDGOKSGCRITXZF4FKKTK34TYH4S5G23NYTMDA, seg_pos={0 0}, upload=44506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VxQN6CV1ogwKcs27ho2ayknnPi7BDEcA9ZFbgsUacuQNFAdmm): protocol: expected piece hash; context canceled; EOF
Aug 10 12:05:50.043131891 (42h39m44.474212042s) [seg_pos={0 0}, upload=44506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 12:05:50.043241971 (42h39m44.474322112s) [upload=44506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 12:05:50.043249126 (42h39m44.474329267s) [upload=44506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 12:05:50.415499947 (42h39m44.846580068s) [upload=44506]: Done uploading segments...
Aug 10 12:05:50.415518713 (42h39m44.846598844s) [upload=44506]: Upload finished. err: <nil>
Duration: 3.94183199s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X......................X..................XX..........] duration:
1.848992954s
FAIL (2025-08-10 12:05:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.849028713s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.572489046s
FAIL (2025-08-10 12:05:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.572510918s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.835645146s
FAIL (2025-08-10 12:04:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.835664053s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X......................X..................XX.........] duration:
1.884992127s
FAIL (2025-08-10 12:04:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.885018809s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X......................X..................XX........] duration:
1.83491178s
FAIL (2025-08-10 12:04:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.834938642s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.628121982s
FAIL (2025-08-10 12:03:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.628167307s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X......................X..................XX.......] duration:
1.813380164s
FAIL (2025-08-10 12:03:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.81340464s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X......................X..................XX......] duration:
1.937633159s
FAIL (2025-08-10 12:02:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.937659289s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.697823592s
FAIL (2025-08-10 12:02:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.69784906s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.596191407s
FAIL (2025-08-10 12:02:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.596220252s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X......................X..................XX.....] duration:
2.041269017s
FAIL (2025-08-10 12:01:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.041304855s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [............X......................X..................XX....] duration:
1.901915792s
FAIL (2025-08-10 12:01:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.901941914s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.589792662s
FAIL (2025-08-10 12:01:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.589821256s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.640543579s
FAIL (2025-08-10 12:00:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.640569518s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.............X......................X..................XX...] duration:
1.909181191s
FAIL (2025-08-10 12:00:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.909210137s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.617455891s
FAIL (2025-08-10 12:00:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.617479367s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..............X......................X..................XX..] duration:
1.818821854s
FAIL (2025-08-10 12:00:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.818848524s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X..............................................X............] duration:
5.741053572s
FAIL (2025-08-10 12:00:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.741081136s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...............X......................X..................XX.] duration:
1.826256401s
FAIL (2025-08-10 11:59:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.826286359s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X......................X..................XX] duration:
861.090927ms
FAIL (2025-08-10 11:59:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:59:21.733396755 (42h33m16.164476896s) [upload=44392]: Starting upload Aug 10 11:59:21.733464916 (42h33m16.164545037s) [upload=44392]: Done starting upload Aug 10 11:59:21.733549167 (42h33m16.164629308s) [upload=44392]: Uploading segments... Aug 10 11:59:21.733620003 (42h33m16.164700134s) [upload=44392]: Got next segment. Inline: true Aug 10 11:59:21.733626445 (42h33m16.164706576s) [upload=44392]: Waiting for error group managing segments... Aug 10 11:59:21.733913153 (42h33m16.164993284s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:59:21.733920457 (42h33m16.165000598s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:59:21.733924535 (42h33m16.165004666s) [upload=44392]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:59:21.947277085 (42h33m16.378357246s) [upload=44392]: Done uploading segments... Aug 10 11:59:21.947298045 (42h33m16.378378216s) [upload=44392]: Upload finished. err: metaclient: Too Many Requests
Duration: 861.111648ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X..............................................X...........] duration:
5.94035515s
FAIL (2025-08-10 11:59:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.940373185s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X..............................................X..........] duration:
5.620569321s
FAIL (2025-08-10 11:58:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.620586975s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X......................X..................X] duration:
872.458276ms
FAIL (2025-08-10 11:58:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:58:15.534141008 (42h32m9.965221139s) [upload=44369]: Starting upload Aug 10 11:58:15.534180153 (42h32m9.965260284s) [upload=44369]: Done starting upload Aug 10 11:58:15.534225019 (42h32m9.96530515s) [upload=44369]: Uploading segments... Aug 10 11:58:15.534258653 (42h32m9.965338784s) [upload=44369]: Got next segment. Inline: true Aug 10 11:58:15.534262210 (42h32m9.965342341s) [upload=44369]: Waiting for error group managing segments... Aug 10 11:58:15.534298279 (42h32m9.96537841s) [upload=44369]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:58:15.534302287 (42h32m9.965382408s) [upload=44369]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:58:15.534307146 (42h32m9.965387277s) [upload=44369]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:58:15.750983997 (42h32m10.182064138s) [upload=44369]: Done uploading segments... Aug 10 11:58:15.751002993 (42h32m10.182083124s) [upload=44369]: Upload finished. err: metaclient: Too Many Requests
Duration: 872.481812ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X..............................................X.........] duration:
5.603894111s
FAIL (2025-08-10 11:57:09 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.603914549s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X......................X..................] duration:
1.934688615s
FAIL (2025-08-10 11:57:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.934709254s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X..............................................X........] duration:
5.62811082s
FAIL (2025-08-10 11:56:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.628129806s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X......................X.................] duration:
1.823425615s
FAIL (2025-08-10 11:56:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.823449069s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X..............................................X.......] duration:
5.977402216s
FAIL (2025-08-10 11:55:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.977426111s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X......................X................] duration:
1.842616021s
FAIL (2025-08-10 11:55:52 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.842637913s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X......................X...............] duration:
1.86598776s
FAIL (2025-08-10 11:55:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.866026966s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.....X..............................................X......] duration:
5.65064831s
FAIL (2025-08-10 11:55:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.650677024s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X......................X..............] duration:
1.836779397s
FAIL (2025-08-10 11:54:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.8368128s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.....X..............................................X.....] duration:
5.773742308s
FAIL (2025-08-10 11:54:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.773777816s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X......................X.............] duration:
1.856290457s
FAIL (2025-08-10 11:54:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.856317729s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.....X..............................................X....] duration:
5.558375298s
FAIL (2025-08-10 11:53:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.558402811s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X......................X............] duration:
1.915017368s
FAIL (2025-08-10 11:53:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.915038238s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X..X.....X..............................................X...] duration:
5.570744639s
FAIL (2025-08-10 11:52:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.570768716s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X......................X...........] duration:
1.835271311s
FAIL (2025-08-10 11:52:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 10 11:43:31.116122302 (42h17m25.547202434s) [upload=44108]: Starting upload Aug 10 11:43:31.116188770 (42h17m25.547268901s) [upload=44108]: Done starting upload Aug 10 11:43:31.116241211 (42h17m25.547321342s) [upload=44108]: Uploading segments... Aug 10 11:43:31.116288201 (42h17m25.547368322s) [upload=44108]: Got next segment. Inline: true Aug 10 11:43:31.116293250 (42h17m25.547373381s) [upload=44108]: Waiting for error group managing segments... Aug 10 11:43:31.116333627 (42h17m25.547413758s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 10 11:43:31.116338236 (42h17m25.547418367s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 10 11:43:31.116340941 (42h17m25.547421072s) [upload=44108]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 10 11:43:31.330546376 (42h17m25.761626507s) [upload=44108]: Done uploading segments... Aug 10 11:43:31.330565733 (42h17m25.761645854s) [upload=44108]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.835298041s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..X.....X..............................................X..] duration:
5.725441227s
FAIL (2025-08-10 11:51:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 65e0d65133fef2f7a58c75a9cfcaf2ab185f7ef40a6ba563a00a347037482c0a != before b5ed442126e6d6e073c295b83953844459496cf4d5fed73e6cb75b14880e81d5
======LOGS======
Aug 10 11:50:25.007263985 (42h24m19.438344116s) [upload=44235]: Starting upload
Aug 10 11:50:25.007310414 (42h24m19.438390545s) [upload=44235]: Done starting upload
Aug 10 11:50:25.007410635 (42h24m19.438490766s) [upload=44235]: Uploading segments...
Aug 10 11:50:25.007490999 (42h24m19.43857113s) [upload=44235]: Got next segment. Inline: false
Aug 10 11:50:25.007532349 (42h24m19.43861248s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 10 11:50:25.007536506 (42h24m19.438616627s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 10 11:50:25.499519079 (42h24m19.93059924s) [seg_pos={0 0}, upload=44235]: Begin upload segment...
Aug 10 11:50:25.499589524 (42h24m19.930669665s) [seg_pos={0 0}, upload=44235]: Done begin upload segment.
Aug 10 11:50:25.499620022 (42h24m19.930700163s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499648216 (42h24m19.930728377s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.499698052 (42h24m19.930778183s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500421926 (42h24m19.931502058s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.500982629 (42h24m19.93206278s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.501498015 (42h24m19.932578146s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502048068 (42h24m19.933128209s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502555259 (42h24m19.93363539s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.502992656 (42h24m19.934072787s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503413100 (42h24m19.934493231s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.503800721 (42h24m19.934880852s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504196688 (42h24m19.935276819s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504542170 (42h24m19.935622311s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.504873213 (42h24m19.935953344s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505210548 (42h24m19.936290679s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505511735 (42h24m19.936591866s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.505853639 (42h24m19.93693377s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:25.507474279 (42h24m19.93855441s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Uploading piece...
Aug 10 11:50:26.605122648 (42h24m21.036202779s) [upload=44235]: Next returned nil segment
Aug 10 11:50:26.605141695 (42h24m21.036221826s) [upload=44235]: Waiting for error group managing segments...
Aug 10 11:50:26.883684065 (42h24m21.314764196s) [noise=true , address=64.49.13.155:4924 , piece_id=WXYS3PH4RNGEIHXTOUI5DQNNWQZOGMCBFPHMVYT5CJGGVUH7BDRA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.894525849 (42h24m21.32560598s) [noise=true , address=64.49.13.139:4478 , piece_id=RVZZHJE7R2PAZQ3LQMKZRH5UCTHTBHVVAIMRL7P4F7EN433OMM2Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.906335445 (42h24m21.337415576s) [noise=true , address=64.49.13.170:4724 , piece_id=7WFEPBT3TXSIJADXBK7PEJTFR76QLAUDINF27C6VXO3ZHNHEP2WQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:26.932166979 (42h24m21.36324711s) [noise=true , address=64.49.13.169:4713 , piece_id=6VXWBWCUVMUJF5HW7CFVOLO5QGPZSFXA6QZ7VHDDW54X67NGEPTA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.442168046 (42h24m21.873248178s) [noise=true , address=45.91.116.13:4185 , piece_id=B6OGI7RLRTKPTZCIVYTZGVC2X2SSWD5DUSV2LL4SIWXHZOZW545Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.446524571 (42h24m21.877604702s) [noise=true , address=104.36.82.17:4339 , piece_id=ER32Z23CCXU575TZHWNNFSJ3OUHXEKWRDR7AYIUMTGSFEIIXPG3Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.449773158 (42h24m21.880853289s) [noise=true , address=104.36.82.46:4501 , piece_id=R22DKGP7JPDKMUUUJSSIIV2ITMESYQAFPXOJBALCEC4T7W3AU6NA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.451780879 (42h24m21.882861s) [noise=true , address=104.36.82.5:4863 , piece_id=XPUTOWTC3NHNX5PLPGJNY5HLHANFTSKEL5BKP4ALNAKV6FNS5BIQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.460972064 (42h24m21.892052195s) [noise=true , address=104.36.82.61:4382 , piece_id=O2GPZJY6YDQJSCQHVG5HBX47RSQ2KMAQRG4GC6HMQ525R4Z2I6QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.461587763 (42h24m21.892667894s) [noise=true , address=104.36.82.18:4389 , piece_id=722EE65GSGGLSQTSEAZPQVSQ3YQO324JGXBV4YKB2H64YDUKBNAQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.475776410 (42h24m21.906856541s) [noise=true , address=104.36.82.35:4589 , piece_id=6E75IRXWXJBRLLEUBA3DN4A6TJCFSSSHN5JCW2V7AE5NAYHTPEWQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.483717995 (42h24m21.914798126s) [noise=true , address=104.36.82.47:4546 , piece_id=DRATM2FCDHBAUA4S4N75YLNJY5WZTSQ4QJLZ6E5Z6UX5CHWVUCYQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.500435190 (42h24m21.931515321s) [noise=true , address=104.36.82.58:4269 , piece_id=32VV22QBXBSEKJBF2NG4MOYA4CMZAZKIZVGHFZEAU2N4ER7N6GVQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539098886 (42h24m21.970179057s) [noise=true , address=104.36.82.14:4239 , piece_id=SUTYW5TOIINOWNW62EPXWRNMZJPQS5PZE36IBGF5HGNZIOVAF3QA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: <nil>
Aug 10 11:50:27.539131989 (42h24m21.97021214s) [seg_pos={0 0}, upload=44235]: Segment reached optimal threshold of 14 pieces.
Aug 10 11:50:27.539315160 (42h24m21.970395371s) [noise=true , address=77.90.31.19:4848 , piece_id=AFXKS5ICFN6UNKTWQLDTWOPGMBAKAUKLIH44LG47S72OUN4LFILA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EFoU2X25nensqiGn1NwTk1LcVDFK9yeJaGBm1nDTe8GqfGXwD): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539436963 (42h24m21.970517134s) [noise=true , address=104.36.82.19:4412 , piece_id=NDTNT7WKVE2OAW6KLOYMUNP5WTLDFMK5IJ7M5HTH4RYMTSR4ZYWA, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MyHzHi6j7ogzfSAgM4pWXq6SzA9tNTnWXXGAVcvYNZjxU3bcX): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539457853 (42h24m21.970538004s) [noise=true , address=104.36.82.59:4312 , piece_id=4AQOAF5RMQUGGNJ2CWCYKNGFKQQJOOBCFU2JNOVDM75HKTPPB46Q, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DY4TMNpTfCcXxVyy8HJpbMFZT64wEZiPSysost4V4dbtqHWvY): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539520322 (42h24m21.970600453s) [noise=true , address=104.36.82.16:4300 , piece_id=NCVTKVGO4RNPPXSURTVZS76N2TDYEXR3LPJXO6XGJ6BOK2VF6YTQ, seg_pos={0 0}, upload=44235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orVauQ7c1EEcy4Kh4ydLcaYo1y8hLGxvsMhd8WDdyojX1Rzvg): protocol: expected piece hash; context canceled; EOF
Aug 10 11:50:27.539561692 (42h24m21.970641823s) [seg_pos={0 0}, upload=44235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 10 11:50:27.539660892 (42h24m21.970741023s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 10 11:50:27.539668717 (42h24m21.970748858s) [upload=44235]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 10 11:50:27.832594009 (42h24m22.26367414s) [upload=44235]: Done uploading segments...
Aug 10 11:50:27.832619698 (42h24m22.26369986s) [upload=44235]: Upload finished. err: <nil>
Duration: 5.725467296s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|