Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.976990006s
FAIL (2025-08-12 14:46:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.97701276s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X............................X...........] duration:
6.286082992s
FAIL (2025-08-12 14:45:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 6.286110454s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.009611131s
FAIL (2025-08-12 14:45:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.009638372s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X............................X..........] duration:
6.188413122s
FAIL (2025-08-12 14:44:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 6.188444211s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
1.883840732s
FAIL (2025-08-12 14:44:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.88387651s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X............................X.........] duration:
6.280138407s
FAIL (2025-08-12 14:44:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 6.280160227s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
1.8534379s
FAIL (2025-08-12 14:43:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.85346354s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................X............................X........] duration:
6.054763256s
FAIL (2025-08-12 14:43:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 6.054789587s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................X............................X.......] duration:
5.823711592s
FAIL (2025-08-12 14:42:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 5.823738263s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.833586047s
FAIL (2025-08-12 14:42:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.833620694s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................X............................X......] duration:
6.237489742s
FAIL (2025-08-12 14:41:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 6.237518768s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.923630065s
FAIL (2025-08-12 14:41:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.92365911s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................X............................X.....] duration:
6.313343943s
FAIL (2025-08-12 14:41:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 6.313375985s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
1.907711066s
FAIL (2025-08-12 14:40:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.907735391s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X...................X.......................................] duration:
2.122104374s
FAIL (2025-08-12 14:40:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.122136817s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................X............................X....] duration:
5.673275035s
FAIL (2025-08-12 14:39:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 5.673299061s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X...................X......................................] duration:
1.821022721s
FAIL (2025-08-12 14:39:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.821049012s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................X............................X...] duration:
6.289873778s
FAIL (2025-08-12 14:39:26 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 6.289915798s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X...................X.....................................] duration:
2.096993892s
FAIL (2025-08-12 14:39:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.097022287s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................X............................X..] duration:
6.495089523s
FAIL (2025-08-12 14:38:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 6.495115793s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X............................X.] duration:
5.941714857s
FAIL (2025-08-12 14:38:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 5.941738414s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X...................X....................................] duration:
1.91925322s
FAIL (2025-08-12 14:38:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.91927479s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X............................X] duration:
4.489114688s
FAIL (2025-08-12 14:37:32 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 14:37:29.051314805 (93h11m23.482394936s) [upload=97079]: Starting upload
Aug 12 14:37:29.051364380 (93h11m23.482444582s) [upload=97079]: Done starting upload
Aug 12 14:37:29.051502765 (93h11m23.482582886s) [upload=97079]: Uploading segments...
Aug 12 14:37:29.051610732 (93h11m23.482690863s) [upload=97079]: Got next segment. Inline: false
Aug 12 14:37:29.051644957 (93h11m23.482725088s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:37:29.051649746 (93h11m23.482729867s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:37:29.510656349 (93h11m23.94173647s) [seg_pos={0 0}, upload=97079]: Begin upload segment...
Aug 12 14:37:29.510705834 (93h11m23.941785965s) [seg_pos={0 0}, upload=97079]: Done begin upload segment.
Aug 12 14:37:29.510727776 (93h11m23.941807907s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.510790315 (93h11m23.941870436s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511086833 (93h11m23.942166954s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511184289 (93h11m23.94226443s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511356198 (93h11m23.94243633s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511457011 (93h11m23.942537142s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511627939 (93h11m23.94270807s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511691550 (93h11m23.942771671s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511907664 (93h11m23.942987795s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.511952178 (93h11m23.943032309s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512149506 (93h11m23.943229638s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512378204 (93h11m23.943458335s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512588296 (93h11m23.943668417s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.512807105 (93h11m23.943887226s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513016875 (93h11m23.944097007s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513204605 (93h11m23.944284736s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513558041 (93h11m23.944638172s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:29.513764647 (93h11m23.944844778s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Uploading piece...
Aug 12 14:37:30.649002235 (93h11m25.080082366s) [upload=97079]: Next returned nil segment
Aug 12 14:37:30.649022454 (93h11m25.080102575s) [upload=97079]: Waiting for error group managing segments...
Aug 12 14:37:30.947134639 (93h11m25.37821476s) [noise=true , address=66.23.193.175:4558 , piece_id=CUIBIDJJMBSQCIFWVQQQAY3YFWN6G5X6SSAC4Y4JNTKK5X3ZUCUQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.440859942 (93h11m25.871940073s) [noise=true , address=77.90.31.12:4593 , piece_id=B3MYGQQV2IGIWXI4SBWNCXEWTM4B5SUKSSPWSK7KOTASLWAKDZDQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.496749930 (93h11m25.927830061s) [noise=true , address=104.36.82.13:4192 , piece_id=53IXPOD5CRHAP3BORFO2TTRTBJRWARMPRMEMFHICOOKMT2RZTN2A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.541422134 (93h11m25.972502265s) [noise=true , address=104.36.82.38:4707 , piece_id=3AYHRATE6V42EBA5DV6IZURFGW3SUBARAXOFEQYFD3WIBHUZIGSA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.580203817 (93h11m26.011283948s) [noise=true , address=104.36.82.5:4868 , piece_id=QAISJ7HOJLP7BSUVUBVKYKBYTKFFCN6NTNR7M7F23TXWPDAEFADA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.583141328 (93h11m26.014221479s) [noise=true , address=104.36.82.62:4437 , piece_id=WDL6I3W32T33TZAVFCAN2CHC6DAS545Z7LVXQD7W2MGIGWNEGQAQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.597293436 (93h11m26.028373557s) [noise=true , address=104.36.82.37:4655 , piece_id=NMD6W45SIRHNNMFKN6N6TUE4V4HCARTVKMCUPLIF3GPBLJUVGX3A, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.622883399 (93h11m26.05396353s) [noise=true , address=104.36.82.36:4617 , piece_id=4BD6GBI5H32ALVUTYX77EXUKBS7GW57ECY4CB5FGWU6AFFHUTEDA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.626115432 (93h11m26.057195563s) [noise=true , address=104.36.82.61:4378 , piece_id=2V2XQKZDOA4XGWMIJODMAOONKHJTZJ42QHYRGDGVRJ2XKEZGF7YQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.627583221 (93h11m26.058663352s) [noise=true , address=104.36.82.23:4457 , piece_id=GCAT45I6LBSL3LWXL4MF6KTLY2EQ2SVG7JL6N2MBXZNKPXKQCDAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.636836476 (93h11m26.067916607s) [noise=true , address=104.36.82.4:4809 , piece_id=SZOUPCDP5RB6LYRCMFQBUKRFY3X2UPRPIY3ZHYJB6AP7GCHLMUHQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.653931264 (93h11m26.085011396s) [noise=true , address=104.36.82.16:4324 , piece_id=OOYHQKKNF6W2DO2YBX7EPDV54WKDQCS7QGN6CCHHK7WJ7MBYRRIA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:31.686519708 (93h11m26.117599839s) [noise=true , address=104.36.82.19:4423 , piece_id=HTAUZKPZTL2W43ZPRVJKZIRFKBOBRHNPLAL4MIBCNGGBXFOCQIAA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028207740 (93h11m26.459287871s) [noise=true , address=104.36.82.39:4738 , piece_id=KFY7CL6ZQFG6PX3VZP522RMBYPUS6SE6NXH7YQLUOVYXB4I4BJEA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: <nil>
Aug 12 14:37:32.028241624 (93h11m26.459321745s) [seg_pos={0 0}, upload=97079]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:37:32.028461575 (93h11m26.459541706s) [noise=true , address=104.36.82.58:4275 , piece_id=O3HNTJVUK6N7U3ONVXGPTWKSPUEHDO2DDHJ5S33CWNMGE5JWY5EQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Mb3s64JoVf1TbMuMRpT67xzAN4YSE9txxRnjomuvZUpSj9tt3): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028502192 (93h11m26.459582323s) [noise=true , address=79.127.201.215:4344 , piece_id=TWZZVYFG7EVO4U2ZCDJH62M7UFR6MZB4GKLH7QZF4YRQ2MYYALZA, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028530376 (93h11m26.459610507s) [noise=true , address=104.36.82.8:4993 , piece_id=O7S2AD6LJA5RUWNHNMAKB5FPHSGMZZB4ZZ5XWXB53JJGQPRRQFWQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xnx9shwwZAcWVV6aPj2ikukj8nbKiFsBs1hiS89zSkRQqNMJD): protocol: expected piece hash; context canceled; EOF
Aug 12 14:37:32.028586043 (93h11m26.459666174s) [noise=true , address=104.36.82.60:4361 , piece_id=FFCMFVUS65P3M2SDRBUSQSOX6DVZJ6UAUMIIITX7HIK6RQPUNMCQ, seg_pos={0 0}, upload=97079]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fbxCfwkBdYcJG3LKJnU19Kyk9DtkhKdEAKoVfL353zC6Hge2k): protocol: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:57172->104.36.82.60:4361: use of closed network connection
Aug 12 14:37:32.028596994 (93h11m26.459677125s) [seg_pos={0 0}, upload=97079]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:37:32.028673550 (93h11m26.459753701s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:37:32.028680664 (93h11m26.459760805s) [upload=97079]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:37:32.390432274 (93h11m26.821512415s) [upload=97079]: Done uploading segments...
Aug 12 14:37:32.390454978 (93h11m26.821535109s) [upload=97079]: Upload finished. err: <nil>
Duration: 4.48914699s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X...................X...................................] duration:
2.209074644s
FAIL (2025-08-12 14:36:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.209100543s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.547027146s
FAIL (2025-08-12 14:36:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 40732489b962274f7c382ed12618172744042a3a2bfe013efec47c095b09c5df != before e6b7c6bde3d8af3ce6ddc4c3e8ad9a229a46aa720c87f6c885701f6436777099
======LOGS======
Aug 12 14:14:07.409031742 (92h48m1.840111873s) [upload=96698]: Starting upload
Aug 12 14:14:07.409087178 (92h48m1.840167309s) [upload=96698]: Done starting upload
Aug 12 14:14:07.409164175 (92h48m1.840244296s) [upload=96698]: Uploading segments...
Aug 12 14:14:07.409292210 (92h48m1.840372351s) [upload=96698]: Got next segment. Inline: false
Aug 12 14:14:07.409327578 (92h48m1.840407709s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:14:07.409332868 (92h48m1.840412999s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:14:07.934722080 (92h48m2.365802211s) [seg_pos={0 0}, upload=96698]: Begin upload segment...
Aug 12 14:14:07.934772547 (92h48m2.365852668s) [seg_pos={0 0}, upload=96698]: Done begin upload segment.
Aug 12 14:14:07.934794750 (92h48m2.365874881s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.934801853 (92h48m2.365881984s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935159818 (92h48m2.366239949s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935476614 (92h48m2.366556745s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935694982 (92h48m2.366775103s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935765266 (92h48m2.366845397s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936015946 (92h48m2.367096067s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936208083 (92h48m2.367288204s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936302374 (92h48m2.367382505s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936543476 (92h48m2.367623607s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936787502 (92h48m2.367867623s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937041078 (92h48m2.368121209s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937218717 (92h48m2.368298848s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937465870 (92h48m2.368546001s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937718333 (92h48m2.368798464s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937843002 (92h48m2.368923123s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938086508 (92h48m2.369166639s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938311428 (92h48m2.369391549s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:09.051491100 (92h48m3.482571221s) [upload=96698]: Next returned nil segment
Aug 12 14:14:09.051508273 (92h48m3.482588394s) [upload=96698]: Waiting for error group managing segments...
Aug 12 14:14:09.410281928 (92h48m3.841362059s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.428391659 (92h48m3.85947183s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.478827452 (92h48m3.909907583s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.906022923 (92h48m4.337103054s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.950710206 (92h48m4.381790337s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.994230577 (92h48m4.425310708s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.005388526 (92h48m4.436468667s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.013672706 (92h48m4.444752847s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.031568317 (92h48m4.462648448s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.055851340 (92h48m4.486931521s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.131567343 (92h48m4.562647474s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.142934372 (92h48m4.574014503s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.221770144 (92h48m4.652850275s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306199077 (92h48m4.737279198s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306225608 (92h48m4.737305729s) [seg_pos={0 0}, upload=96698]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:14:10.306307996 (92h48m4.737388127s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Vs7b4tkgb1GE6i5Kswt2kQ81Gyz7kf1bf8VyzrWxCXgbJdcey): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306349254 (92h48m4.737429375s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306406765 (92h48m4.737486896s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306460037 (92h48m4.737540168s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306517046 (92h48m4.737597177s) [seg_pos={0 0}, upload=96698]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:14:10.306604924 (92h48m4.737685055s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:14:10.306609282 (92h48m4.737689403s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:14:10.630316693 (92h48m5.061396824s) [upload=96698]: Done uploading segments...
Aug 12 14:14:10.630336561 (92h48m5.061416692s) [upload=96698]: Upload finished. err: <nil>
Duration: 6.547056472s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.33379566s
FAIL (2025-08-12 14:36:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 40732489b962274f7c382ed12618172744042a3a2bfe013efec47c095b09c5df != before e6b7c6bde3d8af3ce6ddc4c3e8ad9a229a46aa720c87f6c885701f6436777099
======LOGS======
Aug 12 14:14:07.409031742 (92h48m1.840111873s) [upload=96698]: Starting upload
Aug 12 14:14:07.409087178 (92h48m1.840167309s) [upload=96698]: Done starting upload
Aug 12 14:14:07.409164175 (92h48m1.840244296s) [upload=96698]: Uploading segments...
Aug 12 14:14:07.409292210 (92h48m1.840372351s) [upload=96698]: Got next segment. Inline: false
Aug 12 14:14:07.409327578 (92h48m1.840407709s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:14:07.409332868 (92h48m1.840412999s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:14:07.934722080 (92h48m2.365802211s) [seg_pos={0 0}, upload=96698]: Begin upload segment...
Aug 12 14:14:07.934772547 (92h48m2.365852668s) [seg_pos={0 0}, upload=96698]: Done begin upload segment.
Aug 12 14:14:07.934794750 (92h48m2.365874881s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.934801853 (92h48m2.365881984s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935159818 (92h48m2.366239949s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935476614 (92h48m2.366556745s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935694982 (92h48m2.366775103s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935765266 (92h48m2.366845397s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936015946 (92h48m2.367096067s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936208083 (92h48m2.367288204s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936302374 (92h48m2.367382505s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936543476 (92h48m2.367623607s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936787502 (92h48m2.367867623s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937041078 (92h48m2.368121209s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937218717 (92h48m2.368298848s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937465870 (92h48m2.368546001s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937718333 (92h48m2.368798464s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937843002 (92h48m2.368923123s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938086508 (92h48m2.369166639s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938311428 (92h48m2.369391549s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:09.051491100 (92h48m3.482571221s) [upload=96698]: Next returned nil segment
Aug 12 14:14:09.051508273 (92h48m3.482588394s) [upload=96698]: Waiting for error group managing segments...
Aug 12 14:14:09.410281928 (92h48m3.841362059s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.428391659 (92h48m3.85947183s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.478827452 (92h48m3.909907583s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.906022923 (92h48m4.337103054s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.950710206 (92h48m4.381790337s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.994230577 (92h48m4.425310708s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.005388526 (92h48m4.436468667s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.013672706 (92h48m4.444752847s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.031568317 (92h48m4.462648448s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.055851340 (92h48m4.486931521s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.131567343 (92h48m4.562647474s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.142934372 (92h48m4.574014503s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.221770144 (92h48m4.652850275s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306199077 (92h48m4.737279198s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306225608 (92h48m4.737305729s) [seg_pos={0 0}, upload=96698]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:14:10.306307996 (92h48m4.737388127s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Vs7b4tkgb1GE6i5Kswt2kQ81Gyz7kf1bf8VyzrWxCXgbJdcey): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306349254 (92h48m4.737429375s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306406765 (92h48m4.737486896s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306460037 (92h48m4.737540168s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306517046 (92h48m4.737597177s) [seg_pos={0 0}, upload=96698]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:14:10.306604924 (92h48m4.737685055s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:14:10.306609282 (92h48m4.737689403s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:14:10.630316693 (92h48m5.061396824s) [upload=96698]: Done uploading segments...
Aug 12 14:14:10.630336561 (92h48m5.061416692s) [upload=96698]: Upload finished. err: <nil>
Duration: 6.333816861s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X...................X..................................] duration:
1.880581855s
FAIL (2025-08-12 14:36:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.880621131s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
6.132142677s
FAIL (2025-08-12 14:35:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 40732489b962274f7c382ed12618172744042a3a2bfe013efec47c095b09c5df != before e6b7c6bde3d8af3ce6ddc4c3e8ad9a229a46aa720c87f6c885701f6436777099
======LOGS======
Aug 12 14:14:07.409031742 (92h48m1.840111873s) [upload=96698]: Starting upload
Aug 12 14:14:07.409087178 (92h48m1.840167309s) [upload=96698]: Done starting upload
Aug 12 14:14:07.409164175 (92h48m1.840244296s) [upload=96698]: Uploading segments...
Aug 12 14:14:07.409292210 (92h48m1.840372351s) [upload=96698]: Got next segment. Inline: false
Aug 12 14:14:07.409327578 (92h48m1.840407709s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:14:07.409332868 (92h48m1.840412999s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:14:07.934722080 (92h48m2.365802211s) [seg_pos={0 0}, upload=96698]: Begin upload segment...
Aug 12 14:14:07.934772547 (92h48m2.365852668s) [seg_pos={0 0}, upload=96698]: Done begin upload segment.
Aug 12 14:14:07.934794750 (92h48m2.365874881s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.934801853 (92h48m2.365881984s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935159818 (92h48m2.366239949s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935476614 (92h48m2.366556745s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935694982 (92h48m2.366775103s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935765266 (92h48m2.366845397s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936015946 (92h48m2.367096067s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936208083 (92h48m2.367288204s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936302374 (92h48m2.367382505s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936543476 (92h48m2.367623607s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936787502 (92h48m2.367867623s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937041078 (92h48m2.368121209s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937218717 (92h48m2.368298848s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937465870 (92h48m2.368546001s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937718333 (92h48m2.368798464s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937843002 (92h48m2.368923123s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938086508 (92h48m2.369166639s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938311428 (92h48m2.369391549s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:09.051491100 (92h48m3.482571221s) [upload=96698]: Next returned nil segment
Aug 12 14:14:09.051508273 (92h48m3.482588394s) [upload=96698]: Waiting for error group managing segments...
Aug 12 14:14:09.410281928 (92h48m3.841362059s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.428391659 (92h48m3.85947183s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.478827452 (92h48m3.909907583s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.906022923 (92h48m4.337103054s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.950710206 (92h48m4.381790337s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.994230577 (92h48m4.425310708s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.005388526 (92h48m4.436468667s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.013672706 (92h48m4.444752847s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.031568317 (92h48m4.462648448s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.055851340 (92h48m4.486931521s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.131567343 (92h48m4.562647474s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.142934372 (92h48m4.574014503s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.221770144 (92h48m4.652850275s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306199077 (92h48m4.737279198s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306225608 (92h48m4.737305729s) [seg_pos={0 0}, upload=96698]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:14:10.306307996 (92h48m4.737388127s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Vs7b4tkgb1GE6i5Kswt2kQ81Gyz7kf1bf8VyzrWxCXgbJdcey): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306349254 (92h48m4.737429375s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306406765 (92h48m4.737486896s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306460037 (92h48m4.737540168s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306517046 (92h48m4.737597177s) [seg_pos={0 0}, upload=96698]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:14:10.306604924 (92h48m4.737685055s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:14:10.306609282 (92h48m4.737689403s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:14:10.630316693 (92h48m5.061396824s) [upload=96698]: Done uploading segments...
Aug 12 14:14:10.630336561 (92h48m5.061416692s) [upload=96698]: Upload finished. err: <nil>
Duration: 6.132170059s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X...................X.................................] duration:
2.184893214s
FAIL (2025-08-12 14:35:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.184936458s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
6.062519128s
FAIL (2025-08-12 14:34:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 40732489b962274f7c382ed12618172744042a3a2bfe013efec47c095b09c5df != before e6b7c6bde3d8af3ce6ddc4c3e8ad9a229a46aa720c87f6c885701f6436777099
======LOGS======
Aug 12 14:14:07.409031742 (92h48m1.840111873s) [upload=96698]: Starting upload
Aug 12 14:14:07.409087178 (92h48m1.840167309s) [upload=96698]: Done starting upload
Aug 12 14:14:07.409164175 (92h48m1.840244296s) [upload=96698]: Uploading segments...
Aug 12 14:14:07.409292210 (92h48m1.840372351s) [upload=96698]: Got next segment. Inline: false
Aug 12 14:14:07.409327578 (92h48m1.840407709s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:14:07.409332868 (92h48m1.840412999s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:14:07.934722080 (92h48m2.365802211s) [seg_pos={0 0}, upload=96698]: Begin upload segment...
Aug 12 14:14:07.934772547 (92h48m2.365852668s) [seg_pos={0 0}, upload=96698]: Done begin upload segment.
Aug 12 14:14:07.934794750 (92h48m2.365874881s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.934801853 (92h48m2.365881984s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935159818 (92h48m2.366239949s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935476614 (92h48m2.366556745s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935694982 (92h48m2.366775103s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935765266 (92h48m2.366845397s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936015946 (92h48m2.367096067s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936208083 (92h48m2.367288204s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936302374 (92h48m2.367382505s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936543476 (92h48m2.367623607s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936787502 (92h48m2.367867623s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937041078 (92h48m2.368121209s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937218717 (92h48m2.368298848s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937465870 (92h48m2.368546001s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937718333 (92h48m2.368798464s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937843002 (92h48m2.368923123s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938086508 (92h48m2.369166639s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938311428 (92h48m2.369391549s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:09.051491100 (92h48m3.482571221s) [upload=96698]: Next returned nil segment
Aug 12 14:14:09.051508273 (92h48m3.482588394s) [upload=96698]: Waiting for error group managing segments...
Aug 12 14:14:09.410281928 (92h48m3.841362059s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.428391659 (92h48m3.85947183s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.478827452 (92h48m3.909907583s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.906022923 (92h48m4.337103054s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.950710206 (92h48m4.381790337s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.994230577 (92h48m4.425310708s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.005388526 (92h48m4.436468667s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.013672706 (92h48m4.444752847s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.031568317 (92h48m4.462648448s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.055851340 (92h48m4.486931521s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.131567343 (92h48m4.562647474s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.142934372 (92h48m4.574014503s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.221770144 (92h48m4.652850275s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306199077 (92h48m4.737279198s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306225608 (92h48m4.737305729s) [seg_pos={0 0}, upload=96698]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:14:10.306307996 (92h48m4.737388127s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Vs7b4tkgb1GE6i5Kswt2kQ81Gyz7kf1bf8VyzrWxCXgbJdcey): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306349254 (92h48m4.737429375s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306406765 (92h48m4.737486896s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306460037 (92h48m4.737540168s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306517046 (92h48m4.737597177s) [seg_pos={0 0}, upload=96698]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:14:10.306604924 (92h48m4.737685055s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:14:10.306609282 (92h48m4.737689403s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:14:10.630316693 (92h48m5.061396824s) [upload=96698]: Done uploading segments...
Aug 12 14:14:10.630336561 (92h48m5.061416692s) [upload=96698]: Upload finished. err: <nil>
Duration: 6.062551811s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X...................X................................] duration:
1.844562496s
FAIL (2025-08-12 14:34:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.844617882s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X...................X...............................] duration:
1.893428678s
FAIL (2025-08-12 14:33:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.893457343s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X..................................X........................] duration:
6.30354s
FAIL (2025-08-12 14:33:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 40732489b962274f7c382ed12618172744042a3a2bfe013efec47c095b09c5df != before e6b7c6bde3d8af3ce6ddc4c3e8ad9a229a46aa720c87f6c885701f6436777099
======LOGS======
Aug 12 14:14:07.409031742 (92h48m1.840111873s) [upload=96698]: Starting upload
Aug 12 14:14:07.409087178 (92h48m1.840167309s) [upload=96698]: Done starting upload
Aug 12 14:14:07.409164175 (92h48m1.840244296s) [upload=96698]: Uploading segments...
Aug 12 14:14:07.409292210 (92h48m1.840372351s) [upload=96698]: Got next segment. Inline: false
Aug 12 14:14:07.409327578 (92h48m1.840407709s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:14:07.409332868 (92h48m1.840412999s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:14:07.934722080 (92h48m2.365802211s) [seg_pos={0 0}, upload=96698]: Begin upload segment...
Aug 12 14:14:07.934772547 (92h48m2.365852668s) [seg_pos={0 0}, upload=96698]: Done begin upload segment.
Aug 12 14:14:07.934794750 (92h48m2.365874881s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.934801853 (92h48m2.365881984s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935159818 (92h48m2.366239949s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935476614 (92h48m2.366556745s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935694982 (92h48m2.366775103s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935765266 (92h48m2.366845397s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936015946 (92h48m2.367096067s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936208083 (92h48m2.367288204s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936302374 (92h48m2.367382505s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936543476 (92h48m2.367623607s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936787502 (92h48m2.367867623s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937041078 (92h48m2.368121209s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937218717 (92h48m2.368298848s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937465870 (92h48m2.368546001s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937718333 (92h48m2.368798464s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937843002 (92h48m2.368923123s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938086508 (92h48m2.369166639s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938311428 (92h48m2.369391549s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:09.051491100 (92h48m3.482571221s) [upload=96698]: Next returned nil segment
Aug 12 14:14:09.051508273 (92h48m3.482588394s) [upload=96698]: Waiting for error group managing segments...
Aug 12 14:14:09.410281928 (92h48m3.841362059s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.428391659 (92h48m3.85947183s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.478827452 (92h48m3.909907583s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.906022923 (92h48m4.337103054s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.950710206 (92h48m4.381790337s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.994230577 (92h48m4.425310708s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.005388526 (92h48m4.436468667s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.013672706 (92h48m4.444752847s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.031568317 (92h48m4.462648448s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.055851340 (92h48m4.486931521s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.131567343 (92h48m4.562647474s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.142934372 (92h48m4.574014503s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.221770144 (92h48m4.652850275s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306199077 (92h48m4.737279198s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306225608 (92h48m4.737305729s) [seg_pos={0 0}, upload=96698]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:14:10.306307996 (92h48m4.737388127s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Vs7b4tkgb1GE6i5Kswt2kQ81Gyz7kf1bf8VyzrWxCXgbJdcey): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306349254 (92h48m4.737429375s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306406765 (92h48m4.737486896s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306460037 (92h48m4.737540168s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306517046 (92h48m4.737597177s) [seg_pos={0 0}, upload=96698]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:14:10.306604924 (92h48m4.737685055s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:14:10.306609282 (92h48m4.737689403s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:14:10.630316693 (92h48m5.061396824s) [upload=96698]: Done uploading segments...
Aug 12 14:14:10.630336561 (92h48m5.061416692s) [upload=96698]: Upload finished. err: <nil>
Duration: 6.30356053s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X...................X..............................] duration:
2.05699465s
FAIL (2025-08-12 14:32:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.057022854s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X..................................X.......................] duration:
6.007298465s
FAIL (2025-08-12 14:32:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 40732489b962274f7c382ed12618172744042a3a2bfe013efec47c095b09c5df != before e6b7c6bde3d8af3ce6ddc4c3e8ad9a229a46aa720c87f6c885701f6436777099
======LOGS======
Aug 12 14:14:07.409031742 (92h48m1.840111873s) [upload=96698]: Starting upload
Aug 12 14:14:07.409087178 (92h48m1.840167309s) [upload=96698]: Done starting upload
Aug 12 14:14:07.409164175 (92h48m1.840244296s) [upload=96698]: Uploading segments...
Aug 12 14:14:07.409292210 (92h48m1.840372351s) [upload=96698]: Got next segment. Inline: false
Aug 12 14:14:07.409327578 (92h48m1.840407709s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:14:07.409332868 (92h48m1.840412999s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:14:07.934722080 (92h48m2.365802211s) [seg_pos={0 0}, upload=96698]: Begin upload segment...
Aug 12 14:14:07.934772547 (92h48m2.365852668s) [seg_pos={0 0}, upload=96698]: Done begin upload segment.
Aug 12 14:14:07.934794750 (92h48m2.365874881s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.934801853 (92h48m2.365881984s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935159818 (92h48m2.366239949s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935476614 (92h48m2.366556745s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935694982 (92h48m2.366775103s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935765266 (92h48m2.366845397s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936015946 (92h48m2.367096067s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936208083 (92h48m2.367288204s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936302374 (92h48m2.367382505s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936543476 (92h48m2.367623607s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936787502 (92h48m2.367867623s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937041078 (92h48m2.368121209s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937218717 (92h48m2.368298848s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937465870 (92h48m2.368546001s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937718333 (92h48m2.368798464s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937843002 (92h48m2.368923123s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938086508 (92h48m2.369166639s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938311428 (92h48m2.369391549s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:09.051491100 (92h48m3.482571221s) [upload=96698]: Next returned nil segment
Aug 12 14:14:09.051508273 (92h48m3.482588394s) [upload=96698]: Waiting for error group managing segments...
Aug 12 14:14:09.410281928 (92h48m3.841362059s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.428391659 (92h48m3.85947183s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.478827452 (92h48m3.909907583s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.906022923 (92h48m4.337103054s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.950710206 (92h48m4.381790337s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.994230577 (92h48m4.425310708s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.005388526 (92h48m4.436468667s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.013672706 (92h48m4.444752847s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.031568317 (92h48m4.462648448s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.055851340 (92h48m4.486931521s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.131567343 (92h48m4.562647474s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.142934372 (92h48m4.574014503s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.221770144 (92h48m4.652850275s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306199077 (92h48m4.737279198s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306225608 (92h48m4.737305729s) [seg_pos={0 0}, upload=96698]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:14:10.306307996 (92h48m4.737388127s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Vs7b4tkgb1GE6i5Kswt2kQ81Gyz7kf1bf8VyzrWxCXgbJdcey): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306349254 (92h48m4.737429375s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306406765 (92h48m4.737486896s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306460037 (92h48m4.737540168s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306517046 (92h48m4.737597177s) [seg_pos={0 0}, upload=96698]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:14:10.306604924 (92h48m4.737685055s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:14:10.306609282 (92h48m4.737689403s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:14:10.630316693 (92h48m5.061396824s) [upload=96698]: Done uploading segments...
Aug 12 14:14:10.630336561 (92h48m5.061416692s) [upload=96698]: Upload finished. err: <nil>
Duration: 6.007324944s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X..................................X......................] duration:
6.303204812s
FAIL (2025-08-12 14:31:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 40732489b962274f7c382ed12618172744042a3a2bfe013efec47c095b09c5df != before e6b7c6bde3d8af3ce6ddc4c3e8ad9a229a46aa720c87f6c885701f6436777099
======LOGS======
Aug 12 14:14:07.409031742 (92h48m1.840111873s) [upload=96698]: Starting upload
Aug 12 14:14:07.409087178 (92h48m1.840167309s) [upload=96698]: Done starting upload
Aug 12 14:14:07.409164175 (92h48m1.840244296s) [upload=96698]: Uploading segments...
Aug 12 14:14:07.409292210 (92h48m1.840372351s) [upload=96698]: Got next segment. Inline: false
Aug 12 14:14:07.409327578 (92h48m1.840407709s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:14:07.409332868 (92h48m1.840412999s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:14:07.934722080 (92h48m2.365802211s) [seg_pos={0 0}, upload=96698]: Begin upload segment...
Aug 12 14:14:07.934772547 (92h48m2.365852668s) [seg_pos={0 0}, upload=96698]: Done begin upload segment.
Aug 12 14:14:07.934794750 (92h48m2.365874881s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.934801853 (92h48m2.365881984s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935159818 (92h48m2.366239949s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935476614 (92h48m2.366556745s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935694982 (92h48m2.366775103s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935765266 (92h48m2.366845397s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936015946 (92h48m2.367096067s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936208083 (92h48m2.367288204s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936302374 (92h48m2.367382505s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936543476 (92h48m2.367623607s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936787502 (92h48m2.367867623s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937041078 (92h48m2.368121209s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937218717 (92h48m2.368298848s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937465870 (92h48m2.368546001s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937718333 (92h48m2.368798464s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937843002 (92h48m2.368923123s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938086508 (92h48m2.369166639s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938311428 (92h48m2.369391549s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:09.051491100 (92h48m3.482571221s) [upload=96698]: Next returned nil segment
Aug 12 14:14:09.051508273 (92h48m3.482588394s) [upload=96698]: Waiting for error group managing segments...
Aug 12 14:14:09.410281928 (92h48m3.841362059s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.428391659 (92h48m3.85947183s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.478827452 (92h48m3.909907583s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.906022923 (92h48m4.337103054s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.950710206 (92h48m4.381790337s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.994230577 (92h48m4.425310708s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.005388526 (92h48m4.436468667s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.013672706 (92h48m4.444752847s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.031568317 (92h48m4.462648448s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.055851340 (92h48m4.486931521s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.131567343 (92h48m4.562647474s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.142934372 (92h48m4.574014503s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.221770144 (92h48m4.652850275s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306199077 (92h48m4.737279198s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306225608 (92h48m4.737305729s) [seg_pos={0 0}, upload=96698]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:14:10.306307996 (92h48m4.737388127s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Vs7b4tkgb1GE6i5Kswt2kQ81Gyz7kf1bf8VyzrWxCXgbJdcey): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306349254 (92h48m4.737429375s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306406765 (92h48m4.737486896s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306460037 (92h48m4.737540168s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306517046 (92h48m4.737597177s) [seg_pos={0 0}, upload=96698]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:14:10.306604924 (92h48m4.737685055s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:14:10.306609282 (92h48m4.737689403s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:14:10.630316693 (92h48m5.061396824s) [upload=96698]: Done uploading segments...
Aug 12 14:14:10.630336561 (92h48m5.061416692s) [upload=96698]: Upload finished. err: <nil>
Duration: 6.303230369s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........X...................X.............................] duration:
2.077374902s
FAIL (2025-08-12 14:31:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.077396815s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X...................X............................] duration:
1.883795998s
FAIL (2025-08-12 14:31:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.883822547s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X...........X...................X...........................] duration:
1.896588833s
FAIL (2025-08-12 14:30:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.896611408s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X..................................X.....................] duration:
6.220600568s
FAIL (2025-08-12 14:30:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 40732489b962274f7c382ed12618172744042a3a2bfe013efec47c095b09c5df != before e6b7c6bde3d8af3ce6ddc4c3e8ad9a229a46aa720c87f6c885701f6436777099
======LOGS======
Aug 12 14:14:07.409031742 (92h48m1.840111873s) [upload=96698]: Starting upload
Aug 12 14:14:07.409087178 (92h48m1.840167309s) [upload=96698]: Done starting upload
Aug 12 14:14:07.409164175 (92h48m1.840244296s) [upload=96698]: Uploading segments...
Aug 12 14:14:07.409292210 (92h48m1.840372351s) [upload=96698]: Got next segment. Inline: false
Aug 12 14:14:07.409327578 (92h48m1.840407709s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:14:07.409332868 (92h48m1.840412999s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:14:07.934722080 (92h48m2.365802211s) [seg_pos={0 0}, upload=96698]: Begin upload segment...
Aug 12 14:14:07.934772547 (92h48m2.365852668s) [seg_pos={0 0}, upload=96698]: Done begin upload segment.
Aug 12 14:14:07.934794750 (92h48m2.365874881s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.934801853 (92h48m2.365881984s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935159818 (92h48m2.366239949s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935476614 (92h48m2.366556745s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935694982 (92h48m2.366775103s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935765266 (92h48m2.366845397s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936015946 (92h48m2.367096067s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936208083 (92h48m2.367288204s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936302374 (92h48m2.367382505s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936543476 (92h48m2.367623607s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936787502 (92h48m2.367867623s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937041078 (92h48m2.368121209s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937218717 (92h48m2.368298848s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937465870 (92h48m2.368546001s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937718333 (92h48m2.368798464s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937843002 (92h48m2.368923123s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938086508 (92h48m2.369166639s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938311428 (92h48m2.369391549s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:09.051491100 (92h48m3.482571221s) [upload=96698]: Next returned nil segment
Aug 12 14:14:09.051508273 (92h48m3.482588394s) [upload=96698]: Waiting for error group managing segments...
Aug 12 14:14:09.410281928 (92h48m3.841362059s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.428391659 (92h48m3.85947183s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.478827452 (92h48m3.909907583s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.906022923 (92h48m4.337103054s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.950710206 (92h48m4.381790337s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.994230577 (92h48m4.425310708s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.005388526 (92h48m4.436468667s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.013672706 (92h48m4.444752847s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.031568317 (92h48m4.462648448s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.055851340 (92h48m4.486931521s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.131567343 (92h48m4.562647474s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.142934372 (92h48m4.574014503s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.221770144 (92h48m4.652850275s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306199077 (92h48m4.737279198s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306225608 (92h48m4.737305729s) [seg_pos={0 0}, upload=96698]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:14:10.306307996 (92h48m4.737388127s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Vs7b4tkgb1GE6i5Kswt2kQ81Gyz7kf1bf8VyzrWxCXgbJdcey): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306349254 (92h48m4.737429375s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306406765 (92h48m4.737486896s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306460037 (92h48m4.737540168s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306517046 (92h48m4.737597177s) [seg_pos={0 0}, upload=96698]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:14:10.306604924 (92h48m4.737685055s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:14:10.306609282 (92h48m4.737689403s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:14:10.630316693 (92h48m5.061396824s) [upload=96698]: Done uploading segments...
Aug 12 14:14:10.630336561 (92h48m5.061416692s) [upload=96698]: Upload finished. err: <nil>
Duration: 6.220628172s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X..................................X....................] duration:
6.314068416s
FAIL (2025-08-12 14:29:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 40732489b962274f7c382ed12618172744042a3a2bfe013efec47c095b09c5df != before e6b7c6bde3d8af3ce6ddc4c3e8ad9a229a46aa720c87f6c885701f6436777099
======LOGS======
Aug 12 14:14:07.409031742 (92h48m1.840111873s) [upload=96698]: Starting upload
Aug 12 14:14:07.409087178 (92h48m1.840167309s) [upload=96698]: Done starting upload
Aug 12 14:14:07.409164175 (92h48m1.840244296s) [upload=96698]: Uploading segments...
Aug 12 14:14:07.409292210 (92h48m1.840372351s) [upload=96698]: Got next segment. Inline: false
Aug 12 14:14:07.409327578 (92h48m1.840407709s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:14:07.409332868 (92h48m1.840412999s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:14:07.934722080 (92h48m2.365802211s) [seg_pos={0 0}, upload=96698]: Begin upload segment...
Aug 12 14:14:07.934772547 (92h48m2.365852668s) [seg_pos={0 0}, upload=96698]: Done begin upload segment.
Aug 12 14:14:07.934794750 (92h48m2.365874881s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.934801853 (92h48m2.365881984s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935159818 (92h48m2.366239949s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935476614 (92h48m2.366556745s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935694982 (92h48m2.366775103s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935765266 (92h48m2.366845397s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936015946 (92h48m2.367096067s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936208083 (92h48m2.367288204s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936302374 (92h48m2.367382505s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936543476 (92h48m2.367623607s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936787502 (92h48m2.367867623s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937041078 (92h48m2.368121209s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937218717 (92h48m2.368298848s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937465870 (92h48m2.368546001s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937718333 (92h48m2.368798464s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937843002 (92h48m2.368923123s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938086508 (92h48m2.369166639s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938311428 (92h48m2.369391549s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:09.051491100 (92h48m3.482571221s) [upload=96698]: Next returned nil segment
Aug 12 14:14:09.051508273 (92h48m3.482588394s) [upload=96698]: Waiting for error group managing segments...
Aug 12 14:14:09.410281928 (92h48m3.841362059s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.428391659 (92h48m3.85947183s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.478827452 (92h48m3.909907583s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.906022923 (92h48m4.337103054s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.950710206 (92h48m4.381790337s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.994230577 (92h48m4.425310708s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.005388526 (92h48m4.436468667s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.013672706 (92h48m4.444752847s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.031568317 (92h48m4.462648448s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.055851340 (92h48m4.486931521s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.131567343 (92h48m4.562647474s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.142934372 (92h48m4.574014503s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.221770144 (92h48m4.652850275s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306199077 (92h48m4.737279198s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306225608 (92h48m4.737305729s) [seg_pos={0 0}, upload=96698]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:14:10.306307996 (92h48m4.737388127s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Vs7b4tkgb1GE6i5Kswt2kQ81Gyz7kf1bf8VyzrWxCXgbJdcey): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306349254 (92h48m4.737429375s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306406765 (92h48m4.737486896s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306460037 (92h48m4.737540168s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306517046 (92h48m4.737597177s) [seg_pos={0 0}, upload=96698]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:14:10.306604924 (92h48m4.737685055s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:14:10.306609282 (92h48m4.737689403s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:14:10.630316693 (92h48m5.061396824s) [upload=96698]: Done uploading segments...
Aug 12 14:14:10.630336561 (92h48m5.061416692s) [upload=96698]: Upload finished. err: <nil>
Duration: 6.314092131s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X...........X...................X..........................] duration:
2.042127502s
FAIL (2025-08-12 14:29:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.042153401s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X...........X...................X.........................] duration:
2.021164401s
FAIL (2025-08-12 14:29:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.021192356s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X...........X...................X........................] duration:
1.920908797s
FAIL (2025-08-12 14:29:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.921255509s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X..................................X...................] duration:
6.245644775s
FAIL (2025-08-12 14:28:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 40732489b962274f7c382ed12618172744042a3a2bfe013efec47c095b09c5df != before e6b7c6bde3d8af3ce6ddc4c3e8ad9a229a46aa720c87f6c885701f6436777099
======LOGS======
Aug 12 14:14:07.409031742 (92h48m1.840111873s) [upload=96698]: Starting upload
Aug 12 14:14:07.409087178 (92h48m1.840167309s) [upload=96698]: Done starting upload
Aug 12 14:14:07.409164175 (92h48m1.840244296s) [upload=96698]: Uploading segments...
Aug 12 14:14:07.409292210 (92h48m1.840372351s) [upload=96698]: Got next segment. Inline: false
Aug 12 14:14:07.409327578 (92h48m1.840407709s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:14:07.409332868 (92h48m1.840412999s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:14:07.934722080 (92h48m2.365802211s) [seg_pos={0 0}, upload=96698]: Begin upload segment...
Aug 12 14:14:07.934772547 (92h48m2.365852668s) [seg_pos={0 0}, upload=96698]: Done begin upload segment.
Aug 12 14:14:07.934794750 (92h48m2.365874881s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.934801853 (92h48m2.365881984s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935159818 (92h48m2.366239949s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935476614 (92h48m2.366556745s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935694982 (92h48m2.366775103s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935765266 (92h48m2.366845397s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936015946 (92h48m2.367096067s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936208083 (92h48m2.367288204s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936302374 (92h48m2.367382505s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936543476 (92h48m2.367623607s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936787502 (92h48m2.367867623s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937041078 (92h48m2.368121209s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937218717 (92h48m2.368298848s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937465870 (92h48m2.368546001s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937718333 (92h48m2.368798464s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937843002 (92h48m2.368923123s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938086508 (92h48m2.369166639s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938311428 (92h48m2.369391549s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:09.051491100 (92h48m3.482571221s) [upload=96698]: Next returned nil segment
Aug 12 14:14:09.051508273 (92h48m3.482588394s) [upload=96698]: Waiting for error group managing segments...
Aug 12 14:14:09.410281928 (92h48m3.841362059s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.428391659 (92h48m3.85947183s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.478827452 (92h48m3.909907583s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.906022923 (92h48m4.337103054s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.950710206 (92h48m4.381790337s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.994230577 (92h48m4.425310708s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.005388526 (92h48m4.436468667s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.013672706 (92h48m4.444752847s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.031568317 (92h48m4.462648448s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.055851340 (92h48m4.486931521s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.131567343 (92h48m4.562647474s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.142934372 (92h48m4.574014503s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.221770144 (92h48m4.652850275s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306199077 (92h48m4.737279198s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306225608 (92h48m4.737305729s) [seg_pos={0 0}, upload=96698]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:14:10.306307996 (92h48m4.737388127s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Vs7b4tkgb1GE6i5Kswt2kQ81Gyz7kf1bf8VyzrWxCXgbJdcey): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306349254 (92h48m4.737429375s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306406765 (92h48m4.737486896s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306460037 (92h48m4.737540168s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306517046 (92h48m4.737597177s) [seg_pos={0 0}, upload=96698]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:14:10.306604924 (92h48m4.737685055s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:14:10.306609282 (92h48m4.737689403s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:14:10.630316693 (92h48m5.061396824s) [upload=96698]: Done uploading segments...
Aug 12 14:14:10.630336561 (92h48m5.061416692s) [upload=96698]: Upload finished. err: <nil>
Duration: 6.245671597s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X...........X...................X.......................] duration:
1.885428041s
FAIL (2025-08-12 14:28:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.885453658s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X..................................X..................] duration:
7.015245781s
FAIL (2025-08-12 14:27:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 40732489b962274f7c382ed12618172744042a3a2bfe013efec47c095b09c5df != before e6b7c6bde3d8af3ce6ddc4c3e8ad9a229a46aa720c87f6c885701f6436777099
======LOGS======
Aug 12 14:14:07.409031742 (92h48m1.840111873s) [upload=96698]: Starting upload
Aug 12 14:14:07.409087178 (92h48m1.840167309s) [upload=96698]: Done starting upload
Aug 12 14:14:07.409164175 (92h48m1.840244296s) [upload=96698]: Uploading segments...
Aug 12 14:14:07.409292210 (92h48m1.840372351s) [upload=96698]: Got next segment. Inline: false
Aug 12 14:14:07.409327578 (92h48m1.840407709s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:14:07.409332868 (92h48m1.840412999s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:14:07.934722080 (92h48m2.365802211s) [seg_pos={0 0}, upload=96698]: Begin upload segment...
Aug 12 14:14:07.934772547 (92h48m2.365852668s) [seg_pos={0 0}, upload=96698]: Done begin upload segment.
Aug 12 14:14:07.934794750 (92h48m2.365874881s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.934801853 (92h48m2.365881984s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935159818 (92h48m2.366239949s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935476614 (92h48m2.366556745s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935694982 (92h48m2.366775103s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935765266 (92h48m2.366845397s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936015946 (92h48m2.367096067s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936208083 (92h48m2.367288204s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936302374 (92h48m2.367382505s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936543476 (92h48m2.367623607s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936787502 (92h48m2.367867623s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937041078 (92h48m2.368121209s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937218717 (92h48m2.368298848s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937465870 (92h48m2.368546001s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937718333 (92h48m2.368798464s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937843002 (92h48m2.368923123s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938086508 (92h48m2.369166639s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938311428 (92h48m2.369391549s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:09.051491100 (92h48m3.482571221s) [upload=96698]: Next returned nil segment
Aug 12 14:14:09.051508273 (92h48m3.482588394s) [upload=96698]: Waiting for error group managing segments...
Aug 12 14:14:09.410281928 (92h48m3.841362059s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.428391659 (92h48m3.85947183s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.478827452 (92h48m3.909907583s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.906022923 (92h48m4.337103054s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.950710206 (92h48m4.381790337s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.994230577 (92h48m4.425310708s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.005388526 (92h48m4.436468667s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.013672706 (92h48m4.444752847s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.031568317 (92h48m4.462648448s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.055851340 (92h48m4.486931521s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.131567343 (92h48m4.562647474s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.142934372 (92h48m4.574014503s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.221770144 (92h48m4.652850275s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306199077 (92h48m4.737279198s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306225608 (92h48m4.737305729s) [seg_pos={0 0}, upload=96698]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:14:10.306307996 (92h48m4.737388127s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Vs7b4tkgb1GE6i5Kswt2kQ81Gyz7kf1bf8VyzrWxCXgbJdcey): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306349254 (92h48m4.737429375s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306406765 (92h48m4.737486896s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306460037 (92h48m4.737540168s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306517046 (92h48m4.737597177s) [seg_pos={0 0}, upload=96698]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:14:10.306604924 (92h48m4.737685055s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:14:10.306609282 (92h48m4.737689403s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:14:10.630316693 (92h48m5.061396824s) [upload=96698]: Done uploading segments...
Aug 12 14:14:10.630336561 (92h48m5.061416692s) [upload=96698]: Upload finished. err: <nil>
Duration: 7.01527135s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X...........X...................X......................] duration:
1.837818693s
FAIL (2025-08-12 14:27:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.837846115s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X..................................X.................] duration:
6.33271336s
FAIL (2025-08-12 14:26:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 40732489b962274f7c382ed12618172744042a3a2bfe013efec47c095b09c5df != before e6b7c6bde3d8af3ce6ddc4c3e8ad9a229a46aa720c87f6c885701f6436777099
======LOGS======
Aug 12 14:14:07.409031742 (92h48m1.840111873s) [upload=96698]: Starting upload
Aug 12 14:14:07.409087178 (92h48m1.840167309s) [upload=96698]: Done starting upload
Aug 12 14:14:07.409164175 (92h48m1.840244296s) [upload=96698]: Uploading segments...
Aug 12 14:14:07.409292210 (92h48m1.840372351s) [upload=96698]: Got next segment. Inline: false
Aug 12 14:14:07.409327578 (92h48m1.840407709s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 14:14:07.409332868 (92h48m1.840412999s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 14:14:07.934722080 (92h48m2.365802211s) [seg_pos={0 0}, upload=96698]: Begin upload segment...
Aug 12 14:14:07.934772547 (92h48m2.365852668s) [seg_pos={0 0}, upload=96698]: Done begin upload segment.
Aug 12 14:14:07.934794750 (92h48m2.365874881s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.934801853 (92h48m2.365881984s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935159818 (92h48m2.366239949s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935476614 (92h48m2.366556745s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935694982 (92h48m2.366775103s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.935765266 (92h48m2.366845397s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936015946 (92h48m2.367096067s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936208083 (92h48m2.367288204s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936302374 (92h48m2.367382505s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936543476 (92h48m2.367623607s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.936787502 (92h48m2.367867623s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937041078 (92h48m2.368121209s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937218717 (92h48m2.368298848s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937465870 (92h48m2.368546001s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937718333 (92h48m2.368798464s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.937843002 (92h48m2.368923123s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938086508 (92h48m2.369166639s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:07.938311428 (92h48m2.369391549s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Uploading piece...
Aug 12 14:14:09.051491100 (92h48m3.482571221s) [upload=96698]: Next returned nil segment
Aug 12 14:14:09.051508273 (92h48m3.482588394s) [upload=96698]: Waiting for error group managing segments...
Aug 12 14:14:09.410281928 (92h48m3.841362059s) [noise=true , address=64.49.13.154:4935 , piece_id=T6OWWOBVRXYQVP2XEQ5EQYOATWNXSD3BNTHYRU37LX3N2X34PDPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.428391659 (92h48m3.85947183s) [noise=true , address=193.149.164.143:4693 , piece_id=EWOQ2X2DOBYXMERTCJGBYX7YIXT5UWKWIMXVXITGK4BG4722Z32Q, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.478827452 (92h48m3.909907583s) [noise=true , address=193.149.164.143:4701 , piece_id=N3VIROEUO7NJ2MDFNDS4J2LQZIPFOKVEZDOWZCMKMFLPETVBJ2XA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.906022923 (92h48m4.337103054s) [noise=true , address=77.90.31.13:4630 , piece_id=H52RQEZHYNTYVOEVNLCAROXSHVSIHKNCW7VCP6LPHZX7SLNXH2SA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.950710206 (92h48m4.381790337s) [noise=true , address=104.36.82.3:4792 , piece_id=5RQS4STD5BIMQIDDXR7L6VXK3WFDFSS7BS6PNPFJSAPAU6QF2Y3A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:09.994230577 (92h48m4.425310708s) [noise=true , address=104.36.82.62:4413 , piece_id=B5QYMGX5WXUGIHLOM6PBSPBSQFJQBK5QZ7SY2ZHF5OAW5WAVEUTQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.005388526 (92h48m4.436468667s) [noise=true , address=104.36.82.60:4369 , piece_id=BOQ4XS3HP4YXPCUIQSQ4PJ3O3KKOO7FS6DER64RID5TX6NLJXVBQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.013672706 (92h48m4.444752847s) [noise=true , address=104.36.82.39:4755 , piece_id=7NC2XNR6GNXMVKL7IYJIQ37CCPVNHCAEQ5JFAWE4KLOLZQ4CCPZA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.031568317 (92h48m4.462648448s) [noise=true , address=104.36.82.8:4990 , piece_id=HDQRQ52WD6AUVV5RZPRZLWKFE4NNDEDWJVUU5XBALSSSMOUHKC5A, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.055851340 (92h48m4.486931521s) [noise=true , address=104.36.82.47:4528 , piece_id=JZY6FEBVIOQX7WIZDFBKZJ74OMDAG7V3SENVRY7N3X5EBI4PROHA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.131567343 (92h48m4.562647474s) [noise=true , address=104.36.82.59:4319 , piece_id=ZFNHR247DHC3BZBZG3NJF76EMF4JZKABZSVKAWJLF5UEEYQAIDLA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.142934372 (92h48m4.574014503s) [noise=true , address=104.36.82.34:4560 , piece_id=XRKGJNDNZKQQGK3BDQW2UT333EMOH335ANNZQTBZGO6IFOFWQSBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.221770144 (92h48m4.652850275s) [noise=true , address=104.36.82.23:4472 , piece_id=TNRPXO4IDY7245XHVX4Y4AH6QFZVDZ5CGD5AWA5UGNFUSO52ILCQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306199077 (92h48m4.737279198s) [noise=true , address=104.36.82.44:4882 , piece_id=JMLG2D6UQUTIN3UFVL3SEGSUKHG6YAZ4T3TUNXNPM54VTOMJLJWQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: <nil>
Aug 12 14:14:10.306225608 (92h48m4.737305729s) [seg_pos={0 0}, upload=96698]: Segment reached optimal threshold of 14 pieces.
Aug 12 14:14:10.306307996 (92h48m4.737388127s) [noise=true , address=104.36.82.36:4639 , piece_id=4RQMX2U3QVBVO4Y73LEAUMBW2S5T5Z3SXRPRTA4JX2PR4U2GOAPQ, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Vs7b4tkgb1GE6i5Kswt2kQ81Gyz7kf1bf8VyzrWxCXgbJdcey): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306349254 (92h48m4.737429375s) [noise=true , address=104.36.82.35:4604 , piece_id=5H4ZBDCITGXBSFXDVK7L6XFC4EMOX7P2Y2CHWBWISMS2P3NCN3CA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12EhoYFXjEa1ciTS2UXFRFUWhfSyd7p3oPDgqrdNVTYyBUk4mJ1): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306406765 (92h48m4.737486896s) [noise=true , address=66.23.193.175:4564 , piece_id=IGYOXJPAABSARQOH4MQXP4NYM6UAV27ZW5VZCV4ISHJZ4OQWZRBA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306460037 (92h48m4.737540168s) [noise=true , address=79.127.201.215:4344 , piece_id=MAGVTPOM5245E565OAMB4PWQDE7S5OFFOEGYA5BF6QPGZN74H4JA, seg_pos={0 0}, upload=96698]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 12 14:14:10.306517046 (92h48m4.737597177s) [seg_pos={0 0}, upload=96698]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 14:14:10.306604924 (92h48m4.737685055s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 14:14:10.306609282 (92h48m4.737689403s) [upload=96698]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 14:14:10.630316693 (92h48m5.061396824s) [upload=96698]: Done uploading segments...
Aug 12 14:14:10.630336561 (92h48m5.061416692s) [upload=96698]: Upload finished. err: <nil>
Duration: 6.332741072s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X...........X...................X.....................] duration:
2.059947556s
FAIL (2025-08-12 14:26:43 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 14:09:57.380069492 (92h43m51.811149613s) [upload=96624]: Starting upload Aug 12 14:09:57.380114378 (92h43m51.811194509s) [upload=96624]: Done starting upload Aug 12 14:09:57.380197858 (92h43m51.811277989s) [upload=96624]: Uploading segments... Aug 12 14:09:57.380248003 (92h43m51.811328134s) [upload=96624]: Got next segment. Inline: true Aug 12 14:09:57.380252692 (92h43m51.811332814s) [upload=96624]: Waiting for error group managing segments... Aug 12 14:09:57.380284213 (92h43m51.811364334s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 14:09:57.380288290 (92h43m51.811368421s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 14:09:57.380291025 (92h43m51.811371146s) [upload=96624]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 14:09:57.594013514 (92h43m52.025093645s) [upload=96624]: Done uploading segments... Aug 12 14:09:57.594034174 (92h43m52.025114315s) [upload=96624]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.059991831s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|