Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X..........X..........X.....................] duration:
1.902692071s
FAIL (2025-08-18 00:27:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.902720505s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.597515384s
FAIL (2025-08-18 00:26:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.59753974s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X..........X..........X....................] duration:
1.911830989s
FAIL (2025-08-18 00:26:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.911852688s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
6.159625177s
FAIL (2025-08-18 00:25:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.159645276s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X..........X..........X...................] duration:
1.949325095s
FAIL (2025-08-18 00:25:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.949345594s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
6.001558783s
FAIL (2025-08-18 00:25:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.001590304s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X..........X..........X..................] duration:
2.072544186s
FAIL (2025-08-18 00:24:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.072580795s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X..........X..........X.................] duration:
2.028321941s
FAIL (2025-08-18 00:24:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.028336088s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
6.38144253s
FAIL (2025-08-18 00:24:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.38146837s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X..........X..........X................] duration:
1.931347792s
FAIL (2025-08-18 00:24:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.931371837s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
6.38525811s
FAIL (2025-08-18 00:23:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.385275294s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......................X..........X..........X...............] duration:
2.100140206s
FAIL (2025-08-18 00:23:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.100171727s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
7.877070697s
FAIL (2025-08-18 00:23:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 7.877102346s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X..................X........................................] duration:
6.605912211s
FAIL (2025-08-18 00:22:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.60593787s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X..........X..........X..............] duration:
2.045559266s
FAIL (2025-08-18 00:22:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.04558754s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X..................X.......................................] duration:
6.679099329s
FAIL (2025-08-18 00:21:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.679130109s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X..........X..........X.............] duration:
2.151247981s
FAIL (2025-08-18 00:21:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.151274231s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X..........X..........X............] duration:
2.282165846s
FAIL (2025-08-18 00:20:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.282194902s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X..................X......................................] duration:
6.02075759s
FAIL (2025-08-18 00:20:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.020788599s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................X..........X..........X...........] duration:
1.923996136s
FAIL (2025-08-18 00:20:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.924026483s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........................X..........X..........X..........] duration:
2.245502425s
FAIL (2025-08-18 00:19:36 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.245525609s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X..................X.....................................] duration:
6.276957916s
FAIL (2025-08-18 00:19:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.276985991s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X..................X....................................] duration:
6.326597668s
FAIL (2025-08-18 00:19:12 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.326633426s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............................X..........X..........X.........] duration:
1.994959948s
FAIL (2025-08-18 00:19:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.994977342s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X..................X...................................] duration:
6.19974647s
FAIL (2025-08-18 00:18:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.199777348s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............................X..........X..........X........] duration:
1.900528817s
FAIL (2025-08-18 00:17:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.90055586s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............................X..........X..........X.......] duration:
1.929953525s
FAIL (2025-08-18 00:17:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.929986199s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X..................X..................................] duration:
6.188330638s
FAIL (2025-08-18 00:17:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.188369251s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............................X..........X..........X......] duration:
1.930373681s
FAIL (2025-08-18 00:17:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.930397565s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X..................X.................................] duration:
6.135438354s
FAIL (2025-08-18 00:16:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.135458794s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X...............................X..........X..........X.....] duration:
2.023300695s
FAIL (2025-08-18 00:16:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.023323348s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X..................X................................] duration:
6.390176151s
FAIL (2025-08-18 00:16:03 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.390209757s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [XX...............................X..........X..........X....] duration:
1.919531165s
FAIL (2025-08-18 00:15:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.919682304s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X..................X...............................] duration:
5.924560932s
FAIL (2025-08-18 00:15:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 5.924592682s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X..................X..............................] duration:
6.870552294s
FAIL (2025-08-18 00:14:35 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.870575598s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [.XX...............................X..........X..........X...] duration:
1.889403448s
FAIL (2025-08-18 00:14:12 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.889436521s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X..................X.............................] duration:
6.487984449s
FAIL (2025-08-18 00:14:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.488003615s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X..................X............................] duration:
6.321699935s
FAIL (2025-08-18 00:13:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.32172298s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [..XX...............................X..........X..........X..] duration:
2.275127478s
FAIL (2025-08-18 00:13:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.27515876s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X..................X...........................] duration:
8.153155402s
FAIL (2025-08-18 00:12:28 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 8.153179758s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...XX...............................X..........X..........X.] duration:
1.905072739s
FAIL (2025-08-18 00:12:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.905112123s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [....XX...............................X..........X..........X] duration:
903.945102ms
FAIL (2025-08-18 00:11:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 18 00:11:21.958947624 (222h45m16.390027755s) [upload=231665]: Starting upload Aug 18 00:11:21.959015404 (222h45m16.390095535s) [upload=231665]: Done starting upload Aug 18 00:11:21.959117539 (222h45m16.39019767s) [upload=231665]: Uploading segments... Aug 18 00:11:21.959168146 (222h45m16.390248277s) [upload=231665]: Got next segment. Inline: true Aug 18 00:11:21.959172524 (222h45m16.390252655s) [upload=231665]: Waiting for error group managing segments... Aug 18 00:11:21.959208153 (222h45m16.390288284s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:11:21.959212401 (222h45m16.390292532s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:11:21.959215717 (222h45m16.390295838s) [upload=231665]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:11:22.183384921 (222h45m16.614465052s) [upload=231665]: Done uploading segments... Aug 18 00:11:22.183401683 (222h45m16.614481814s) [upload=231665]: Upload finished. err: metaclient: Too Many Requests
Duration: 903.962875ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.............X..................X..........................] duration:
6.192299169s
FAIL (2025-08-18 00:11:20 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.192326022s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....XX...............................X..........X..........] duration:
2.0462475s
FAIL (2025-08-18 00:10:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3c300e72346e33c5fecbaf34d26ee603986d7ab84b073248fa1a2329cf58129a != before 6be0bfd103e6e17c1958b913ad2c3585f40d740a200905ad5e15c213ab9bdfd0 ======LOGS====== Aug 18 00:02:50.564839588 (222h36m44.995919719s) [upload=231523]: Starting upload Aug 18 00:02:50.564872040 (222h36m44.995952171s) [upload=231523]: Done starting upload Aug 18 00:02:50.564937366 (222h36m44.996017497s) [upload=231523]: Uploading segments... Aug 18 00:02:50.564972172 (222h36m44.996052303s) [upload=231523]: Got next segment. Inline: true Aug 18 00:02:50.564975879 (222h36m44.99605601s) [upload=231523]: Waiting for error group managing segments... Aug 18 00:02:50.565005255 (222h36m44.996085386s) [upload=231523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:02:50.565009083 (222h36m44.996089214s) [upload=231523]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:02:50.565011727 (222h36m44.996091859s) [upload=231523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:02:50.850333409 (222h36m45.28141354s) [upload=231523]: Done uploading segments... Aug 18 00:02:50.850351233 (222h36m45.281431364s) [upload=231523]: Upload finished. err: <nil>
Duration: 2.046274862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......XX...............................X..........X.........] duration:
1.977000375s
FAIL (2025-08-18 00:10:28 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3c300e72346e33c5fecbaf34d26ee603986d7ab84b073248fa1a2329cf58129a != before 6be0bfd103e6e17c1958b913ad2c3585f40d740a200905ad5e15c213ab9bdfd0 ======LOGS====== Aug 18 00:02:50.564839588 (222h36m44.995919719s) [upload=231523]: Starting upload Aug 18 00:02:50.564872040 (222h36m44.995952171s) [upload=231523]: Done starting upload Aug 18 00:02:50.564937366 (222h36m44.996017497s) [upload=231523]: Uploading segments... Aug 18 00:02:50.564972172 (222h36m44.996052303s) [upload=231523]: Got next segment. Inline: true Aug 18 00:02:50.564975879 (222h36m44.99605601s) [upload=231523]: Waiting for error group managing segments... Aug 18 00:02:50.565005255 (222h36m44.996085386s) [upload=231523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:02:50.565009083 (222h36m44.996089214s) [upload=231523]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:02:50.565011727 (222h36m44.996091859s) [upload=231523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:02:50.850333409 (222h36m45.28141354s) [upload=231523]: Done uploading segments... Aug 18 00:02:50.850351233 (222h36m45.281431364s) [upload=231523]: Upload finished. err: <nil>
Duration: 1.97702411s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.............X..................X.........................] duration:
6.343771083s
FAIL (2025-08-18 00:10:15 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.343804899s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......XX...............................X..........X........] duration:
1.924929743s
FAIL (2025-08-18 00:09:53 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3c300e72346e33c5fecbaf34d26ee603986d7ab84b073248fa1a2329cf58129a != before 6be0bfd103e6e17c1958b913ad2c3585f40d740a200905ad5e15c213ab9bdfd0 ======LOGS====== Aug 18 00:02:50.564839588 (222h36m44.995919719s) [upload=231523]: Starting upload Aug 18 00:02:50.564872040 (222h36m44.995952171s) [upload=231523]: Done starting upload Aug 18 00:02:50.564937366 (222h36m44.996017497s) [upload=231523]: Uploading segments... Aug 18 00:02:50.564972172 (222h36m44.996052303s) [upload=231523]: Got next segment. Inline: true Aug 18 00:02:50.564975879 (222h36m44.99605601s) [upload=231523]: Waiting for error group managing segments... Aug 18 00:02:50.565005255 (222h36m44.996085386s) [upload=231523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:02:50.565009083 (222h36m44.996089214s) [upload=231523]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:02:50.565011727 (222h36m44.996091859s) [upload=231523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:02:50.850333409 (222h36m45.28141354s) [upload=231523]: Done uploading segments... Aug 18 00:02:50.850351233 (222h36m45.281431364s) [upload=231523]: Upload finished. err: <nil>
Duration: 1.924975351s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.............X..................X........................] duration:
6.028477316s
FAIL (2025-08-18 00:09:42 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.028500189s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.............X..................X.......................] duration:
6.385804419s
FAIL (2025-08-18 00:09:24 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 17 23:52:16.675058573 (222h26m11.106138704s) [upload=231342]: Starting upload
Aug 17 23:52:16.675104159 (222h26m11.10618428s) [upload=231342]: Done starting upload
Aug 17 23:52:16.675188711 (222h26m11.106268842s) [upload=231342]: Uploading segments...
Aug 17 23:52:16.675309793 (222h26m11.106389924s) [upload=231342]: Got next segment. Inline: false
Aug 17 23:52:16.675339801 (222h26m11.106419932s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 23:52:16.675344489 (222h26m11.10642462s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 23:52:17.133866830 (222h26m11.564946961s) [seg_pos={0 0}, upload=231342]: Begin upload segment...
Aug 17 23:52:17.133915944 (222h26m11.564996076s) [seg_pos={0 0}, upload=231342]: Done begin upload segment.
Aug 17 23:52:17.133941322 (222h26m11.565021473s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134086170 (222h26m11.565166341s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134362058 (222h26m11.565442189s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134633287 (222h26m11.565713408s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.134824944 (222h26m11.565905075s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135018354 (222h26m11.566098485s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135177017 (222h26m11.566257148s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135293971 (222h26m11.566374102s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135491358 (222h26m11.566571489s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135509283 (222h26m11.566589414s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135714565 (222h26m11.566794696s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135785131 (222h26m11.566865262s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.135942421 (222h26m11.567022552s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136147875 (222h26m11.567228006s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136383336 (222h26m11.567463477s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136427620 (222h26m11.567507751s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136716403 (222h26m11.567796524s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:17.136985087 (222h26m11.568065218s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Uploading piece...
Aug 17 23:52:18.325046187 (222h26m12.756126308s) [upload=231342]: Next returned nil segment
Aug 17 23:52:18.325071374 (222h26m12.756151495s) [upload=231342]: Waiting for error group managing segments...
Aug 17 23:52:18.628507796 (222h26m13.059587928s) [noise=true , address=66.23.193.175:4556 , piece_id=WMVLQSIG6ESKQUEDMSUMV4P5HB5QFZWQR7XXAOX2EONQ7GNCB7JA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.158842073 (222h26m13.589922225s) [noise=true , address=45.91.116.9:4270 , piece_id=TQNQVC2B7ED62V4YVMSOPZSURKG2NTCKKGEYUPUP7CXRPJARM35Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.164068653 (222h26m13.595148774s) [noise=true , address=104.36.82.5:4844 , piece_id=DUIDPSAU4ATVEUGAOLL2A7SC4H76SBP2XO47ONQYRFKK4NJC5W5A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.176934130 (222h26m13.608014261s) [noise=true , address=104.36.82.15:4274 , piece_id=X2PEH5X3PFUDO2QVOT4T67Y4VMCVZ3ZKJFROW4QJKHJYDKO253DQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187715950 (222h26m13.618796081s) [noise=true , address=77.90.31.11:4564 , piece_id=O3VTDX6OFMMK32XWBHBSHYOWJBDT4CGPZEXMLITCXEY6UFTYFJPA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.187764623 (222h26m13.618844754s) [noise=true , address=77.90.31.12:4621 , piece_id=OE3OZA36ONH4JRTMT7HF34IEPXCXJQ6HYMVDRONDA266YQJNIT6Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.224056473 (222h26m13.655136604s) [noise=true , address=77.90.31.21:4908 , piece_id=3XS6UBACISWSM45ROGJQ4YZ33QFNZ67LIEOFWJ7ZEJIVGD6HWTLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.242270694 (222h26m13.673350825s) [noise=true , address=77.90.31.19:4863 , piece_id=K5QQ6OKYAPGTIZL47UH4CVSGMKA35GHIHCSMWFMWCNMUAMU4E27A, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.343535924 (222h26m13.774616045s) [noise=true , address=77.90.31.15:4728 , piece_id=P77XJHU7334DQW2FWHQJBWMKD7ZWM4SKJ6SD54YHUGB6V3U3BCWQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.360473062 (222h26m13.791553193s) [noise=true , address=45.91.116.14:4214 , piece_id=TVQHCOVB6QOSQ6LLKUZJSIQ3HKRITNE27AMR7JHAAKDXHFLWMADQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.402233265 (222h26m13.833313396s) [noise=true , address=45.91.116.12:4237 , piece_id=F33SAJK62MBDTBOCNCGXGUQEAJHILSS7Q35XTGRHTHFAV2WNIO5Q, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.418117367 (222h26m13.849197498s) [noise=true , address=104.36.82.6:4900 , piece_id=SZUSQXH5ZV5OQOM3GEOPVZ2Z2MZOTQ2FTJHNEWWEHZPYRAV6KTJQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.459656437 (222h26m13.890736568s) [noise=true , address=104.36.82.2:4740 , piece_id=EUN44REFBKOS3MZEBHR2KQ43WOTE6ZMOFHXHUO6ZGKP4BXME3MLQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473836820 (222h26m13.904916941s) [noise=true , address=104.36.82.19:4409 , piece_id=IA7KMNNRN3FM5IVAHJ2HMGWBIKTGGM5OTVAUANPFQCSH64VXPCRA, seg_pos={0 0}, upload=231342]: Done uploading piece. err: <nil>
Aug 17 23:52:19.473861115 (222h26m13.904941247s) [seg_pos={0 0}, upload=231342]: Segment reached optimal threshold of 14 pieces.
Aug 17 23:52:19.473980765 (222h26m13.905060896s) [noise=true , address=104.36.82.60:4353 , piece_id=HN255VFEEXPC4KOWBGFLYLBHD5IQKYZRCCOU5ALFSCMZXYRF3NDQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474161460 (222h26m13.905241591s) [noise=true , address=104.36.82.38:4701 , piece_id=H3CBPUDW5L7WBHKEAGXUFXEE2BDK6EFR7RGX7GLJZVEGTBDCIHUQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1weCZWAtZRRYdeuPE8TjnZB5fZVD4gz4qW6TxyyNz33wVfW9hQ): protocol: expected piece hash; context canceled; EOF
Aug 17 23:52:19.474215253 (222h26m13.905295384s) [noise=true , address=104.36.82.35:4587 , piece_id=R3QK3673V5ZUJD4EQYJESPIMUC7KVLTLZABJB5YFI6V7UXC2IXNQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1T4C5mqpUTmi8sZq38KuFakx6Xh6FTVBn5jCFqFHr5GAyBBDaY): protocol: rpc: dial tcp 104.36.82.35:4587: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 17 23:52:19.474255330 (222h26m13.905335461s) [noise=true , address=104.36.82.39:4747 , piece_id=TH4HXJ26SM4E56IATN53S2Q4DGX2UQSEHVPOKE6K7FV6NGSUHUKQ, seg_pos={0 0}, upload=231342]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bmbaxrj3X67qtdL5boUEPGBsujt1ggcGcGsJvvGTAMWoQe8Qg): protocol: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45242->104.36.82.39:4747: use of closed network connection
Aug 17 23:52:19.474271230 (222h26m13.905351351s) [seg_pos={0 0}, upload=231342]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 23:52:19.474332769 (222h26m13.90541289s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 23:52:19.474337157 (222h26m13.905417288s) [upload=231342]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 23:52:19.777513261 (222h26m14.208593392s) [upload=231342]: Done uploading segments...
Aug 17 23:52:19.777533039 (222h26m14.20861317s) [upload=231342]: Upload finished. err: <nil>
Duration: 6.385831833s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........XX...............................X..........X.......] duration:
2.037682114s
FAIL (2025-08-18 00:08:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 3c300e72346e33c5fecbaf34d26ee603986d7ab84b073248fa1a2329cf58129a != before 6be0bfd103e6e17c1958b913ad2c3585f40d740a200905ad5e15c213ab9bdfd0 ======LOGS====== Aug 18 00:02:50.564839588 (222h36m44.995919719s) [upload=231523]: Starting upload Aug 18 00:02:50.564872040 (222h36m44.995952171s) [upload=231523]: Done starting upload Aug 18 00:02:50.564937366 (222h36m44.996017497s) [upload=231523]: Uploading segments... Aug 18 00:02:50.564972172 (222h36m44.996052303s) [upload=231523]: Got next segment. Inline: true Aug 18 00:02:50.564975879 (222h36m44.99605601s) [upload=231523]: Waiting for error group managing segments... Aug 18 00:02:50.565005255 (222h36m44.996085386s) [upload=231523]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 18 00:02:50.565009083 (222h36m44.996089214s) [upload=231523]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 18 00:02:50.565011727 (222h36m44.996091859s) [upload=231523]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 18 00:02:50.850333409 (222h36m45.28141354s) [upload=231523]: Done uploading segments... Aug 18 00:02:50.850351233 (222h36m45.281431364s) [upload=231523]: Upload finished. err: <nil>
Duration: 2.037704546s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|