Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 11 out of 60 is failed (threshold=3) [............................X.....X..X.X...XXX....X.X....X.X] duration: 30.004049979s FAIL (2025-08-28 04:08:18 UTC) orbiter warning: operation: sync2.Copy uplink: context deadline exceeded Duration: 30.004074808s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [............................X....X.X.....X...X.........X....] duration: 1.342957706s FAIL (2025-08-28 04:07:47 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.342979257s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [.............................X....X.X.....X...X.........X...] duration: 27.75679762s FAIL (2025-08-28 04:07:45 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 27.756826465s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X.......................X...] duration: 5.816016337s FAIL (2025-08-28 04:07:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:05:53.289363958 (10h27m32.451964926s) [upload=10949]: Starting upload Aug 28 04:05:53.289458931 (10h27m32.452059869s) [upload=10949]: Done starting upload Aug 28 04:05:53.289544624 (10h27m32.452145562s) [upload=10949]: Uploading segments... Aug 28 04:05:53.289936975 (10h27m32.452537963s) [upload=10949]: Got next segment. Inline: false Aug 28 04:05:53.289966621 (10h27m32.452567549s) [upload=10949]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:05:53.289970921 (10h27m32.452571859s) [upload=10949]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:05:53.759704708 (10h27m32.922305646s) [seg_pos={0 0}, upload=10949]: Begin upload segment... Aug 28 04:05:53.759750246 (10h27m32.922351184s) [seg_pos={0 0}, upload=10949]: Done begin upload segment. Aug 28 04:05:53.759780604 (10h27m32.922381542s) [noise=true , address=45.91.116.8:4060 , piece_id=RBI2EDNLOOYVN5RSAERIYEIXH63FOWD6IZQTAKXZ5HZO7NBRVQLA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.759788739 (10h27m32.922389687s) [noise=true , address=45.91.116.6:4999 , piece_id=T2THXW3464HZPRMPAD5NWPP3PHXFGHPXMMAHKRHLDCNKHGS5UNTQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760165330 (10h27m32.922766268s) [noise=true , address=79.127.201.215:4343 , piece_id=5QBWFDM2FXVYXYQGWDUPR54SAW3IRORHCR5SVX5EHNWKXZ35PIIA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760461617 (10h27m32.923062555s) [noise=true , address=77.90.31.15:4701 , piece_id=S6TPY54DURMAZXKUWPS6N2THZ3HA5H64SDZT2QU53DMW3RUNIZFA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760596666 (10h27m32.923197614s) [noise=true , address=79.127.205.245:4238 , piece_id=2H2SHXAU2P4JBMINIQJIDPWU5AIXBYD276WFEV3LHY7UZ5QXRTEQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760761020 (10h27m32.923361958s) [noise=true , address=79.127.205.246:4281 , piece_id=HQMU5MFQ7P3AG2TO2KHRXI2RBX7QDETMUMX4PJE4KD6MD7ED2LVA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761018753 (10h27m32.923619691s) [noise=true , address=45.91.116.7:4039 , piece_id=22UVQ7BU3KHTQ5Y4IILVOYRBMIGFJOQZHGNVZ2WNUXGCT4CRJGBA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761291374 (10h27m32.923892312s) [noise=true , address=104.36.82.44:4885 , piece_id=Q2D3EJEOXCIUKUHO24XNXKN4GHZARE3TOOAXJ4OIGVRSLTHB4BOQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761498942 (10h27m32.92409988s) [noise=true , address=79.127.201.214:4290 , piece_id=CRODRI3BNAA4Q4NIMAJJUDI45ARELZ6WBC67WBCTMT55AE2SBNVA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761698784 (10h27m32.924299722s) [noise=true , address=104.36.82.50:4016 , piece_id=NXQDHZQ3RBKRQPPUYDI4AU2JXN3FCX6OIU3VNX6UNR5N35HKNQFA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761945757 (10h27m32.924546695s) [noise=true , address=79.127.220.97:4361 , piece_id=BPGKJDESXP53ROBUDLR3JIGQMLABKUWF5RJALDHKMTIIB2P7O7ZA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762179363 (10h27m32.924780292s) [noise=true , address=77.90.31.13:4647 , piece_id=OMTE4HGX4L33DXF7GLWXO7NYR7JQBJL2NLC5VU5P2VWG3ME7RA3Q, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762210724 (10h27m32.924811652s) [noise=true , address=77.90.31.10:4524 , piece_id=PVC3U44KHKHOVCRPFT6GH26UDZN4B77MSPUAB7TXJ4ZGENUTV2NQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762367984 (10h27m32.924968922s) [noise=true , address=79.127.219.51:4196 , piece_id=6NNUKMIZH5AYYX3FJ3AOJAW6EXDIOKCIYDZPDP76OYQKOB5PMJBQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762556545 (10h27m32.925157483s) [noise=true , address=79.127.219.47:4058 , piece_id=5JWBT2H42W6UIW4CJPAC445X4LDNEUQEUKV7NNSOU43JLMQ5JXZQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762667858 (10h27m32.925268796s) [noise=true , address=64.49.13.137:4494 , piece_id=6CAPGAYDDB7ZPXGBAQINVOH5VHT74MZQYULANGDWI5F2ZX7AY36Q, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762774853 (10h27m32.925375791s) [noise=true , address=45.91.116.9:4274 , piece_id=DCCGZGN2PX3OQO4VX3TT7EYXKTQY6MITMCC7M7FXE7HYI2L67OWA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.763080417 (10h27m32.925681355s) [noise=true , address=45.91.116.5:4304 , piece_id=YEZ66ZS52YVRBB4XP33UC7VDZELK7YFJC6MHYIUG5G4Z4AD7YN2A, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:54.882306217 (10h27m34.044907155s) [upload=10949]: Next returned nil segment Aug 28 04:05:54.882324662 (10h27m34.0449256s) [upload=10949]: Waiting for error group managing segments... Aug 28 04:05:55.176815078 (10h27m34.339416056s) [noise=true , address=79.127.205.246:4281 , piece_id=HQMU5MFQ7P3AG2TO2KHRXI2RBX7QDETMUMX4PJE4KD6MD7ED2LVA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.178010275 (10h27m34.340611223s) [noise=true , address=79.127.205.245:4238 , piece_id=2H2SHXAU2P4JBMINIQJIDPWU5AIXBYD276WFEV3LHY7UZ5QXRTEQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.190745574 (10h27m34.353346512s) [noise=true , address=64.49.13.137:4494 , piece_id=6CAPGAYDDB7ZPXGBAQINVOH5VHT74MZQYULANGDWI5F2ZX7AY36Q, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.603281813 (10h27m34.765882751s) [noise=true , address=79.127.220.97:4361 , piece_id=BPGKJDESXP53ROBUDLR3JIGQMLABKUWF5RJALDHKMTIIB2P7O7ZA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.657161975 (10h27m34.819762913s) [noise=true , address=45.91.116.8:4060 , piece_id=RBI2EDNLOOYVN5RSAERIYEIXH63FOWD6IZQTAKXZ5HZO7NBRVQLA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.671217149 (10h27m34.833818087s) [noise=true , address=45.91.116.9:4274 , piece_id=DCCGZGN2PX3OQO4VX3TT7EYXKTQY6MITMCC7M7FXE7HYI2L67OWA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.702955241 (10h27m34.865556169s) [noise=true , address=79.127.219.51:4196 , piece_id=6NNUKMIZH5AYYX3FJ3AOJAW6EXDIOKCIYDZPDP76OYQKOB5PMJBQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.707816403 (10h27m34.870417341s) [noise=true , address=45.91.116.6:4999 , piece_id=T2THXW3464HZPRMPAD5NWPP3PHXFGHPXMMAHKRHLDCNKHGS5UNTQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.728970733 (10h27m34.891571681s) [noise=true , address=77.90.31.13:4647 , piece_id=OMTE4HGX4L33DXF7GLWXO7NYR7JQBJL2NLC5VU5P2VWG3ME7RA3Q, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.742514249 (10h27m34.905115187s) [noise=true , address=79.127.219.47:4058 , piece_id=5JWBT2H42W6UIW4CJPAC445X4LDNEUQEUKV7NNSOU43JLMQ5JXZQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.755299383 (10h27m34.917900321s) [noise=true , address=104.36.82.50:4016 , piece_id=NXQDHZQ3RBKRQPPUYDI4AU2JXN3FCX6OIU3VNX6UNR5N35HKNQFA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.794179992 (10h27m34.95678093s) [noise=true , address=79.127.201.215:4343 , piece_id=5QBWFDM2FXVYXYQGWDUPR54SAW3IRORHCR5SVX5EHNWKXZ35PIIA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.834967951 (10h27m34.997568889s) [noise=true , address=45.91.116.7:4039 , piece_id=22UVQ7BU3KHTQ5Y4IILVOYRBMIGFJOQZHGNVZ2WNUXGCT4CRJGBA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.846294364 (10h27m35.008895302s) [noise=true , address=79.127.201.214:4290 , piece_id=CRODRI3BNAA4Q4NIMAJJUDI45ARELZ6WBC67WBCTMT55AE2SBNVA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.846322088 (10h27m35.008923026s) [seg_pos={0 0}, upload=10949]: Segment reached optimal threshold of 14 pieces. Aug 28 04:05:55.846431748 (10h27m35.009032686s) [noise=true , address=77.90.31.10:4524 , piece_id=PVC3U44KHKHOVCRPFT6GH26UDZN4B77MSPUAB7TXJ4ZGENUTV2NQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846493265 (10h27m35.009094203s) [noise=true , address=45.91.116.5:4304 , piece_id=YEZ66ZS52YVRBB4XP33UC7VDZELK7YFJC6MHYIUG5G4Z4AD7YN2A, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dFsmPBv2oP7W7uKnJFpKMcJDSQ3BEGLaPZ23eX3Cqze8UgDSs): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846545676 (10h27m35.009146604s) [noise=true , address=77.90.31.15:4701 , piece_id=S6TPY54DURMAZXKUWPS6N2THZ3HA5H64SDZT2QU53DMW3RUNIZFA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846576364 (10h27m35.009177302s) [noise=true , address=104.36.82.44:4885 , piece_id=Q2D3EJEOXCIUKUHO24XNXKN4GHZARE3TOOAXJ4OIGVRSLTHB4BOQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846601863 (10h27m35.009202801s) [seg_pos={0 0}, upload=10949]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:05:55.846697305 (10h27m35.009298253s) [upload=10949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:05:55.846703988 (10h27m35.009304956s) [upload=10949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:05:56.185002402 (10h27m35.34760334s) [upload=10949]: Done uploading segments... Aug 28 04:05:56.185020596 (10h27m35.347621534s) [upload=10949]: Upload finished. err: <nil> Duration: 5.816047837s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X.......................X..] duration: 5.901326469s FAIL (2025-08-28 04:07:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:05:53.289363958 (10h27m32.451964926s) [upload=10949]: Starting upload Aug 28 04:05:53.289458931 (10h27m32.452059869s) [upload=10949]: Done starting upload Aug 28 04:05:53.289544624 (10h27m32.452145562s) [upload=10949]: Uploading segments... Aug 28 04:05:53.289936975 (10h27m32.452537963s) [upload=10949]: Got next segment. Inline: false Aug 28 04:05:53.289966621 (10h27m32.452567549s) [upload=10949]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:05:53.289970921 (10h27m32.452571859s) [upload=10949]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:05:53.759704708 (10h27m32.922305646s) [seg_pos={0 0}, upload=10949]: Begin upload segment... Aug 28 04:05:53.759750246 (10h27m32.922351184s) [seg_pos={0 0}, upload=10949]: Done begin upload segment. Aug 28 04:05:53.759780604 (10h27m32.922381542s) [noise=true , address=45.91.116.8:4060 , piece_id=RBI2EDNLOOYVN5RSAERIYEIXH63FOWD6IZQTAKXZ5HZO7NBRVQLA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.759788739 (10h27m32.922389687s) [noise=true , address=45.91.116.6:4999 , piece_id=T2THXW3464HZPRMPAD5NWPP3PHXFGHPXMMAHKRHLDCNKHGS5UNTQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760165330 (10h27m32.922766268s) [noise=true , address=79.127.201.215:4343 , piece_id=5QBWFDM2FXVYXYQGWDUPR54SAW3IRORHCR5SVX5EHNWKXZ35PIIA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760461617 (10h27m32.923062555s) [noise=true , address=77.90.31.15:4701 , piece_id=S6TPY54DURMAZXKUWPS6N2THZ3HA5H64SDZT2QU53DMW3RUNIZFA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760596666 (10h27m32.923197614s) [noise=true , address=79.127.205.245:4238 , piece_id=2H2SHXAU2P4JBMINIQJIDPWU5AIXBYD276WFEV3LHY7UZ5QXRTEQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760761020 (10h27m32.923361958s) [noise=true , address=79.127.205.246:4281 , piece_id=HQMU5MFQ7P3AG2TO2KHRXI2RBX7QDETMUMX4PJE4KD6MD7ED2LVA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761018753 (10h27m32.923619691s) [noise=true , address=45.91.116.7:4039 , piece_id=22UVQ7BU3KHTQ5Y4IILVOYRBMIGFJOQZHGNVZ2WNUXGCT4CRJGBA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761291374 (10h27m32.923892312s) [noise=true , address=104.36.82.44:4885 , piece_id=Q2D3EJEOXCIUKUHO24XNXKN4GHZARE3TOOAXJ4OIGVRSLTHB4BOQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761498942 (10h27m32.92409988s) [noise=true , address=79.127.201.214:4290 , piece_id=CRODRI3BNAA4Q4NIMAJJUDI45ARELZ6WBC67WBCTMT55AE2SBNVA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761698784 (10h27m32.924299722s) [noise=true , address=104.36.82.50:4016 , piece_id=NXQDHZQ3RBKRQPPUYDI4AU2JXN3FCX6OIU3VNX6UNR5N35HKNQFA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761945757 (10h27m32.924546695s) [noise=true , address=79.127.220.97:4361 , piece_id=BPGKJDESXP53ROBUDLR3JIGQMLABKUWF5RJALDHKMTIIB2P7O7ZA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762179363 (10h27m32.924780292s) [noise=true , address=77.90.31.13:4647 , piece_id=OMTE4HGX4L33DXF7GLWXO7NYR7JQBJL2NLC5VU5P2VWG3ME7RA3Q, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762210724 (10h27m32.924811652s) [noise=true , address=77.90.31.10:4524 , piece_id=PVC3U44KHKHOVCRPFT6GH26UDZN4B77MSPUAB7TXJ4ZGENUTV2NQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762367984 (10h27m32.924968922s) [noise=true , address=79.127.219.51:4196 , piece_id=6NNUKMIZH5AYYX3FJ3AOJAW6EXDIOKCIYDZPDP76OYQKOB5PMJBQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762556545 (10h27m32.925157483s) [noise=true , address=79.127.219.47:4058 , piece_id=5JWBT2H42W6UIW4CJPAC445X4LDNEUQEUKV7NNSOU43JLMQ5JXZQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762667858 (10h27m32.925268796s) [noise=true , address=64.49.13.137:4494 , piece_id=6CAPGAYDDB7ZPXGBAQINVOH5VHT74MZQYULANGDWI5F2ZX7AY36Q, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762774853 (10h27m32.925375791s) [noise=true , address=45.91.116.9:4274 , piece_id=DCCGZGN2PX3OQO4VX3TT7EYXKTQY6MITMCC7M7FXE7HYI2L67OWA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.763080417 (10h27m32.925681355s) [noise=true , address=45.91.116.5:4304 , piece_id=YEZ66ZS52YVRBB4XP33UC7VDZELK7YFJC6MHYIUG5G4Z4AD7YN2A, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:54.882306217 (10h27m34.044907155s) [upload=10949]: Next returned nil segment Aug 28 04:05:54.882324662 (10h27m34.0449256s) [upload=10949]: Waiting for error group managing segments... Aug 28 04:05:55.176815078 (10h27m34.339416056s) [noise=true , address=79.127.205.246:4281 , piece_id=HQMU5MFQ7P3AG2TO2KHRXI2RBX7QDETMUMX4PJE4KD6MD7ED2LVA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.178010275 (10h27m34.340611223s) [noise=true , address=79.127.205.245:4238 , piece_id=2H2SHXAU2P4JBMINIQJIDPWU5AIXBYD276WFEV3LHY7UZ5QXRTEQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.190745574 (10h27m34.353346512s) [noise=true , address=64.49.13.137:4494 , piece_id=6CAPGAYDDB7ZPXGBAQINVOH5VHT74MZQYULANGDWI5F2ZX7AY36Q, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.603281813 (10h27m34.765882751s) [noise=true , address=79.127.220.97:4361 , piece_id=BPGKJDESXP53ROBUDLR3JIGQMLABKUWF5RJALDHKMTIIB2P7O7ZA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.657161975 (10h27m34.819762913s) [noise=true , address=45.91.116.8:4060 , piece_id=RBI2EDNLOOYVN5RSAERIYEIXH63FOWD6IZQTAKXZ5HZO7NBRVQLA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.671217149 (10h27m34.833818087s) [noise=true , address=45.91.116.9:4274 , piece_id=DCCGZGN2PX3OQO4VX3TT7EYXKTQY6MITMCC7M7FXE7HYI2L67OWA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.702955241 (10h27m34.865556169s) [noise=true , address=79.127.219.51:4196 , piece_id=6NNUKMIZH5AYYX3FJ3AOJAW6EXDIOKCIYDZPDP76OYQKOB5PMJBQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.707816403 (10h27m34.870417341s) [noise=true , address=45.91.116.6:4999 , piece_id=T2THXW3464HZPRMPAD5NWPP3PHXFGHPXMMAHKRHLDCNKHGS5UNTQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.728970733 (10h27m34.891571681s) [noise=true , address=77.90.31.13:4647 , piece_id=OMTE4HGX4L33DXF7GLWXO7NYR7JQBJL2NLC5VU5P2VWG3ME7RA3Q, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.742514249 (10h27m34.905115187s) [noise=true , address=79.127.219.47:4058 , piece_id=5JWBT2H42W6UIW4CJPAC445X4LDNEUQEUKV7NNSOU43JLMQ5JXZQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.755299383 (10h27m34.917900321s) [noise=true , address=104.36.82.50:4016 , piece_id=NXQDHZQ3RBKRQPPUYDI4AU2JXN3FCX6OIU3VNX6UNR5N35HKNQFA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.794179992 (10h27m34.95678093s) [noise=true , address=79.127.201.215:4343 , piece_id=5QBWFDM2FXVYXYQGWDUPR54SAW3IRORHCR5SVX5EHNWKXZ35PIIA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.834967951 (10h27m34.997568889s) [noise=true , address=45.91.116.7:4039 , piece_id=22UVQ7BU3KHTQ5Y4IILVOYRBMIGFJOQZHGNVZ2WNUXGCT4CRJGBA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.846294364 (10h27m35.008895302s) [noise=true , address=79.127.201.214:4290 , piece_id=CRODRI3BNAA4Q4NIMAJJUDI45ARELZ6WBC67WBCTMT55AE2SBNVA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.846322088 (10h27m35.008923026s) [seg_pos={0 0}, upload=10949]: Segment reached optimal threshold of 14 pieces. Aug 28 04:05:55.846431748 (10h27m35.009032686s) [noise=true , address=77.90.31.10:4524 , piece_id=PVC3U44KHKHOVCRPFT6GH26UDZN4B77MSPUAB7TXJ4ZGENUTV2NQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846493265 (10h27m35.009094203s) [noise=true , address=45.91.116.5:4304 , piece_id=YEZ66ZS52YVRBB4XP33UC7VDZELK7YFJC6MHYIUG5G4Z4AD7YN2A, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dFsmPBv2oP7W7uKnJFpKMcJDSQ3BEGLaPZ23eX3Cqze8UgDSs): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846545676 (10h27m35.009146604s) [noise=true , address=77.90.31.15:4701 , piece_id=S6TPY54DURMAZXKUWPS6N2THZ3HA5H64SDZT2QU53DMW3RUNIZFA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846576364 (10h27m35.009177302s) [noise=true , address=104.36.82.44:4885 , piece_id=Q2D3EJEOXCIUKUHO24XNXKN4GHZARE3TOOAXJ4OIGVRSLTHB4BOQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846601863 (10h27m35.009202801s) [seg_pos={0 0}, upload=10949]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:05:55.846697305 (10h27m35.009298253s) [upload=10949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:05:55.846703988 (10h27m35.009304956s) [upload=10949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:05:56.185002402 (10h27m35.34760334s) [upload=10949]: Done uploading segments... Aug 28 04:05:56.185020596 (10h27m35.347621534s) [upload=10949]: Upload finished. err: <nil> Duration: 5.901347801s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.............X.] duration: 1.982859205s FAIL (2025-08-28 04:07:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:06:16.838647525 (10h27m56.001248463s) [upload=10955]: Starting upload Aug 28 04:06:16.838721075 (10h27m56.001322013s) [upload=10955]: Done starting upload Aug 28 04:06:16.838776211 (10h27m56.001377149s) [upload=10955]: Uploading segments... Aug 28 04:06:16.838813302 (10h27m56.00141424s) [upload=10955]: Got next segment. Inline: true Aug 28 04:06:16.838817791 (10h27m56.001418729s) [upload=10955]: Waiting for error group managing segments... Aug 28 04:06:16.838853038 (10h27m56.001453976s) [upload=10955]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:06:16.838857506 (10h27m56.001458444s) [upload=10955]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:06:16.838860311 (10h27m56.00146125s) [upload=10955]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:06:17.075949559 (10h27m56.238550547s) [upload=10955]: Done uploading segments... Aug 28 04:06:17.075972433 (10h27m56.238573401s) [upload=10955]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.982879285s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [..............................X....X.X.....X...X.........X..] duration: 1.478966723s FAIL (2025-08-28 04:06:53 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.478992853s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 10 out of 60 is failed (threshold=3) [.............................X.....X..X.X...XXX....X.X....X.] duration: 4.930963695s FAIL (2025-08-28 04:06:46 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.930990336s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X.......................X.] duration: 5.748143s FAIL (2025-08-28 04:06:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:05:53.289363958 (10h27m32.451964926s) [upload=10949]: Starting upload Aug 28 04:05:53.289458931 (10h27m32.452059869s) [upload=10949]: Done starting upload Aug 28 04:05:53.289544624 (10h27m32.452145562s) [upload=10949]: Uploading segments... Aug 28 04:05:53.289936975 (10h27m32.452537963s) [upload=10949]: Got next segment. Inline: false Aug 28 04:05:53.289966621 (10h27m32.452567549s) [upload=10949]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:05:53.289970921 (10h27m32.452571859s) [upload=10949]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:05:53.759704708 (10h27m32.922305646s) [seg_pos={0 0}, upload=10949]: Begin upload segment... Aug 28 04:05:53.759750246 (10h27m32.922351184s) [seg_pos={0 0}, upload=10949]: Done begin upload segment. Aug 28 04:05:53.759780604 (10h27m32.922381542s) [noise=true , address=45.91.116.8:4060 , piece_id=RBI2EDNLOOYVN5RSAERIYEIXH63FOWD6IZQTAKXZ5HZO7NBRVQLA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.759788739 (10h27m32.922389687s) [noise=true , address=45.91.116.6:4999 , piece_id=T2THXW3464HZPRMPAD5NWPP3PHXFGHPXMMAHKRHLDCNKHGS5UNTQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760165330 (10h27m32.922766268s) [noise=true , address=79.127.201.215:4343 , piece_id=5QBWFDM2FXVYXYQGWDUPR54SAW3IRORHCR5SVX5EHNWKXZ35PIIA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760461617 (10h27m32.923062555s) [noise=true , address=77.90.31.15:4701 , piece_id=S6TPY54DURMAZXKUWPS6N2THZ3HA5H64SDZT2QU53DMW3RUNIZFA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760596666 (10h27m32.923197614s) [noise=true , address=79.127.205.245:4238 , piece_id=2H2SHXAU2P4JBMINIQJIDPWU5AIXBYD276WFEV3LHY7UZ5QXRTEQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760761020 (10h27m32.923361958s) [noise=true , address=79.127.205.246:4281 , piece_id=HQMU5MFQ7P3AG2TO2KHRXI2RBX7QDETMUMX4PJE4KD6MD7ED2LVA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761018753 (10h27m32.923619691s) [noise=true , address=45.91.116.7:4039 , piece_id=22UVQ7BU3KHTQ5Y4IILVOYRBMIGFJOQZHGNVZ2WNUXGCT4CRJGBA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761291374 (10h27m32.923892312s) [noise=true , address=104.36.82.44:4885 , piece_id=Q2D3EJEOXCIUKUHO24XNXKN4GHZARE3TOOAXJ4OIGVRSLTHB4BOQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761498942 (10h27m32.92409988s) [noise=true , address=79.127.201.214:4290 , piece_id=CRODRI3BNAA4Q4NIMAJJUDI45ARELZ6WBC67WBCTMT55AE2SBNVA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761698784 (10h27m32.924299722s) [noise=true , address=104.36.82.50:4016 , piece_id=NXQDHZQ3RBKRQPPUYDI4AU2JXN3FCX6OIU3VNX6UNR5N35HKNQFA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761945757 (10h27m32.924546695s) [noise=true , address=79.127.220.97:4361 , piece_id=BPGKJDESXP53ROBUDLR3JIGQMLABKUWF5RJALDHKMTIIB2P7O7ZA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762179363 (10h27m32.924780292s) [noise=true , address=77.90.31.13:4647 , piece_id=OMTE4HGX4L33DXF7GLWXO7NYR7JQBJL2NLC5VU5P2VWG3ME7RA3Q, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762210724 (10h27m32.924811652s) [noise=true , address=77.90.31.10:4524 , piece_id=PVC3U44KHKHOVCRPFT6GH26UDZN4B77MSPUAB7TXJ4ZGENUTV2NQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762367984 (10h27m32.924968922s) [noise=true , address=79.127.219.51:4196 , piece_id=6NNUKMIZH5AYYX3FJ3AOJAW6EXDIOKCIYDZPDP76OYQKOB5PMJBQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762556545 (10h27m32.925157483s) [noise=true , address=79.127.219.47:4058 , piece_id=5JWBT2H42W6UIW4CJPAC445X4LDNEUQEUKV7NNSOU43JLMQ5JXZQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762667858 (10h27m32.925268796s) [noise=true , address=64.49.13.137:4494 , piece_id=6CAPGAYDDB7ZPXGBAQINVOH5VHT74MZQYULANGDWI5F2ZX7AY36Q, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762774853 (10h27m32.925375791s) [noise=true , address=45.91.116.9:4274 , piece_id=DCCGZGN2PX3OQO4VX3TT7EYXKTQY6MITMCC7M7FXE7HYI2L67OWA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.763080417 (10h27m32.925681355s) [noise=true , address=45.91.116.5:4304 , piece_id=YEZ66ZS52YVRBB4XP33UC7VDZELK7YFJC6MHYIUG5G4Z4AD7YN2A, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:54.882306217 (10h27m34.044907155s) [upload=10949]: Next returned nil segment Aug 28 04:05:54.882324662 (10h27m34.0449256s) [upload=10949]: Waiting for error group managing segments... Aug 28 04:05:55.176815078 (10h27m34.339416056s) [noise=true , address=79.127.205.246:4281 , piece_id=HQMU5MFQ7P3AG2TO2KHRXI2RBX7QDETMUMX4PJE4KD6MD7ED2LVA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.178010275 (10h27m34.340611223s) [noise=true , address=79.127.205.245:4238 , piece_id=2H2SHXAU2P4JBMINIQJIDPWU5AIXBYD276WFEV3LHY7UZ5QXRTEQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.190745574 (10h27m34.353346512s) [noise=true , address=64.49.13.137:4494 , piece_id=6CAPGAYDDB7ZPXGBAQINVOH5VHT74MZQYULANGDWI5F2ZX7AY36Q, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.603281813 (10h27m34.765882751s) [noise=true , address=79.127.220.97:4361 , piece_id=BPGKJDESXP53ROBUDLR3JIGQMLABKUWF5RJALDHKMTIIB2P7O7ZA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.657161975 (10h27m34.819762913s) [noise=true , address=45.91.116.8:4060 , piece_id=RBI2EDNLOOYVN5RSAERIYEIXH63FOWD6IZQTAKXZ5HZO7NBRVQLA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.671217149 (10h27m34.833818087s) [noise=true , address=45.91.116.9:4274 , piece_id=DCCGZGN2PX3OQO4VX3TT7EYXKTQY6MITMCC7M7FXE7HYI2L67OWA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.702955241 (10h27m34.865556169s) [noise=true , address=79.127.219.51:4196 , piece_id=6NNUKMIZH5AYYX3FJ3AOJAW6EXDIOKCIYDZPDP76OYQKOB5PMJBQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.707816403 (10h27m34.870417341s) [noise=true , address=45.91.116.6:4999 , piece_id=T2THXW3464HZPRMPAD5NWPP3PHXFGHPXMMAHKRHLDCNKHGS5UNTQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.728970733 (10h27m34.891571681s) [noise=true , address=77.90.31.13:4647 , piece_id=OMTE4HGX4L33DXF7GLWXO7NYR7JQBJL2NLC5VU5P2VWG3ME7RA3Q, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.742514249 (10h27m34.905115187s) [noise=true , address=79.127.219.47:4058 , piece_id=5JWBT2H42W6UIW4CJPAC445X4LDNEUQEUKV7NNSOU43JLMQ5JXZQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.755299383 (10h27m34.917900321s) [noise=true , address=104.36.82.50:4016 , piece_id=NXQDHZQ3RBKRQPPUYDI4AU2JXN3FCX6OIU3VNX6UNR5N35HKNQFA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.794179992 (10h27m34.95678093s) [noise=true , address=79.127.201.215:4343 , piece_id=5QBWFDM2FXVYXYQGWDUPR54SAW3IRORHCR5SVX5EHNWKXZ35PIIA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.834967951 (10h27m34.997568889s) [noise=true , address=45.91.116.7:4039 , piece_id=22UVQ7BU3KHTQ5Y4IILVOYRBMIGFJOQZHGNVZ2WNUXGCT4CRJGBA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.846294364 (10h27m35.008895302s) [noise=true , address=79.127.201.214:4290 , piece_id=CRODRI3BNAA4Q4NIMAJJUDI45ARELZ6WBC67WBCTMT55AE2SBNVA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.846322088 (10h27m35.008923026s) [seg_pos={0 0}, upload=10949]: Segment reached optimal threshold of 14 pieces. Aug 28 04:05:55.846431748 (10h27m35.009032686s) [noise=true , address=77.90.31.10:4524 , piece_id=PVC3U44KHKHOVCRPFT6GH26UDZN4B77MSPUAB7TXJ4ZGENUTV2NQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846493265 (10h27m35.009094203s) [noise=true , address=45.91.116.5:4304 , piece_id=YEZ66ZS52YVRBB4XP33UC7VDZELK7YFJC6MHYIUG5G4Z4AD7YN2A, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dFsmPBv2oP7W7uKnJFpKMcJDSQ3BEGLaPZ23eX3Cqze8UgDSs): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846545676 (10h27m35.009146604s) [noise=true , address=77.90.31.15:4701 , piece_id=S6TPY54DURMAZXKUWPS6N2THZ3HA5H64SDZT2QU53DMW3RUNIZFA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846576364 (10h27m35.009177302s) [noise=true , address=104.36.82.44:4885 , piece_id=Q2D3EJEOXCIUKUHO24XNXKN4GHZARE3TOOAXJ4OIGVRSLTHB4BOQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846601863 (10h27m35.009202801s) [seg_pos={0 0}, upload=10949]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:05:55.846697305 (10h27m35.009298253s) [upload=10949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:05:55.846703988 (10h27m35.009304956s) [upload=10949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:05:56.185002402 (10h27m35.34760334s) [upload=10949]: Done uploading segments... Aug 28 04:05:56.185020596 (10h27m35.347621534s) [upload=10949]: Upload finished. err: <nil> Duration: 5.748172956s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 10 out of 60 is failed (threshold=3) [..............................X.....X..X.X...XXX....X.X....X] duration: 30.002884078s FAIL (2025-08-28 04:06:27 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.002908754s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X.............X] duration: 917.847656ms FAIL (2025-08-28 04:06:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 28 04:06:16.838647525 (10h27m56.001248463s) [upload=10955]: Starting upload Aug 28 04:06:16.838721075 (10h27m56.001322013s) [upload=10955]: Done starting upload Aug 28 04:06:16.838776211 (10h27m56.001377149s) [upload=10955]: Uploading segments... Aug 28 04:06:16.838813302 (10h27m56.00141424s) [upload=10955]: Got next segment. Inline: true Aug 28 04:06:16.838817791 (10h27m56.001418729s) [upload=10955]: Waiting for error group managing segments... Aug 28 04:06:16.838853038 (10h27m56.001453976s) [upload=10955]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:06:16.838857506 (10h27m56.001458444s) [upload=10955]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 04:06:16.838860311 (10h27m56.00146125s) [upload=10955]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:06:17.075949559 (10h27m56.238550547s) [upload=10955]: Done uploading segments... Aug 28 04:06:17.075972433 (10h27m56.238573401s) [upload=10955]: Upload finished. err: metaclient: Too Many Requests Duration:* 917.874978ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X.......................X] duration: 4.045677524s FAIL (2025-08-28 04:05:56 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 28 04:05:53.289363958 (10h27m32.451964926s) [upload=10949]: Starting upload Aug 28 04:05:53.289458931 (10h27m32.452059869s) [upload=10949]: Done starting upload Aug 28 04:05:53.289544624 (10h27m32.452145562s) [upload=10949]: Uploading segments... Aug 28 04:05:53.289936975 (10h27m32.452537963s) [upload=10949]: Got next segment. Inline: false Aug 28 04:05:53.289966621 (10h27m32.452567549s) [upload=10949]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 04:05:53.289970921 (10h27m32.452571859s) [upload=10949]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 04:05:53.759704708 (10h27m32.922305646s) [seg_pos={0 0}, upload=10949]: Begin upload segment... Aug 28 04:05:53.759750246 (10h27m32.922351184s) [seg_pos={0 0}, upload=10949]: Done begin upload segment. Aug 28 04:05:53.759780604 (10h27m32.922381542s) [noise=true , address=45.91.116.8:4060 , piece_id=RBI2EDNLOOYVN5RSAERIYEIXH63FOWD6IZQTAKXZ5HZO7NBRVQLA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.759788739 (10h27m32.922389687s) [noise=true , address=45.91.116.6:4999 , piece_id=T2THXW3464HZPRMPAD5NWPP3PHXFGHPXMMAHKRHLDCNKHGS5UNTQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760165330 (10h27m32.922766268s) [noise=true , address=79.127.201.215:4343 , piece_id=5QBWFDM2FXVYXYQGWDUPR54SAW3IRORHCR5SVX5EHNWKXZ35PIIA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760461617 (10h27m32.923062555s) [noise=true , address=77.90.31.15:4701 , piece_id=S6TPY54DURMAZXKUWPS6N2THZ3HA5H64SDZT2QU53DMW3RUNIZFA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760596666 (10h27m32.923197614s) [noise=true , address=79.127.205.245:4238 , piece_id=2H2SHXAU2P4JBMINIQJIDPWU5AIXBYD276WFEV3LHY7UZ5QXRTEQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.760761020 (10h27m32.923361958s) [noise=true , address=79.127.205.246:4281 , piece_id=HQMU5MFQ7P3AG2TO2KHRXI2RBX7QDETMUMX4PJE4KD6MD7ED2LVA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761018753 (10h27m32.923619691s) [noise=true , address=45.91.116.7:4039 , piece_id=22UVQ7BU3KHTQ5Y4IILVOYRBMIGFJOQZHGNVZ2WNUXGCT4CRJGBA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761291374 (10h27m32.923892312s) [noise=true , address=104.36.82.44:4885 , piece_id=Q2D3EJEOXCIUKUHO24XNXKN4GHZARE3TOOAXJ4OIGVRSLTHB4BOQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761498942 (10h27m32.92409988s) [noise=true , address=79.127.201.214:4290 , piece_id=CRODRI3BNAA4Q4NIMAJJUDI45ARELZ6WBC67WBCTMT55AE2SBNVA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761698784 (10h27m32.924299722s) [noise=true , address=104.36.82.50:4016 , piece_id=NXQDHZQ3RBKRQPPUYDI4AU2JXN3FCX6OIU3VNX6UNR5N35HKNQFA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.761945757 (10h27m32.924546695s) [noise=true , address=79.127.220.97:4361 , piece_id=BPGKJDESXP53ROBUDLR3JIGQMLABKUWF5RJALDHKMTIIB2P7O7ZA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762179363 (10h27m32.924780292s) [noise=true , address=77.90.31.13:4647 , piece_id=OMTE4HGX4L33DXF7GLWXO7NYR7JQBJL2NLC5VU5P2VWG3ME7RA3Q, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762210724 (10h27m32.924811652s) [noise=true , address=77.90.31.10:4524 , piece_id=PVC3U44KHKHOVCRPFT6GH26UDZN4B77MSPUAB7TXJ4ZGENUTV2NQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762367984 (10h27m32.924968922s) [noise=true , address=79.127.219.51:4196 , piece_id=6NNUKMIZH5AYYX3FJ3AOJAW6EXDIOKCIYDZPDP76OYQKOB5PMJBQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762556545 (10h27m32.925157483s) [noise=true , address=79.127.219.47:4058 , piece_id=5JWBT2H42W6UIW4CJPAC445X4LDNEUQEUKV7NNSOU43JLMQ5JXZQ, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762667858 (10h27m32.925268796s) [noise=true , address=64.49.13.137:4494 , piece_id=6CAPGAYDDB7ZPXGBAQINVOH5VHT74MZQYULANGDWI5F2ZX7AY36Q, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.762774853 (10h27m32.925375791s) [noise=true , address=45.91.116.9:4274 , piece_id=DCCGZGN2PX3OQO4VX3TT7EYXKTQY6MITMCC7M7FXE7HYI2L67OWA, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:53.763080417 (10h27m32.925681355s) [noise=true , address=45.91.116.5:4304 , piece_id=YEZ66ZS52YVRBB4XP33UC7VDZELK7YFJC6MHYIUG5G4Z4AD7YN2A, seg_pos={0 0}, upload=10949]: Uploading piece... Aug 28 04:05:54.882306217 (10h27m34.044907155s) [upload=10949]: Next returned nil segment Aug 28 04:05:54.882324662 (10h27m34.0449256s) [upload=10949]: Waiting for error group managing segments... Aug 28 04:05:55.176815078 (10h27m34.339416056s) [noise=true , address=79.127.205.246:4281 , piece_id=HQMU5MFQ7P3AG2TO2KHRXI2RBX7QDETMUMX4PJE4KD6MD7ED2LVA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.178010275 (10h27m34.340611223s) [noise=true , address=79.127.205.245:4238 , piece_id=2H2SHXAU2P4JBMINIQJIDPWU5AIXBYD276WFEV3LHY7UZ5QXRTEQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.190745574 (10h27m34.353346512s) [noise=true , address=64.49.13.137:4494 , piece_id=6CAPGAYDDB7ZPXGBAQINVOH5VHT74MZQYULANGDWI5F2ZX7AY36Q, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.603281813 (10h27m34.765882751s) [noise=true , address=79.127.220.97:4361 , piece_id=BPGKJDESXP53ROBUDLR3JIGQMLABKUWF5RJALDHKMTIIB2P7O7ZA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.657161975 (10h27m34.819762913s) [noise=true , address=45.91.116.8:4060 , piece_id=RBI2EDNLOOYVN5RSAERIYEIXH63FOWD6IZQTAKXZ5HZO7NBRVQLA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.671217149 (10h27m34.833818087s) [noise=true , address=45.91.116.9:4274 , piece_id=DCCGZGN2PX3OQO4VX3TT7EYXKTQY6MITMCC7M7FXE7HYI2L67OWA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.702955241 (10h27m34.865556169s) [noise=true , address=79.127.219.51:4196 , piece_id=6NNUKMIZH5AYYX3FJ3AOJAW6EXDIOKCIYDZPDP76OYQKOB5PMJBQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.707816403 (10h27m34.870417341s) [noise=true , address=45.91.116.6:4999 , piece_id=T2THXW3464HZPRMPAD5NWPP3PHXFGHPXMMAHKRHLDCNKHGS5UNTQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.728970733 (10h27m34.891571681s) [noise=true , address=77.90.31.13:4647 , piece_id=OMTE4HGX4L33DXF7GLWXO7NYR7JQBJL2NLC5VU5P2VWG3ME7RA3Q, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.742514249 (10h27m34.905115187s) [noise=true , address=79.127.219.47:4058 , piece_id=5JWBT2H42W6UIW4CJPAC445X4LDNEUQEUKV7NNSOU43JLMQ5JXZQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.755299383 (10h27m34.917900321s) [noise=true , address=104.36.82.50:4016 , piece_id=NXQDHZQ3RBKRQPPUYDI4AU2JXN3FCX6OIU3VNX6UNR5N35HKNQFA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.794179992 (10h27m34.95678093s) [noise=true , address=79.127.201.215:4343 , piece_id=5QBWFDM2FXVYXYQGWDUPR54SAW3IRORHCR5SVX5EHNWKXZ35PIIA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.834967951 (10h27m34.997568889s) [noise=true , address=45.91.116.7:4039 , piece_id=22UVQ7BU3KHTQ5Y4IILVOYRBMIGFJOQZHGNVZ2WNUXGCT4CRJGBA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.846294364 (10h27m35.008895302s) [noise=true , address=79.127.201.214:4290 , piece_id=CRODRI3BNAA4Q4NIMAJJUDI45ARELZ6WBC67WBCTMT55AE2SBNVA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: <nil> Aug 28 04:05:55.846322088 (10h27m35.008923026s) [seg_pos={0 0}, upload=10949]: Segment reached optimal threshold of 14 pieces. Aug 28 04:05:55.846431748 (10h27m35.009032686s) [noise=true , address=77.90.31.10:4524 , piece_id=PVC3U44KHKHOVCRPFT6GH26UDZN4B77MSPUAB7TXJ4ZGENUTV2NQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uN7CznoK4AD8FqFkNUndawdGJ9rmjAe7oNnjJkV844ScY87qe): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846493265 (10h27m35.009094203s) [noise=true , address=45.91.116.5:4304 , piece_id=YEZ66ZS52YVRBB4XP33UC7VDZELK7YFJC6MHYIUG5G4Z4AD7YN2A, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dFsmPBv2oP7W7uKnJFpKMcJDSQ3BEGLaPZ23eX3Cqze8UgDSs): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846545676 (10h27m35.009146604s) [noise=true , address=77.90.31.15:4701 , piece_id=S6TPY54DURMAZXKUWPS6N2THZ3HA5H64SDZT2QU53DMW3RUNIZFA, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12u5UY7VzJcjCvHtATf2ofXugWew2JXVXBjpManmX4wSzQwR7A6): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846576364 (10h27m35.009177302s) [noise=true , address=104.36.82.44:4885 , piece_id=Q2D3EJEOXCIUKUHO24XNXKN4GHZARE3TOOAXJ4OIGVRSLTHB4BOQ, seg_pos={0 0}, upload=10949]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:118qGQLFSNbsYsvFrKjTXXWbFYu2sRaRHrUNkKNCrNVpzVQRtG): protocol: expected piece hash; context canceled; EOF Aug 28 04:05:55.846601863 (10h27m35.009202801s) [seg_pos={0 0}, upload=10949]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 04:05:55.846697305 (10h27m35.009298253s) [upload=10949]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 04:05:55.846703988 (10h27m35.009304956s) [upload=10949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 04:05:56.185002402 (10h27m35.34760334s) [upload=10949]: Done uploading segments... Aug 28 04:05:56.185020596 (10h27m35.347621534s) [upload=10949]: Upload finished. err: <nil> Duration: 4.045698975s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [...............................X....X.X.....X...X.........X.] duration: 1.456082153s FAIL (2025-08-28 04:05:38 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 1.456111718s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.994107459s FAIL (2025-08-28 04:05:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 1.994136014s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 6 out of 60 is failed (threshold=3) [................................X....X.X.....X...X.........X] duration: 30.001155277s FAIL (2025-08-28 04:05:06 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 30.001178753s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 9 out of 60 is failed (threshold=3) [...............................X.....X..X.X...XXX....X.X....] duration: 5.17404196s FAIL (2025-08-28 04:04:54 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.174066297s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.895440196s FAIL (2025-08-28 04:04:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.895467949s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X..............................................X............] duration: 1.909691766s FAIL (2025-08-28 04:04:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 1.909714701s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.052730807s FAIL (2025-08-28 04:04:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 6.052760342s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 9 out of 60 is failed (threshold=3) [................................X.....X..X.X...XXX....X.X...] duration: 4.999252181s FAIL (2025-08-28 04:03:54 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.999278521s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.................................X.....X..X.X...XXX....X.X..] duration: 5.111045241s FAIL (2025-08-28 04:03:35 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.111077103s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [.................................X....X.X.....X...X.........] duration: 1.525420976s FAIL (2025-08-28 04:03:29 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.525449972s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X..............................................X...........] duration: 1.91022156s FAIL (2025-08-28 04:03:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 1.91025826s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 9 out of 60 is failed (threshold=3) [..................................X.....X..X.X...XXX....X.X.] duration: 5.086253535s FAIL (2025-08-28 04:02:58 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.086272762s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.726185716s FAIL (2025-08-28 04:02:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.726213999s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [..................................X....X.X.....X...X........] duration: 1.547039484s FAIL (2025-08-28 04:02:41 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.547056958s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X..............................................X..........] duration: 2.180640592s FAIL (2025-08-28 04:02:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 2.180670409s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [...................................X....X.X.....X...X.......] duration: 30.001054567s FAIL (2025-08-28 04:02:39 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.001110904s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 9 out of 60 is failed (threshold=3) [...................................X.....X..X.X...XXX....X.X] duration: 30.003484448s FAIL (2025-08-28 04:02:32 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.003505356s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.015891205s FAIL (2025-08-28 04:02:30 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 6.015919068s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X..............................................X.........] duration: 2.063554959s FAIL (2025-08-28 04:02:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 2.063582574s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 8 out of 60 is failed (threshold=3) [....................................X.....X..X.X...XXX....X.] duration: 4.996770618s FAIL (2025-08-28 04:01:51 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 4.99679876s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.947375155s FAIL (2025-08-28 04:01:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.947400493s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X..............................................X........] duration: 2.120614736s FAIL (2025-08-28 04:01:19 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 2.120647068s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.....................................X.....X..X.X...XXX....X] duration: 30.003347324s FAIL (2025-08-28 04:01:07 UTC) orbiter warning: operation: DeleteObject uplink: metaclient: context deadline exceeded Duration: 30.00336639s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [....................................X....X.X.....X...X......] duration: 1.440752893s FAIL (2025-08-28 04:01:07 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.440782881s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 6.400883271s FAIL (2025-08-28 04:00:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 6.400901607s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X..............................................X.......] duration: 2.332628356s FAIL (2025-08-28 04:00:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 2.33266198s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [.....................................X....X.X.....X...X.....] duration: 1.4930883s FAIL (2025-08-28 04:00:27 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.493117356s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 7 out of 60 is failed (threshold=3) [......................................X.....X..X.X...XXX....] duration: 5.1551861s FAIL (2025-08-28 04:00:11 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 5.15522282s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [......................................X....X.X.....X...X....] duration: 1.472290196s FAIL (2025-08-28 04:00:08 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.472319702s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 7 out of 60 is failed (threshold=3) [.......................................X.....X..X.X...XXX...] duration: 4.978885085s FAIL (2025-08-28 03:59:38 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.978988904s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [.......................................X....X.X.....X...X...] duration: 1.409752065s FAIL (2025-08-28 03:59:22 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 1.409818043s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.861991992s FAIL (2025-08-28 03:59:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.862018572s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X..............................................X......] duration: 2.15512518s FAIL (2025-08-28 03:59:15 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 2.155157723s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.707726958s FAIL (2025-08-28 03:59:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.707759061s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 5 out of 60 is failed (threshold=3) [........................................X....X.X.....X...X..] duration: 30.000997708s FAIL (2025-08-28 03:58:47 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 30.001020301s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X..............................................X.....] duration: 1.991803009s FAIL (2025-08-28 03:58:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 28 03:54:35.743314837 (10h16m14.905915775s) [upload=10767]: Starting upload Aug 28 03:54:35.743364762 (10h16m14.905965701s) [upload=10767]: Done starting upload Aug 28 03:54:35.743430798 (10h16m14.906031736s) [upload=10767]: Uploading segments... Aug 28 03:54:35.743525740 (10h16m14.906126678s) [upload=10767]: Got next segment. Inline: true Aug 28 03:54:35.743530500 (10h16m14.906131428s) [upload=10767]: Waiting for error group managing segments... Aug 28 03:54:35.743575134 (10h16m14.906176072s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:54:35.743580986 (10h16m14.906181914s) [upload=10767]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 28 03:54:35.743583731 (10h16m14.90618467s) [upload=10767]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:54:36.027291742 (10h16m15.18989268s) [upload=10767]: Done uploading segments... Aug 28 03:54:36.027346026 (10h16m15.189946964s) [upload=10767]: Upload finished. err: <nil> Duration:* 1.991824491s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 7 out of 60 is failed (threshold=3) [........................................X.....X..X.X...XXX..] duration: 4.921191302s FAIL (2025-08-28 03:58:33 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 4.921223293s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.698595679s FAIL (2025-08-28 03:58:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 28 03:47:01.449941517 (10h8m40.612542465s) [upload=10630]: Starting upload Aug 28 03:47:01.450037982 (10h8m40.61263893s) [upload=10630]: Done starting upload Aug 28 03:47:01.450304613 (10h8m40.612905561s) [upload=10630]: Uploading segments... Aug 28 03:47:01.450648991 (10h8m40.613249939s) [upload=10630]: Got next segment. Inline: false Aug 28 03:47:01.450731108 (10h8m40.613332046s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 28 03:47:01.450738211 (10h8m40.613339149s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 28 03:47:01.942610496 (10h8m41.105211454s) [seg_pos={0 0}, upload=10630]: Begin upload segment... Aug 28 03:47:01.942692122 (10h8m41.10529307s) [seg_pos={0 0}, upload=10630]: Done begin upload segment. Aug 28 03:47:01.942737999 (10h8m41.105338947s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.942750544 (10h8m41.105351492s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943270599 (10h8m41.105871537s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943283583 (10h8m41.105884531s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943584148 (10h8m41.106185086s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943681976 (10h8m41.106282924s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.943842814 (10h8m41.106443762s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944187593 (10h8m41.106788541s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944514849 (10h8m41.107115797s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944522313 (10h8m41.107123261s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.944892322 (10h8m41.10749326s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.945541845 (10h8m41.108142793s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946012655 (10h8m41.108613603s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.946778872 (10h8m41.10937982s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.947222380 (10h8m41.109823328s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950097692 (10h8m41.11269864s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.950569995 (10h8m41.113170933s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:01.951844224 (10h8m41.114445172s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Uploading piece... Aug 28 03:47:03.069156050 (10h8m42.231756998s) [upload=10630]: Next returned nil segment Aug 28 03:47:03.069178824 (10h8m42.231779762s) [upload=10630]: Waiting for error group managing segments... Aug 28 03:47:03.370355148 (10h8m42.532956086s) [noise=true , address=79.127.205.245:4246 , piece_id=JD7AX24BSGIYN3WSEXZYGIXWZ75BQUSDX7PMCUSMP5K5WCMAT7SQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.825779622 (10h8m42.988380561s) [noise=true , address=77.90.31.15:4721 , piece_id=Q4DRDX72BSPOZBD32ST2BDCUJNCYJAODI7FUYK5NOGSF4KTNSMXQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.847643047 (10h8m43.010243995s) [noise=true , address=77.90.31.19:4847 , piece_id=NGIBKNV6PBRTQSYT73ZB6BNCGGNKI4X24GZILCCIG5V25CFWDNOQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.859978730 (10h8m43.022579678s) [noise=true , address=77.90.31.17:4801 , piece_id=AHCROXCLNS4EZGUTE6MF24XPG3OBDFL6NY42JGVBNME3LHP5R3DQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.865901262 (10h8m43.0285022s) [noise=true , address=45.91.116.13:4161 , piece_id=6VG72DEKKPCHLCPDATB634HBJPHSTZFONME5SSKU7UJI7IGFK5NQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.868794998 (10h8m43.031395936s) [noise=true , address=104.36.82.3:4769 , piece_id=W6MHFQWRQ42AM336FMBP7KYPDLM2WRTRBFXIGC4TOXRARXMKJPYQ, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.921028603 (10h8m43.083629541s) [noise=true , address=77.90.31.14:4678 , piece_id=ZFWGCQ4CSOX24H75DZJE4AACRGYLVJ6WLQ4ZSMGHS7WTCGQZVUVA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.924771185 (10h8m43.087372123s) [noise=true , address=45.91.116.5:4304 , piece_id=JTGXVKSMLB22MKJW37FCIS7I2WV3UG6OMAVY6NU2N7MGHXYGJBFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.927841500 (10h8m43.090442438s) [noise=true , address=45.91.116.11:4142 , piece_id=5JKINQM3PAPMGGF7TIRS3HEMKV2OSS6JSBIESTJ3P6FBVW67GNDA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.943958889 (10h8m43.106559837s) [noise=true , address=77.90.31.12:4605 , piece_id=3MZOYB3T5GHE5W4ESDGCB55OGC24BV775XUDOSXJJ27XEWRNODFA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.946856983 (10h8m43.109457941s) [noise=true , address=156.146.43.225:4461 , piece_id=BUFCSVZHO5XENDNRGCGLK35BULW2YPJFN6XDCSKPFJ232ZGWZI3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.948234369 (10h8m43.110835307s) [noise=true , address=79.127.201.215:4348 , piece_id=I4OF64DFW572ZRGKG3WO4V73QZ6VZMGDWMDHJIEQY7HH4MDOTZ3A, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.950644160 (10h8m43.113245098s) [noise=true , address=104.36.82.60:4359 , piece_id=TWLGEUOC7747QINZ2R2KMUJFHXYB6FWD3HJSHPVCFEWVNLVME3XA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965478183 (10h8m43.128079121s) [noise=true , address=77.90.31.21:4911 , piece_id=2PRY4KBE575XFMZP7L6CT3D6IJ2LUFMOACZCVHKT3FG3S2FJU2ZA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: <nil> Aug 28 03:47:03.965497200 (10h8m43.128098138s) [seg_pos={0 0}, upload=10630]: Segment reached optimal threshold of 14 pieces. Aug 28 03:47:03.965596721 (10h8m43.128197659s) [noise=true , address=77.90.31.16:4759 , piece_id=4VVVX5LAOASFA5H4DBTYDZKG7N2K4NTRFHUG7VJTW27AFESE6ERA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:13KqQ6GUrwQMP2ov1YRC1RJ6YqJhxB2T8MwxFEW1dFJADhBfYE): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965701662 (10h8m43.1283026s) [noise=true , address=104.36.82.23:4473 , piece_id=B2YLFREC4QI2W4E7RB5BSDH4JHF2MJJAKV5S7T77ZRR7EVKPJRCA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965760935 (10h8m43.128361873s) [noise=true , address=77.90.31.18:4827 , piece_id=SMUTVYWNQ4X7YSIFXDKCO75DBSREH23HMQXJOMF6HT6R73OFDRRA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:127KQ2X6VXddEeFRMau7MVGwtTsUmFsm8hTYDR2A6B4A1oVKfyo): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965789359 (10h8m43.128390297s) [noise=true , address=77.90.31.10:4547 , piece_id=PVJVZGHOEJA4TYTDGNW37O6ZTXYJ7IBUOWSW5WQEUYXXWGI6O4PA, seg_pos={0 0}, upload=10630]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hkdk6W2VmYLGra1GpBVJjkypiydor2f1LDjjGL2Kkb6fJqENZ): protocol: expected piece hash; context canceled; EOF Aug 28 03:47:03.965835838 (10h8m43.128436776s) [seg_pos={0 0}, upload=10630]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 28 03:47:03.965905822 (10h8m43.12850676s) [upload=10630]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 28 03:47:03.965910130 (10h8m43.128511068s) [upload=10630]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 28 03:47:04.309103099 (10h8m43.471704037s) [upload=10630]: Done uploading segments... Aug 28 03:47:04.309122155 (10h8m43.471723093s) [upload=10630]: Upload finished. err: <nil> Duration: 5.698620797s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)