Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 6.013573101s FAIL (2025-08-08 06:15:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.013594402s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.X.......................X.....................XX..........] duration: 5.491827179s FAIL (2025-08-08 06:15:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Upload finished. err: <nil> Aug 8 06:08:57.749323750 (20h28m57.338668737s) [upload=21214]: Starting upload Aug 8 06:08:57.749392772 (20h28m57.33873776s) [upload=21214]: Done starting upload Aug 8 06:08:57.749531277 (20h28m57.338876264s) [upload=21214]: Uploading segments... Aug 8 06:08:57.749648722 (20h28m57.338993699s) [upload=21214]: Got next segment. Inline: false Aug 8 06:08:57.749685904 (20h28m57.339030891s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:57.749690372 (20h28m57.339035359s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:08:58.201181414 (20h28m57.790526401s) [seg_pos={0 0}, upload=21214]: Begin upload segment... Aug 8 06:08:58.201256226 (20h28m57.790601213s) [seg_pos={0 0}, upload=21214]: Done begin upload segment. Aug 8 06:08:58.201279771 (20h28m57.790624758s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201311612 (20h28m57.790656599s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201653948 (20h28m57.790998925s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201945274 (20h28m57.791290261s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.202848843 (20h28m57.79219383s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203094173 (20h28m57.79243915s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203696936 (20h28m57.793041923s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.204978358 (20h28m57.794323345s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205294082 (20h28m57.794639069s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205596801 (20h28m57.794941788s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205860516 (20h28m57.795205503s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206100625 (20h28m57.795445612s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206346976 (20h28m57.795691953s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206562549 (20h28m57.795907536s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206764776 (20h28m57.796109753s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206972122 (20h28m57.79631711s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207357780 (20h28m57.796702777s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207757766 (20h28m57.797102763s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:59.355717999 (20h28m58.945062996s) [upload=21214]: Next returned nil segment Aug 8 06:08:59.355737837 (20h28m58.945082834s) [upload=21214]: Waiting for error group managing segments... Aug 8 06:08:59.649849433 (20h28m59.23919442s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.682717209 (20h28m59.272062196s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.709034182 (20h28m59.298379169s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.100260499 (20h28m59.689605486s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.104855691 (20h28m59.694200698s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.114024843 (20h28m59.70336982s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.121771305 (20h28m59.711116292s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.123815857 (20h28m59.713160845s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.199260396 (20h28m59.788605383s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.202036998 (20h28m59.791381985s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.206595831 (20h28m59.795940808s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.210343491 (20h28m59.799688478s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.223637637 (20h28m59.812982624s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247880111 (20h28m59.837225108s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247905569 (20h28m59.837250556s) [seg_pos={0 0}, upload=21214]: Segment reached optimal threshold of 14 pieces. Aug 8 06:09:00.248020038 (20h28m59.837365025s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248081636 (20h28m59.837426623s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248170025 (20h28m59.837515012s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248213729 (20h28m59.837558716s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248254727 (20h28m59.837599714s) [seg_pos={0 0}, upload=21214]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:09:00.248333207 (20h28m59.837678204s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:09:00.248337625 (20h28m59.837682612s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:00.584384828 (20h29m0.173729805s) [upload=21214]: Done uploading segments... Aug 8 06:09:00.584401549 (20h29m0.173746536s) [upload=21214]: Upload finished. err: <nil> Duration: 5.491850915s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.X.......................X.....................XX.........] duration: 5.725926926s FAIL (2025-08-08 06:14:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Upload finished. err: <nil> Aug 8 06:08:57.749323750 (20h28m57.338668737s) [upload=21214]: Starting upload Aug 8 06:08:57.749392772 (20h28m57.33873776s) [upload=21214]: Done starting upload Aug 8 06:08:57.749531277 (20h28m57.338876264s) [upload=21214]: Uploading segments... Aug 8 06:08:57.749648722 (20h28m57.338993699s) [upload=21214]: Got next segment. Inline: false Aug 8 06:08:57.749685904 (20h28m57.339030891s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:57.749690372 (20h28m57.339035359s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:08:58.201181414 (20h28m57.790526401s) [seg_pos={0 0}, upload=21214]: Begin upload segment... Aug 8 06:08:58.201256226 (20h28m57.790601213s) [seg_pos={0 0}, upload=21214]: Done begin upload segment. Aug 8 06:08:58.201279771 (20h28m57.790624758s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201311612 (20h28m57.790656599s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201653948 (20h28m57.790998925s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201945274 (20h28m57.791290261s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.202848843 (20h28m57.79219383s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203094173 (20h28m57.79243915s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203696936 (20h28m57.793041923s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.204978358 (20h28m57.794323345s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205294082 (20h28m57.794639069s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205596801 (20h28m57.794941788s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205860516 (20h28m57.795205503s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206100625 (20h28m57.795445612s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206346976 (20h28m57.795691953s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206562549 (20h28m57.795907536s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206764776 (20h28m57.796109753s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206972122 (20h28m57.79631711s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207357780 (20h28m57.796702777s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207757766 (20h28m57.797102763s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:59.355717999 (20h28m58.945062996s) [upload=21214]: Next returned nil segment Aug 8 06:08:59.355737837 (20h28m58.945082834s) [upload=21214]: Waiting for error group managing segments... Aug 8 06:08:59.649849433 (20h28m59.23919442s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.682717209 (20h28m59.272062196s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.709034182 (20h28m59.298379169s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.100260499 (20h28m59.689605486s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.104855691 (20h28m59.694200698s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.114024843 (20h28m59.70336982s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.121771305 (20h28m59.711116292s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.123815857 (20h28m59.713160845s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.199260396 (20h28m59.788605383s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.202036998 (20h28m59.791381985s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.206595831 (20h28m59.795940808s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.210343491 (20h28m59.799688478s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.223637637 (20h28m59.812982624s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247880111 (20h28m59.837225108s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247905569 (20h28m59.837250556s) [seg_pos={0 0}, upload=21214]: Segment reached optimal threshold of 14 pieces. Aug 8 06:09:00.248020038 (20h28m59.837365025s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248081636 (20h28m59.837426623s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248170025 (20h28m59.837515012s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248213729 (20h28m59.837558716s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248254727 (20h28m59.837599714s) [seg_pos={0 0}, upload=21214]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:09:00.248333207 (20h28m59.837678204s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:09:00.248337625 (20h28m59.837682612s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:00.584384828 (20h29m0.173729805s) [upload=21214]: Done uploading segments... Aug 8 06:09:00.584401549 (20h29m0.173746536s) [upload=21214]: Upload finished. err: <nil> Duration: 5.725952464s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 7.200106418s FAIL (2025-08-08 06:14:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.200152545s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [......X......X.............X............X........X....X.....] duration: 1.914009832s FAIL (2025-08-08 06:14:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.914035241s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X.X.......................X.....................XX........] duration: 5.557200375s FAIL (2025-08-08 06:14:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Upload finished. err: <nil> Aug 8 06:08:57.749323750 (20h28m57.338668737s) [upload=21214]: Starting upload Aug 8 06:08:57.749392772 (20h28m57.33873776s) [upload=21214]: Done starting upload Aug 8 06:08:57.749531277 (20h28m57.338876264s) [upload=21214]: Uploading segments... Aug 8 06:08:57.749648722 (20h28m57.338993699s) [upload=21214]: Got next segment. Inline: false Aug 8 06:08:57.749685904 (20h28m57.339030891s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:57.749690372 (20h28m57.339035359s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:08:58.201181414 (20h28m57.790526401s) [seg_pos={0 0}, upload=21214]: Begin upload segment... Aug 8 06:08:58.201256226 (20h28m57.790601213s) [seg_pos={0 0}, upload=21214]: Done begin upload segment. Aug 8 06:08:58.201279771 (20h28m57.790624758s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201311612 (20h28m57.790656599s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201653948 (20h28m57.790998925s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201945274 (20h28m57.791290261s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.202848843 (20h28m57.79219383s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203094173 (20h28m57.79243915s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203696936 (20h28m57.793041923s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.204978358 (20h28m57.794323345s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205294082 (20h28m57.794639069s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205596801 (20h28m57.794941788s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205860516 (20h28m57.795205503s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206100625 (20h28m57.795445612s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206346976 (20h28m57.795691953s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206562549 (20h28m57.795907536s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206764776 (20h28m57.796109753s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206972122 (20h28m57.79631711s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207357780 (20h28m57.796702777s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207757766 (20h28m57.797102763s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:59.355717999 (20h28m58.945062996s) [upload=21214]: Next returned nil segment Aug 8 06:08:59.355737837 (20h28m58.945082834s) [upload=21214]: Waiting for error group managing segments... Aug 8 06:08:59.649849433 (20h28m59.23919442s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.682717209 (20h28m59.272062196s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.709034182 (20h28m59.298379169s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.100260499 (20h28m59.689605486s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.104855691 (20h28m59.694200698s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.114024843 (20h28m59.70336982s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.121771305 (20h28m59.711116292s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.123815857 (20h28m59.713160845s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.199260396 (20h28m59.788605383s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.202036998 (20h28m59.791381985s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.206595831 (20h28m59.795940808s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.210343491 (20h28m59.799688478s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.223637637 (20h28m59.812982624s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247880111 (20h28m59.837225108s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247905569 (20h28m59.837250556s) [seg_pos={0 0}, upload=21214]: Segment reached optimal threshold of 14 pieces. Aug 8 06:09:00.248020038 (20h28m59.837365025s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248081636 (20h28m59.837426623s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248170025 (20h28m59.837515012s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248213729 (20h28m59.837558716s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248254727 (20h28m59.837599714s) [seg_pos={0 0}, upload=21214]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:09:00.248333207 (20h28m59.837678204s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:09:00.248337625 (20h28m59.837682612s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:00.584384828 (20h29m0.173729805s) [upload=21214]: Done uploading segments... Aug 8 06:09:00.584401549 (20h29m0.173746536s) [upload=21214]: Upload finished. err: <nil> Duration: 5.557249218s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 6.248576455s FAIL (2025-08-08 06:13:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.24859985s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X.X.......................X.....................XX.......] duration: 6.205707632s FAIL (2025-08-08 06:13:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Upload finished. err: <nil> Aug 8 06:08:57.749323750 (20h28m57.338668737s) [upload=21214]: Starting upload Aug 8 06:08:57.749392772 (20h28m57.33873776s) [upload=21214]: Done starting upload Aug 8 06:08:57.749531277 (20h28m57.338876264s) [upload=21214]: Uploading segments... Aug 8 06:08:57.749648722 (20h28m57.338993699s) [upload=21214]: Got next segment. Inline: false Aug 8 06:08:57.749685904 (20h28m57.339030891s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:57.749690372 (20h28m57.339035359s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:08:58.201181414 (20h28m57.790526401s) [seg_pos={0 0}, upload=21214]: Begin upload segment... Aug 8 06:08:58.201256226 (20h28m57.790601213s) [seg_pos={0 0}, upload=21214]: Done begin upload segment. Aug 8 06:08:58.201279771 (20h28m57.790624758s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201311612 (20h28m57.790656599s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201653948 (20h28m57.790998925s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201945274 (20h28m57.791290261s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.202848843 (20h28m57.79219383s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203094173 (20h28m57.79243915s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203696936 (20h28m57.793041923s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.204978358 (20h28m57.794323345s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205294082 (20h28m57.794639069s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205596801 (20h28m57.794941788s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205860516 (20h28m57.795205503s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206100625 (20h28m57.795445612s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206346976 (20h28m57.795691953s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206562549 (20h28m57.795907536s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206764776 (20h28m57.796109753s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206972122 (20h28m57.79631711s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207357780 (20h28m57.796702777s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207757766 (20h28m57.797102763s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:59.355717999 (20h28m58.945062996s) [upload=21214]: Next returned nil segment Aug 8 06:08:59.355737837 (20h28m58.945082834s) [upload=21214]: Waiting for error group managing segments... Aug 8 06:08:59.649849433 (20h28m59.23919442s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.682717209 (20h28m59.272062196s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.709034182 (20h28m59.298379169s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.100260499 (20h28m59.689605486s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.104855691 (20h28m59.694200698s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.114024843 (20h28m59.70336982s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.121771305 (20h28m59.711116292s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.123815857 (20h28m59.713160845s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.199260396 (20h28m59.788605383s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.202036998 (20h28m59.791381985s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.206595831 (20h28m59.795940808s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.210343491 (20h28m59.799688478s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.223637637 (20h28m59.812982624s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247880111 (20h28m59.837225108s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247905569 (20h28m59.837250556s) [seg_pos={0 0}, upload=21214]: Segment reached optimal threshold of 14 pieces. Aug 8 06:09:00.248020038 (20h28m59.837365025s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248081636 (20h28m59.837426623s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248170025 (20h28m59.837515012s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248213729 (20h28m59.837558716s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248254727 (20h28m59.837599714s) [seg_pos={0 0}, upload=21214]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:09:00.248333207 (20h28m59.837678204s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:09:00.248337625 (20h28m59.837682612s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:00.584384828 (20h29m0.173729805s) [upload=21214]: Done uploading segments... Aug 8 06:09:00.584401549 (20h29m0.173746536s) [upload=21214]: Upload finished. err: <nil> Duration: 6.205731847s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 6.251164909s FAIL (2025-08-08 06:13:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.251184406s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.......X......X.............X............X........X....X....] duration: 1.838097733s FAIL (2025-08-08 06:13:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.838130735s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X.X.......................X.....................XX......] duration: 7.069436252s FAIL (2025-08-08 06:12:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Upload finished. err: <nil> Aug 8 06:08:57.749323750 (20h28m57.338668737s) [upload=21214]: Starting upload Aug 8 06:08:57.749392772 (20h28m57.33873776s) [upload=21214]: Done starting upload Aug 8 06:08:57.749531277 (20h28m57.338876264s) [upload=21214]: Uploading segments... Aug 8 06:08:57.749648722 (20h28m57.338993699s) [upload=21214]: Got next segment. Inline: false Aug 8 06:08:57.749685904 (20h28m57.339030891s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:57.749690372 (20h28m57.339035359s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:08:58.201181414 (20h28m57.790526401s) [seg_pos={0 0}, upload=21214]: Begin upload segment... Aug 8 06:08:58.201256226 (20h28m57.790601213s) [seg_pos={0 0}, upload=21214]: Done begin upload segment. Aug 8 06:08:58.201279771 (20h28m57.790624758s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201311612 (20h28m57.790656599s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201653948 (20h28m57.790998925s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201945274 (20h28m57.791290261s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.202848843 (20h28m57.79219383s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203094173 (20h28m57.79243915s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203696936 (20h28m57.793041923s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.204978358 (20h28m57.794323345s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205294082 (20h28m57.794639069s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205596801 (20h28m57.794941788s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205860516 (20h28m57.795205503s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206100625 (20h28m57.795445612s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206346976 (20h28m57.795691953s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206562549 (20h28m57.795907536s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206764776 (20h28m57.796109753s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206972122 (20h28m57.79631711s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207357780 (20h28m57.796702777s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207757766 (20h28m57.797102763s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:59.355717999 (20h28m58.945062996s) [upload=21214]: Next returned nil segment Aug 8 06:08:59.355737837 (20h28m58.945082834s) [upload=21214]: Waiting for error group managing segments... Aug 8 06:08:59.649849433 (20h28m59.23919442s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.682717209 (20h28m59.272062196s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.709034182 (20h28m59.298379169s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.100260499 (20h28m59.689605486s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.104855691 (20h28m59.694200698s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.114024843 (20h28m59.70336982s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.121771305 (20h28m59.711116292s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.123815857 (20h28m59.713160845s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.199260396 (20h28m59.788605383s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.202036998 (20h28m59.791381985s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.206595831 (20h28m59.795940808s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.210343491 (20h28m59.799688478s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.223637637 (20h28m59.812982624s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247880111 (20h28m59.837225108s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247905569 (20h28m59.837250556s) [seg_pos={0 0}, upload=21214]: Segment reached optimal threshold of 14 pieces. Aug 8 06:09:00.248020038 (20h28m59.837365025s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248081636 (20h28m59.837426623s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248170025 (20h28m59.837515012s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248213729 (20h28m59.837558716s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248254727 (20h28m59.837599714s) [seg_pos={0 0}, upload=21214]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:09:00.248333207 (20h28m59.837678204s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:09:00.248337625 (20h28m59.837682612s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:00.584384828 (20h29m0.173729805s) [upload=21214]: Done uploading segments... Aug 8 06:09:00.584401549 (20h29m0.173746536s) [upload=21214]: Upload finished. err: <nil> Duration: 7.069463605s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.066591314s FAIL (2025-08-08 06:12:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.066617235s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [........X......X.............X............X........X....X...] duration: 1.830070332s FAIL (2025-08-08 06:12:09 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.830098356s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X.X.......................X.....................XX.....] duration: 5.584161255s FAIL (2025-08-08 06:11:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Upload finished. err: <nil> Aug 8 06:08:57.749323750 (20h28m57.338668737s) [upload=21214]: Starting upload Aug 8 06:08:57.749392772 (20h28m57.33873776s) [upload=21214]: Done starting upload Aug 8 06:08:57.749531277 (20h28m57.338876264s) [upload=21214]: Uploading segments... Aug 8 06:08:57.749648722 (20h28m57.338993699s) [upload=21214]: Got next segment. Inline: false Aug 8 06:08:57.749685904 (20h28m57.339030891s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:57.749690372 (20h28m57.339035359s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:08:58.201181414 (20h28m57.790526401s) [seg_pos={0 0}, upload=21214]: Begin upload segment... Aug 8 06:08:58.201256226 (20h28m57.790601213s) [seg_pos={0 0}, upload=21214]: Done begin upload segment. Aug 8 06:08:58.201279771 (20h28m57.790624758s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201311612 (20h28m57.790656599s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201653948 (20h28m57.790998925s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201945274 (20h28m57.791290261s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.202848843 (20h28m57.79219383s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203094173 (20h28m57.79243915s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203696936 (20h28m57.793041923s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.204978358 (20h28m57.794323345s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205294082 (20h28m57.794639069s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205596801 (20h28m57.794941788s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205860516 (20h28m57.795205503s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206100625 (20h28m57.795445612s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206346976 (20h28m57.795691953s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206562549 (20h28m57.795907536s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206764776 (20h28m57.796109753s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206972122 (20h28m57.79631711s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207357780 (20h28m57.796702777s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207757766 (20h28m57.797102763s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:59.355717999 (20h28m58.945062996s) [upload=21214]: Next returned nil segment Aug 8 06:08:59.355737837 (20h28m58.945082834s) [upload=21214]: Waiting for error group managing segments... Aug 8 06:08:59.649849433 (20h28m59.23919442s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.682717209 (20h28m59.272062196s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.709034182 (20h28m59.298379169s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.100260499 (20h28m59.689605486s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.104855691 (20h28m59.694200698s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.114024843 (20h28m59.70336982s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.121771305 (20h28m59.711116292s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.123815857 (20h28m59.713160845s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.199260396 (20h28m59.788605383s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.202036998 (20h28m59.791381985s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.206595831 (20h28m59.795940808s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.210343491 (20h28m59.799688478s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.223637637 (20h28m59.812982624s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247880111 (20h28m59.837225108s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247905569 (20h28m59.837250556s) [seg_pos={0 0}, upload=21214]: Segment reached optimal threshold of 14 pieces. Aug 8 06:09:00.248020038 (20h28m59.837365025s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248081636 (20h28m59.837426623s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248170025 (20h28m59.837515012s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248213729 (20h28m59.837558716s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248254727 (20h28m59.837599714s) [seg_pos={0 0}, upload=21214]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:09:00.248333207 (20h28m59.837678204s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:09:00.248337625 (20h28m59.837682612s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:00.584384828 (20h29m0.173729805s) [upload=21214]: Done uploading segments... Aug 8 06:09:00.584401549 (20h29m0.173746536s) [upload=21214]: Upload finished. err: <nil> Duration: 5.584188096s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 7.342092269s FAIL (2025-08-08 06:11:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 7.34211834s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.........X......X.............X............X........X....X..] duration: 1.840942051s FAIL (2025-08-08 06:11:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.840969694s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X.X.......................X.....................XX....] duration: 5.724121664s FAIL (2025-08-08 06:11:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Upload finished. err: <nil> Aug 8 06:08:57.749323750 (20h28m57.338668737s) [upload=21214]: Starting upload Aug 8 06:08:57.749392772 (20h28m57.33873776s) [upload=21214]: Done starting upload Aug 8 06:08:57.749531277 (20h28m57.338876264s) [upload=21214]: Uploading segments... Aug 8 06:08:57.749648722 (20h28m57.338993699s) [upload=21214]: Got next segment. Inline: false Aug 8 06:08:57.749685904 (20h28m57.339030891s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:57.749690372 (20h28m57.339035359s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:08:58.201181414 (20h28m57.790526401s) [seg_pos={0 0}, upload=21214]: Begin upload segment... Aug 8 06:08:58.201256226 (20h28m57.790601213s) [seg_pos={0 0}, upload=21214]: Done begin upload segment. Aug 8 06:08:58.201279771 (20h28m57.790624758s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201311612 (20h28m57.790656599s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201653948 (20h28m57.790998925s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201945274 (20h28m57.791290261s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.202848843 (20h28m57.79219383s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203094173 (20h28m57.79243915s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203696936 (20h28m57.793041923s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.204978358 (20h28m57.794323345s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205294082 (20h28m57.794639069s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205596801 (20h28m57.794941788s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205860516 (20h28m57.795205503s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206100625 (20h28m57.795445612s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206346976 (20h28m57.795691953s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206562549 (20h28m57.795907536s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206764776 (20h28m57.796109753s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206972122 (20h28m57.79631711s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207357780 (20h28m57.796702777s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207757766 (20h28m57.797102763s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:59.355717999 (20h28m58.945062996s) [upload=21214]: Next returned nil segment Aug 8 06:08:59.355737837 (20h28m58.945082834s) [upload=21214]: Waiting for error group managing segments... Aug 8 06:08:59.649849433 (20h28m59.23919442s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.682717209 (20h28m59.272062196s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.709034182 (20h28m59.298379169s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.100260499 (20h28m59.689605486s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.104855691 (20h28m59.694200698s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.114024843 (20h28m59.70336982s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.121771305 (20h28m59.711116292s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.123815857 (20h28m59.713160845s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.199260396 (20h28m59.788605383s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.202036998 (20h28m59.791381985s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.206595831 (20h28m59.795940808s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.210343491 (20h28m59.799688478s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.223637637 (20h28m59.812982624s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247880111 (20h28m59.837225108s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247905569 (20h28m59.837250556s) [seg_pos={0 0}, upload=21214]: Segment reached optimal threshold of 14 pieces. Aug 8 06:09:00.248020038 (20h28m59.837365025s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248081636 (20h28m59.837426623s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248170025 (20h28m59.837515012s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248213729 (20h28m59.837558716s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248254727 (20h28m59.837599714s) [seg_pos={0 0}, upload=21214]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:09:00.248333207 (20h28m59.837678204s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:09:00.248337625 (20h28m59.837682612s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:00.584384828 (20h29m0.173729805s) [upload=21214]: Done uploading segments... Aug 8 06:09:00.584401549 (20h29m0.173746536s) [upload=21214]: Upload finished. err: <nil> Duration: 5.72414539s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 6.358412388s FAIL (2025-08-08 06:11:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.35843911s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X.X.......................X.....................XX...] duration: 5.631934392s FAIL (2025-08-08 06:10:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Upload finished. err: <nil> Aug 8 06:08:57.749323750 (20h28m57.338668737s) [upload=21214]: Starting upload Aug 8 06:08:57.749392772 (20h28m57.33873776s) [upload=21214]: Done starting upload Aug 8 06:08:57.749531277 (20h28m57.338876264s) [upload=21214]: Uploading segments... Aug 8 06:08:57.749648722 (20h28m57.338993699s) [upload=21214]: Got next segment. Inline: false Aug 8 06:08:57.749685904 (20h28m57.339030891s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:57.749690372 (20h28m57.339035359s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:08:58.201181414 (20h28m57.790526401s) [seg_pos={0 0}, upload=21214]: Begin upload segment... Aug 8 06:08:58.201256226 (20h28m57.790601213s) [seg_pos={0 0}, upload=21214]: Done begin upload segment. Aug 8 06:08:58.201279771 (20h28m57.790624758s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201311612 (20h28m57.790656599s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201653948 (20h28m57.790998925s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201945274 (20h28m57.791290261s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.202848843 (20h28m57.79219383s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203094173 (20h28m57.79243915s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203696936 (20h28m57.793041923s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.204978358 (20h28m57.794323345s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205294082 (20h28m57.794639069s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205596801 (20h28m57.794941788s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205860516 (20h28m57.795205503s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206100625 (20h28m57.795445612s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206346976 (20h28m57.795691953s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206562549 (20h28m57.795907536s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206764776 (20h28m57.796109753s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206972122 (20h28m57.79631711s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207357780 (20h28m57.796702777s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207757766 (20h28m57.797102763s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:59.355717999 (20h28m58.945062996s) [upload=21214]: Next returned nil segment Aug 8 06:08:59.355737837 (20h28m58.945082834s) [upload=21214]: Waiting for error group managing segments... Aug 8 06:08:59.649849433 (20h28m59.23919442s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.682717209 (20h28m59.272062196s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.709034182 (20h28m59.298379169s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.100260499 (20h28m59.689605486s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.104855691 (20h28m59.694200698s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.114024843 (20h28m59.70336982s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.121771305 (20h28m59.711116292s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.123815857 (20h28m59.713160845s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.199260396 (20h28m59.788605383s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.202036998 (20h28m59.791381985s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.206595831 (20h28m59.795940808s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.210343491 (20h28m59.799688478s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.223637637 (20h28m59.812982624s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247880111 (20h28m59.837225108s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247905569 (20h28m59.837250556s) [seg_pos={0 0}, upload=21214]: Segment reached optimal threshold of 14 pieces. Aug 8 06:09:00.248020038 (20h28m59.837365025s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248081636 (20h28m59.837426623s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248170025 (20h28m59.837515012s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248213729 (20h28m59.837558716s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248254727 (20h28m59.837599714s) [seg_pos={0 0}, upload=21214]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:09:00.248333207 (20h28m59.837678204s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:09:00.248337625 (20h28m59.837682612s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:00.584384828 (20h29m0.173729805s) [upload=21214]: Done uploading segments... Aug 8 06:09:00.584401549 (20h29m0.173746536s) [upload=21214]: Upload finished. err: <nil> Duration: 5.63195933s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..........X......X.............X............X........X....X.] duration: 1.811236014s FAIL (2025-08-08 06:10:43 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.811298964s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 6.194815515s FAIL (2025-08-08 06:10:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.194837688s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [........X.X.......................X.....................XX..] duration: 5.877895398s FAIL (2025-08-08 06:10:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Upload finished. err: <nil> Aug 8 06:08:57.749323750 (20h28m57.338668737s) [upload=21214]: Starting upload Aug 8 06:08:57.749392772 (20h28m57.33873776s) [upload=21214]: Done starting upload Aug 8 06:08:57.749531277 (20h28m57.338876264s) [upload=21214]: Uploading segments... Aug 8 06:08:57.749648722 (20h28m57.338993699s) [upload=21214]: Got next segment. Inline: false Aug 8 06:08:57.749685904 (20h28m57.339030891s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:57.749690372 (20h28m57.339035359s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:08:58.201181414 (20h28m57.790526401s) [seg_pos={0 0}, upload=21214]: Begin upload segment... Aug 8 06:08:58.201256226 (20h28m57.790601213s) [seg_pos={0 0}, upload=21214]: Done begin upload segment. Aug 8 06:08:58.201279771 (20h28m57.790624758s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201311612 (20h28m57.790656599s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201653948 (20h28m57.790998925s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201945274 (20h28m57.791290261s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.202848843 (20h28m57.79219383s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203094173 (20h28m57.79243915s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203696936 (20h28m57.793041923s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.204978358 (20h28m57.794323345s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205294082 (20h28m57.794639069s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205596801 (20h28m57.794941788s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205860516 (20h28m57.795205503s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206100625 (20h28m57.795445612s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206346976 (20h28m57.795691953s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206562549 (20h28m57.795907536s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206764776 (20h28m57.796109753s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206972122 (20h28m57.79631711s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207357780 (20h28m57.796702777s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207757766 (20h28m57.797102763s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:59.355717999 (20h28m58.945062996s) [upload=21214]: Next returned nil segment Aug 8 06:08:59.355737837 (20h28m58.945082834s) [upload=21214]: Waiting for error group managing segments... Aug 8 06:08:59.649849433 (20h28m59.23919442s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.682717209 (20h28m59.272062196s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.709034182 (20h28m59.298379169s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.100260499 (20h28m59.689605486s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.104855691 (20h28m59.694200698s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.114024843 (20h28m59.70336982s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.121771305 (20h28m59.711116292s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.123815857 (20h28m59.713160845s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.199260396 (20h28m59.788605383s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.202036998 (20h28m59.791381985s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.206595831 (20h28m59.795940808s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.210343491 (20h28m59.799688478s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.223637637 (20h28m59.812982624s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247880111 (20h28m59.837225108s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247905569 (20h28m59.837250556s) [seg_pos={0 0}, upload=21214]: Segment reached optimal threshold of 14 pieces. Aug 8 06:09:00.248020038 (20h28m59.837365025s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248081636 (20h28m59.837426623s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248170025 (20h28m59.837515012s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248213729 (20h28m59.837558716s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248254727 (20h28m59.837599714s) [seg_pos={0 0}, upload=21214]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:09:00.248333207 (20h28m59.837678204s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:09:00.248337625 (20h28m59.837682612s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:00.584384828 (20h29m0.173729805s) [upload=21214]: Done uploading segments... Aug 8 06:09:00.584401549 (20h29m0.173746536s) [upload=21214]: Upload finished. err: <nil> Duration: 5.877921989s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [X..........X......X.............X............X........X....X] duration: 1.395107943s FAIL (2025-08-08 06:09:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 3]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Aug 8 06:07:22.254451561 (20h27m21.843796548s) [upload=21185]: Starting upload Aug 8 06:07:22.254494954 (20h27m21.843839941s) [upload=21185]: Done starting upload Aug 8 06:07:22.254541172 (20h27m21.843886159s) [upload=21185]: Uploading segments... Aug 8 06:07:22.254572322 (20h27m21.843917309s) [upload=21185]: Got next segment. Inline: true Aug 8 06:07:22.254576750 (20h27m21.843921727s) [upload=21185]: Waiting for error group managing segments... Aug 8 06:07:22.254609363 (20h27m21.84395434s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:22.254613711 (20h27m21.843958698s) [upload=21185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:22.254616176 (20h27m21.843961163s) [upload=21185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:22.527167141 (20h27m22.116512129s) [upload=21185]: Done uploading segments... Aug 8 06:07:22.527184113 (20h27m22.1165291s) [upload=21185]: Upload finished. err: <nil> Aug 8 06:07:46.857727381 (20h27m46.447072368s) [upload=21194]: Starting upload Aug 8 06:07:46.857828454 (20h27m46.447173441s) [upload=21194]: Done starting upload Aug 8 06:07:46.857908598 (20h27m46.447253645s) [upload=21194]: Uploading segments... Aug 8 06:07:46.857963142 (20h27m46.447308199s) [upload=21194]: Got next segment. Inline: true Aug 8 06:07:46.857970827 (20h27m46.447315824s) [upload=21194]: Waiting for error group managing segments... Aug 8 06:07:46.858024780 (20h27m46.447369837s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:46.858031873 (20h27m46.44737687s) [upload=21194]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:07:46.858039588 (20h27m46.447384585s) [upload=21194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:47.149163187 (20h27m46.738508174s) [upload=21194]: Done uploading segments... Aug 8 06:07:47.149180380 (20h27m46.738525367s) [upload=21194]: Upload finished. err: <nil> Aug 8 06:08:42.834382781 (20h28m42.423727768s) [upload=21210]: Starting upload Aug 8 06:08:42.834426955 (20h28m42.423771942s) [upload=21210]: Done starting upload Aug 8 06:08:42.834474927 (20h28m42.423819904s) [upload=21210]: Uploading segments... Aug 8 06:08:42.834504474 (20h28m42.423849461s) [upload=21210]: Got next segment. Inline: true Aug 8 06:08:42.834508201 (20h28m42.423853188s) [upload=21210]: Waiting for error group managing segments... Aug 8 06:08:42.834538368 (20h28m42.423883355s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:42.834542297 (20h28m42.423887284s) [upload=21210]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:08:42.834544711 (20h28m42.423889698s) [upload=21210]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:08:43.116846072 (20h28m42.706191059s) [upload=21210]: Done uploading segments... Aug 8 06:08:43.116864106 (20h28m42.706209083s) [upload=21210]: Upload finished. err: <nil> Aug 8 06:09:26.568540071 (20h29m26.157885058s) [upload=21222]: Starting upload Aug 8 06:09:26.568589085 (20h29m26.157934062s) [upload=21222]: Done starting upload Aug 8 06:09:26.568648869 (20h29m26.157993856s) [upload=21222]: Uploading segments... Aug 8 06:09:26.568677755 (20h29m26.158022732s) [upload=21222]: Got next segment. Inline: true Aug 8 06:09:26.568681513 (20h29m26.1580265s) [upload=21222]: Waiting for error group managing segments... Aug 8 06:09:26.568714716 (20h29m26.158059703s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:26.568718884 (20h29m26.158063871s) [upload=21222]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:26.568721509 (20h29m26.158066496s) [upload=21222]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:26.864644220 (20h29m26.453989207s) [upload=21222]: Done uploading segments... Aug 8 06:09:26.864664109 (20h29m26.454009096s) [upload=21222]: Upload finished. err: <nil> Aug 8 06:09:57.735847704 (20h29m57.325192692s) [upload=21232]: Starting upload Aug 8 06:09:57.735894755 (20h29m57.325239742s) [upload=21232]: Done starting upload Aug 8 06:09:57.735951714 (20h29m57.325296691s) [upload=21232]: Uploading segments... Aug 8 06:09:57.735998874 (20h29m57.325343861s) [upload=21232]: Got next segment. Inline: true Aug 8 06:09:57.736003192 (20h29m57.325348179s) [upload=21232]: Waiting for error group managing segments... Aug 8 06:09:57.736037608 (20h29m57.325382595s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:09:57.736042467 (20h29m57.325387454s) [upload=21232]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:09:57.736044672 (20h29m57.325389659s) [upload=21232]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:58.022557780 (20h29m57.611902767s) [upload=21232]: Done uploading segments... Aug 8 06:09:58.022573971 (20h29m57.611918958s) [upload=21232]: Upload finished. err: <nil> Duration: 1.395132419s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........X.X.......................X.....................XX.] duration: 5.511377319s FAIL (2025-08-08 06:09:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Upload finished. err: <nil> Aug 8 06:08:57.749323750 (20h28m57.338668737s) [upload=21214]: Starting upload Aug 8 06:08:57.749392772 (20h28m57.33873776s) [upload=21214]: Done starting upload Aug 8 06:08:57.749531277 (20h28m57.338876264s) [upload=21214]: Uploading segments... Aug 8 06:08:57.749648722 (20h28m57.338993699s) [upload=21214]: Got next segment. Inline: false Aug 8 06:08:57.749685904 (20h28m57.339030891s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:57.749690372 (20h28m57.339035359s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:08:58.201181414 (20h28m57.790526401s) [seg_pos={0 0}, upload=21214]: Begin upload segment... Aug 8 06:08:58.201256226 (20h28m57.790601213s) [seg_pos={0 0}, upload=21214]: Done begin upload segment. Aug 8 06:08:58.201279771 (20h28m57.790624758s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201311612 (20h28m57.790656599s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201653948 (20h28m57.790998925s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201945274 (20h28m57.791290261s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.202848843 (20h28m57.79219383s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203094173 (20h28m57.79243915s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203696936 (20h28m57.793041923s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.204978358 (20h28m57.794323345s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205294082 (20h28m57.794639069s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205596801 (20h28m57.794941788s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205860516 (20h28m57.795205503s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206100625 (20h28m57.795445612s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206346976 (20h28m57.795691953s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206562549 (20h28m57.795907536s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206764776 (20h28m57.796109753s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206972122 (20h28m57.79631711s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207357780 (20h28m57.796702777s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207757766 (20h28m57.797102763s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:59.355717999 (20h28m58.945062996s) [upload=21214]: Next returned nil segment Aug 8 06:08:59.355737837 (20h28m58.945082834s) [upload=21214]: Waiting for error group managing segments... Aug 8 06:08:59.649849433 (20h28m59.23919442s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.682717209 (20h28m59.272062196s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.709034182 (20h28m59.298379169s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.100260499 (20h28m59.689605486s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.104855691 (20h28m59.694200698s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.114024843 (20h28m59.70336982s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.121771305 (20h28m59.711116292s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.123815857 (20h28m59.713160845s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.199260396 (20h28m59.788605383s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.202036998 (20h28m59.791381985s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.206595831 (20h28m59.795940808s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.210343491 (20h28m59.799688478s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.223637637 (20h28m59.812982624s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247880111 (20h28m59.837225108s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247905569 (20h28m59.837250556s) [seg_pos={0 0}, upload=21214]: Segment reached optimal threshold of 14 pieces. Aug 8 06:09:00.248020038 (20h28m59.837365025s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248081636 (20h28m59.837426623s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248170025 (20h28m59.837515012s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248213729 (20h28m59.837558716s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248254727 (20h28m59.837599714s) [seg_pos={0 0}, upload=21214]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:09:00.248333207 (20h28m59.837678204s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:09:00.248337625 (20h28m59.837682612s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:00.584384828 (20h29m0.173729805s) [upload=21214]: Done uploading segments... Aug 8 06:09:00.584401549 (20h29m0.173746536s) [upload=21214]: Upload finished. err: <nil> Duration: 5.511441832s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.X..........X......X.............X............X........X....] duration: 1.877891938s FAIL (2025-08-08 06:09:27 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Aug 8 06:01:37.986483141 (20h21m37.575828158s) [upload=21092]: Starting upload Aug 8 06:01:37.986576620 (20h21m37.575921597s) [upload=21092]: Done starting upload Aug 8 06:01:37.986640021 (20h21m37.575985088s) [upload=21092]: Uploading segments... Aug 8 06:01:37.986703933 (20h21m37.57604892s) [upload=21092]: Got next segment. Inline: true Aug 8 06:01:37.986709013 (20h21m37.576054s) [upload=21092]: Waiting for error group managing segments... Aug 8 06:01:37.986745603 (20h21m37.57609059s) [upload=21092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:37.986749901 (20h21m37.576094878s) [upload=21092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:37.986752807 (20h21m37.576097794s) [upload=21092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:38.252261658 (20h21m37.841606645s) [upload=21092]: Done uploading segments... Aug 8 06:01:38.252277178 (20h21m37.841622165s) [upload=21092]: Upload finished. err: <nil> Aug 8 06:02:26.619669407 (20h22m26.209014394s) [upload=21104]: Starting upload Aug 8 06:02:26.619708563 (20h22m26.20905354s) [upload=21104]: Done starting upload Aug 8 06:02:26.619756935 (20h22m26.209101912s) [upload=21104]: Uploading segments... Aug 8 06:02:26.619785379 (20h22m26.209130366s) [upload=21104]: Got next segment. Inline: true Aug 8 06:02:26.619788816 (20h22m26.209133804s) [upload=21104]: Waiting for error group managing segments... Aug 8 06:02:26.619820136 (20h22m26.209165113s) [upload=21104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:02:26.619824024 (20h22m26.209169011s) [upload=21104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:02:26.619826458 (20h22m26.209171445s) [upload=21104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:02:26.964000279 (20h22m26.553345266s) [upload=21104]: Done uploading segments... Aug 8 06:02:26.964016459 (20h22m26.553361446s) [upload=21104]: Upload finished. err: <nil> Aug 8 06:03:26.281167800 (20h23m25.870512787s) [upload=21119]: Starting upload Aug 8 06:03:26.281216803 (20h23m25.87056179s) [upload=21119]: Done starting upload Aug 8 06:03:26.281267360 (20h23m25.870612337s) [upload=21119]: Uploading segments... Aug 8 06:03:26.281298389 (20h23m25.870643376s) [upload=21119]: Got next segment. Inline: true Aug 8 06:03:26.281302347 (20h23m25.870647334s) [upload=21119]: Waiting for error group managing segments... Aug 8 06:03:26.281334770 (20h23m25.870679747s) [upload=21119]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:03:26.281338837 (20h23m25.870683814s) [upload=21119]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:03:26.281341202 (20h23m25.870686189s) [upload=21119]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:03:26.746110970 (20h23m26.335455957s) [upload=21119]: Done uploading segments... Aug 8 06:03:26.746129696 (20h23m26.335474683s) [upload=21119]: Upload finished. err: <nil> Aug 8 06:03:42.106238303 (20h23m41.69558329s) [upload=21123]: Starting upload Aug 8 06:03:42.106286295 (20h23m41.695631283s) [upload=21123]: Done starting upload Aug 8 06:03:42.106336652 (20h23m41.695681629s) [upload=21123]: Uploading segments... Aug 8 06:03:42.106366679 (20h23m41.695711676s) [upload=21123]: Got next segment. Inline: true Aug 8 06:03:42.106370577 (20h23m41.695715554s) [upload=21123]: Waiting for error group managing segments... Aug 8 06:03:42.106401967 (20h23m41.695746954s) [upload=21123]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:03:42.106405835 (20h23m41.695750822s) [upload=21123]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:03:42.106408029 (20h23m41.695753016s) [upload=21123]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:03:42.377020835 (20h23m41.966365832s) [upload=21123]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Duration: 1.877920653s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 6.144218898s FAIL (2025-08-08 06:09:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.144275426s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..........X.X.......................X.....................XX] duration: 3.941341824s FAIL (2025-08-08 06:09:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Upload finished. err: <nil> Aug 8 06:08:57.749323750 (20h28m57.338668737s) [upload=21214]: Starting upload Aug 8 06:08:57.749392772 (20h28m57.33873776s) [upload=21214]: Done starting upload Aug 8 06:08:57.749531277 (20h28m57.338876264s) [upload=21214]: Uploading segments... Aug 8 06:08:57.749648722 (20h28m57.338993699s) [upload=21214]: Got next segment. Inline: false Aug 8 06:08:57.749685904 (20h28m57.339030891s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:08:57.749690372 (20h28m57.339035359s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:08:58.201181414 (20h28m57.790526401s) [seg_pos={0 0}, upload=21214]: Begin upload segment... Aug 8 06:08:58.201256226 (20h28m57.790601213s) [seg_pos={0 0}, upload=21214]: Done begin upload segment. Aug 8 06:08:58.201279771 (20h28m57.790624758s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201311612 (20h28m57.790656599s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201653948 (20h28m57.790998925s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.201945274 (20h28m57.791290261s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.202848843 (20h28m57.79219383s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203094173 (20h28m57.79243915s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.203696936 (20h28m57.793041923s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.204978358 (20h28m57.794323345s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205294082 (20h28m57.794639069s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205596801 (20h28m57.794941788s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.205860516 (20h28m57.795205503s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206100625 (20h28m57.795445612s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206346976 (20h28m57.795691953s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206562549 (20h28m57.795907536s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206764776 (20h28m57.796109753s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.206972122 (20h28m57.79631711s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207357780 (20h28m57.796702777s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:58.207757766 (20h28m57.797102763s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Uploading piece... Aug 8 06:08:59.355717999 (20h28m58.945062996s) [upload=21214]: Next returned nil segment Aug 8 06:08:59.355737837 (20h28m58.945082834s) [upload=21214]: Waiting for error group managing segments... Aug 8 06:08:59.649849433 (20h28m59.23919442s) [noise=true , address=64.49.13.137:4497 , piece_id=652ZAYKAOG26IAPY2YH7TYVCEIQJVIWUCG3ML6NIJ2MS7SVXNDQA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.682717209 (20h28m59.272062196s) [noise=true , address=64.49.13.26:4956 , piece_id=JZ722OKMZ6TOXBVSIDYTVC2DY5TISWIVB5KW64NDCASOUTLUZ3LQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:08:59.709034182 (20h28m59.298379169s) [noise=true , address=193.149.164.143:4697 , piece_id=VNFRL2FYHEPMVYPAC5IANN2XYVTJ2IUZWH2CSYCXEGI76AY4VCLQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.100260499 (20h28m59.689605486s) [noise=true , address=104.36.82.23:4457 , piece_id=AI3GVD7VMCFHM2D5PJF7SPDICS3ZN6PTZIU3EZLL2BJAVN7QEV5Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.104855691 (20h28m59.694200698s) [noise=true , address=104.36.82.54:4173 , piece_id=YAKTKQCYQUN352UPQUCUZL6YVROC2NBWGBZKJZ6PXSN6DCRZLUTA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.114024843 (20h28m59.70336982s) [noise=true , address=104.36.82.41:4789 , piece_id=SH66XBAYXK7WZXCRQGWS52GPDTG6R47DOZAWZUOPOSBPGY4HLMYQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.121771305 (20h28m59.711116292s) [noise=true , address=104.36.82.39:4759 , piece_id=5PJGZP5EABHGP6DSJZZGCYLNCXVUHCURIN4UWMMUHVSDQAMRU2ZQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.123815857 (20h28m59.713160845s) [noise=true , address=104.36.82.60:4372 , piece_id=XGUFVZGQHIFNK3E5SIL2RHSO53WWVR2O4WYRLLDLM5N5BTB4SLHQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.199260396 (20h28m59.788605383s) [noise=true , address=104.36.82.9:4037 , piece_id=ENIOJ4DG3OVZJQPHIRMHVVYIJ2IGHZZKZQMOU7G54HM4LPFT4FCQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.202036998 (20h28m59.791381985s) [noise=true , address=104.36.82.11:4132 , piece_id=QS27UX3Z2X5D4J4QJUPASOVIYWF7DNN3H4SSGGQZFJIEDZHFN36Q, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.206595831 (20h28m59.795940808s) [noise=true , address=104.36.82.61:4392 , piece_id=GKR2MVRKLFK3X4BZGBKPFZTWQ6PYQAYCNYSG6WG7AJE5FKKPRAEQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.210343491 (20h28m59.799688478s) [noise=true , address=104.36.82.44:4873 , piece_id=CVKVIOBOFPTX2XO2FZYLWVRJ4KPK2HR3GMVEXDR3KMRI7Y6ZQF5A, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.223637637 (20h28m59.812982624s) [noise=true , address=104.36.82.62:4432 , piece_id=E7XVTCORFTVORP5JLMIPQLVW44R7MHIVIGPJQJDHNJWSZ7EH6PSA, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247880111 (20h28m59.837225108s) [noise=true , address=104.36.82.37:4671 , piece_id=AKL35C563IT54XGQYWD3ADYUA47VBRM3CWNOCMXQUQZWPLR26RFQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: <nil> Aug 8 06:09:00.247905569 (20h28m59.837250556s) [seg_pos={0 0}, upload=21214]: Segment reached optimal threshold of 14 pieces. Aug 8 06:09:00.248020038 (20h28m59.837365025s) [noise=true , address=104.36.82.58:4294 , piece_id=RHUGFPR4SOQMSIVSD5V24EQURO4QZW5A23IMFWHIXEAJALHWESXQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12THzQNaXbHuTNCv3CAi8aG31YeFfPW5xe6JveSqKJWyGuHhffW): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248081636 (20h28m59.837426623s) [noise=true , address=104.36.82.47:4526 , piece_id=5BDMJYFY2JNPKUDOAXVAYMY42QNLHQDUKEKCNRXNYILHSZ2U3VAQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1djnDo1bR9DZLEAHGJGoaxg895sQ3tQpYmPgGXpmsAxnpAtQwk): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248170025 (20h28m59.837515012s) [noise=true , address=104.36.82.59:4336 , piece_id=QKZYEH667OAW5NVV4P2ZKH5YAI4TTZZJRFKIVCG3RKGRWE3UANRQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12W6uY3xtjFp52F1Q3PwjX8Xb53NPcZxxf3KbxhRafAL6Prm4u5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248213729 (20h28m59.837558716s) [noise=true , address=104.36.82.6:4890 , piece_id=435Q7GNBW5H3ZDJVDI2T5TV5XOKXWEYX3L46KK6V3PGZ7JKIKBKQ, seg_pos={0 0}, upload=21214]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gakF2Cctzc6EhFScfLfBHJdcDHqMBcey4mNoToEwbtk8Pwix5): protocol: expected piece hash; context canceled; EOF Aug 8 06:09:00.248254727 (20h28m59.837599714s) [seg_pos={0 0}, upload=21214]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:09:00.248333207 (20h28m59.837678204s) [upload=21214]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:09:00.248337625 (20h28m59.837682612s) [upload=21214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:09:00.584384828 (20h29m0.173729805s) [upload=21214]: Done uploading segments... Aug 8 06:09:00.584401549 (20h29m0.173746536s) [upload=21214]: Upload finished. err: <nil> Duration: 3.941368144s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..X..........X......X.............X............X........X...] duration: 1.836949104s FAIL (2025-08-08 06:08:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Aug 8 06:01:37.986483141 (20h21m37.575828158s) [upload=21092]: Starting upload Aug 8 06:01:37.986576620 (20h21m37.575921597s) [upload=21092]: Done starting upload Aug 8 06:01:37.986640021 (20h21m37.575985088s) [upload=21092]: Uploading segments... Aug 8 06:01:37.986703933 (20h21m37.57604892s) [upload=21092]: Got next segment. Inline: true Aug 8 06:01:37.986709013 (20h21m37.576054s) [upload=21092]: Waiting for error group managing segments... Aug 8 06:01:37.986745603 (20h21m37.57609059s) [upload=21092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:37.986749901 (20h21m37.576094878s) [upload=21092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:37.986752807 (20h21m37.576097794s) [upload=21092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:38.252261658 (20h21m37.841606645s) [upload=21092]: Done uploading segments... Aug 8 06:01:38.252277178 (20h21m37.841622165s) [upload=21092]: Upload finished. err: <nil> Aug 8 06:02:26.619669407 (20h22m26.209014394s) [upload=21104]: Starting upload Aug 8 06:02:26.619708563 (20h22m26.20905354s) [upload=21104]: Done starting upload Aug 8 06:02:26.619756935 (20h22m26.209101912s) [upload=21104]: Uploading segments... Aug 8 06:02:26.619785379 (20h22m26.209130366s) [upload=21104]: Got next segment. Inline: true Aug 8 06:02:26.619788816 (20h22m26.209133804s) [upload=21104]: Waiting for error group managing segments... Aug 8 06:02:26.619820136 (20h22m26.209165113s) [upload=21104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:02:26.619824024 (20h22m26.209169011s) [upload=21104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:02:26.619826458 (20h22m26.209171445s) [upload=21104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:02:26.964000279 (20h22m26.553345266s) [upload=21104]: Done uploading segments... Aug 8 06:02:26.964016459 (20h22m26.553361446s) [upload=21104]: Upload finished. err: <nil> Aug 8 06:03:26.281167800 (20h23m25.870512787s) [upload=21119]: Starting upload Aug 8 06:03:26.281216803 (20h23m25.87056179s) [upload=21119]: Done starting upload Aug 8 06:03:26.281267360 (20h23m25.870612337s) [upload=21119]: Uploading segments... Aug 8 06:03:26.281298389 (20h23m25.870643376s) [upload=21119]: Got next segment. Inline: true Aug 8 06:03:26.281302347 (20h23m25.870647334s) [upload=21119]: Waiting for error group managing segments... Aug 8 06:03:26.281334770 (20h23m25.870679747s) [upload=21119]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:03:26.281338837 (20h23m25.870683814s) [upload=21119]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:03:26.281341202 (20h23m25.870686189s) [upload=21119]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:03:26.746110970 (20h23m26.335455957s) [upload=21119]: Done uploading segments... Aug 8 06:03:26.746129696 (20h23m26.335474683s) [upload=21119]: Upload finished. err: <nil> Aug 8 06:03:42.106238303 (20h23m41.69558329s) [upload=21123]: Starting upload Aug 8 06:03:42.106286295 (20h23m41.695631283s) [upload=21123]: Done starting upload Aug 8 06:03:42.106336652 (20h23m41.695681629s) [upload=21123]: Uploading segments... Aug 8 06:03:42.106366679 (20h23m41.695711676s) [upload=21123]: Got next segment. Inline: true Aug 8 06:03:42.106370577 (20h23m41.695715554s) [upload=21123]: Waiting for error group managing segments... Aug 8 06:03:42.106401967 (20h23m41.695746954s) [upload=21123]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:03:42.106405835 (20h23m41.695750822s) [upload=21123]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:03:42.106408029 (20h23m41.695753016s) [upload=21123]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:03:42.377020835 (20h23m41.966365832s) [upload=21123]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Duration: 1.836979342s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.824897463s FAIL (2025-08-08 06:08:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.825211775s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X.X.......................X.....................X] duration: 5.656349484s FAIL (2025-08-08 06:07:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b42d321eee4dd51e3ffda65a1b4adca90f0ec6686cd9ab323f3c1b73597e405c != before ce39bd7b0d0b135be47cc7056ce05c005a4554dd431496211ea83f2182070b59 ======LOGS====== oad finished. err: <nil> Aug 8 06:07:44.018969027 (20h27m43.608314014s) [upload=21193]: Starting upload Aug 8 06:07:44.019015506 (20h27m43.608360483s) [upload=21193]: Done starting upload Aug 8 06:07:44.019104987 (20h27m43.608449974s) [upload=21193]: Uploading segments... Aug 8 06:07:44.019224356 (20h27m43.608569343s) [upload=21193]: Got next segment. Inline: false Aug 8 06:07:44.019272368 (20h27m43.608617355s) [upload=21193]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:07:44.019277257 (20h27m43.608622234s) [upload=21193]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 06:07:44.471494690 (20h27m44.060839687s) [seg_pos={0 0}, upload=21193]: Begin upload segment... Aug 8 06:07:44.471567719 (20h27m44.060912706s) [seg_pos={0 0}, upload=21193]: Done begin upload segment. Aug 8 06:07:44.471597476 (20h27m44.060942463s) [noise=true , address=104.36.82.14:4246 , piece_id=VCSHEVBRJMGYWAWHBQC6FNYXOPAUHTYFKYG3WPRXAUZC2ULS2WMA, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.472086702 (20h27m44.061431689s) [noise=true , address=104.36.82.9:4033 , piece_id=HGGSTIZD577RKIOMCY4XREUFVY4Z2IPMFKP633QOWERGWOTIZ6UQ, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.472544478 (20h27m44.061889455s) [noise=true , address=64.49.13.26:4954 , piece_id=X4MKVZZOPNIIPCQWHHHZKIGKHP22NX7PDEA4266ACJBD7TS7T5EA, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.472933062 (20h27m44.062278049s) [noise=true , address=45.91.116.9:4279 , piece_id=JUVBRIZMALPXY4TOOYOGLLBMO7II3FENFKZASH7JXKB6K2ZLFNSQ, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.473247003 (20h27m44.06259199s) [noise=true , address=104.36.82.36:4622 , piece_id=WRHWIU7JGTCE3RLJN4IACGOTG3BSLLNMIRVCGE7L2RTWXG66KQXA, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.473655915 (20h27m44.063000902s) [noise=true , address=104.36.82.16:4309 , piece_id=QDL5VPO76Z2UOBGCIKE3U7H7NMJXY4MVAGBBUOYXQJZULEIVEIXQ, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.474061160 (20h27m44.063406147s) [noise=true , address=64.49.13.155:4917 , piece_id=GYEW4G6VMC2RO5YEHYE5AUNPF37OD6NVHXKATPSF7WRNZLYDG5GQ, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.474360673 (20h27m44.06370566s) [noise=true , address=64.49.13.140:4515 , piece_id=HWLQ4UZVUT6NANUV3TYO4Y2OTOO6VTOAQLJYCTHU64GFMKMOT65Q, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.474682780 (20h27m44.064027767s) [noise=true , address=104.36.82.37:4665 , piece_id=Z2RA4EUZIQXFSTWD3IGB7WJYEPFYFTIYJJSLAG5TYUCXZWZT2W7A, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.474890537 (20h27m44.064235514s) [noise=true , address=104.36.82.46:4504 , piece_id=URMAPQKFZDL6DLXC5E7MYMI72SF4A35HTGSDAF2QSCH4BRPNQVXQ, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.475094457 (20h27m44.064439444s) [noise=true , address=45.91.116.13:4173 , piece_id=RHDHQHTNEN6KZT437OVF4WQAKWPBH7BCVQHP454S6MRRZNQYP7JQ, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.475288659 (20h27m44.064633646s) [noise=true , address=104.36.82.47:4540 , piece_id=RPTV6MCUG7PVWOYJD3HD6LEQK7XMXTP4YRI4AUBQQIB4XRJ77TMQ, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.475503380 (20h27m44.064848357s) [noise=true , address=104.36.82.60:4345 , piece_id=DOOPWKPPDSJUVBUBNUNEQSKAWSOTHEFAT34LTL53CRRRWI6NYGEQ, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.475740373 (20h27m44.06508535s) [noise=true , address=104.36.82.59:4329 , piece_id=P2M7FFPITQ7NHY6VBGGU3ITOULIQKDRLJSBPGPCLF45OTUFYDWVA, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.475934254 (20h27m44.065279231s) [noise=true , address=64.49.13.169:4713 , piece_id=EINKKJW6HJKLB4LEJS2K2FTAIZW4GP3MBOKG266PZWPSGH2EKH4Q, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.476134467 (20h27m44.065479444s) [noise=true , address=64.49.13.154:4936 , piece_id=7HS2RVPYNWPY256T43KBVOG5M6QOTCCXELBLBMOYLBJ4UOURQKYA, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.476354047 (20h27m44.065699035s) [noise=true , address=104.36.82.61:4405 , piece_id=HMMO2STC5TG6G2H64IH7DRL2KRN35OELM7NGV6LA2UETYGWQ7MXQ, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:44.476573888 (20h27m44.065918875s) [noise=true , address=104.36.82.37:4683 , piece_id=5V3S5VPBPLRH5B2MRYGW6EID6KSLHS4OO7KGVMIAJRMNTXSY532A, seg_pos={0 0}, upload=21193]: Uploading piece... Aug 8 06:07:45.576367332 (20h27m45.165712319s) [upload=21193]: Next returned nil segment Aug 8 06:07:45.576385547 (20h27m45.165730534s) [upload=21193]: Waiting for error group managing segments... Aug 8 06:07:45.874018320 (20h27m45.463363307s) [noise=true , address=64.49.13.26:4954 , piece_id=X4MKVZZOPNIIPCQWHHHZKIGKHP22NX7PDEA4266ACJBD7TS7T5EA, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:45.903890916 (20h27m45.493235903s) [noise=true , address=64.49.13.169:4713 , piece_id=EINKKJW6HJKLB4LEJS2K2FTAIZW4GP3MBOKG266PZWPSGH2EKH4Q, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:45.907427884 (20h27m45.496772871s) [noise=true , address=64.49.13.155:4917 , piece_id=GYEW4G6VMC2RO5YEHYE5AUNPF37OD6NVHXKATPSF7WRNZLYDG5GQ, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:45.917409692 (20h27m45.506754679s) [noise=true , address=64.49.13.154:4936 , piece_id=7HS2RVPYNWPY256T43KBVOG5M6QOTCCXELBLBMOYLBJ4UOURQKYA, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:45.928972685 (20h27m45.518317662s) [noise=true , address=64.49.13.140:4515 , piece_id=HWLQ4UZVUT6NANUV3TYO4Y2OTOO6VTOAQLJYCTHU64GFMKMOT65Q, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:46.366319755 (20h27m45.955664742s) [noise=true , address=45.91.116.9:4279 , piece_id=JUVBRIZMALPXY4TOOYOGLLBMO7II3FENFKZASH7JXKB6K2ZLFNSQ, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:46.382636254 (20h27m45.971981231s) [noise=true , address=104.36.82.37:4665 , piece_id=Z2RA4EUZIQXFSTWD3IGB7WJYEPFYFTIYJJSLAG5TYUCXZWZT2W7A, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:46.383964365 (20h27m45.973309352s) [noise=true , address=104.36.82.46:4504 , piece_id=URMAPQKFZDL6DLXC5E7MYMI72SF4A35HTGSDAF2QSCH4BRPNQVXQ, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:46.385962809 (20h27m45.975307796s) [noise=true , address=104.36.82.60:4345 , piece_id=DOOPWKPPDSJUVBUBNUNEQSKAWSOTHEFAT34LTL53CRRRWI6NYGEQ, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:46.390691817 (20h27m45.980036804s) [noise=true , address=104.36.82.61:4405 , piece_id=HMMO2STC5TG6G2H64IH7DRL2KRN35OELM7NGV6LA2UETYGWQ7MXQ, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:46.427741744 (20h27m46.017086761s) [noise=true , address=45.91.116.13:4173 , piece_id=RHDHQHTNEN6KZT437OVF4WQAKWPBH7BCVQHP454S6MRRZNQYP7JQ, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:46.462267694 (20h27m46.051612681s) [noise=true , address=104.36.82.16:4309 , piece_id=QDL5VPO76Z2UOBGCIKE3U7H7NMJXY4MVAGBBUOYXQJZULEIVEIXQ, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:46.465033104 (20h27m46.054378091s) [noise=true , address=104.36.82.37:4683 , piece_id=5V3S5VPBPLRH5B2MRYGW6EID6KSLHS4OO7KGVMIAJRMNTXSY532A, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:46.474058252 (20h27m46.063403239s) [noise=true , address=104.36.82.47:4540 , piece_id=RPTV6MCUG7PVWOYJD3HD6LEQK7XMXTP4YRI4AUBQQIB4XRJ77TMQ, seg_pos={0 0}, upload=21193]: Done uploading piece. err: <nil> Aug 8 06:07:46.474076287 (20h27m46.063421274s) [seg_pos={0 0}, upload=21193]: Segment reached optimal threshold of 14 pieces. Aug 8 06:07:46.474176218 (20h27m46.063521205s) [noise=true , address=104.36.82.9:4033 , piece_id=HGGSTIZD577RKIOMCY4XREUFVY4Z2IPMFKP633QOWERGWOTIZ6UQ, seg_pos={0 0}, upload=21193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SV3LrcQW16wLewDzfyUWFB6sUgnERNJVdhz72CJmyde95M79C): protocol: expected piece hash; context canceled; EOF Aug 8 06:07:46.474300436 (20h27m46.063645423s) [noise=true , address=104.36.82.14:4246 , piece_id=VCSHEVBRJMGYWAWHBQC6FNYXOPAUHTYFKYG3WPRXAUZC2ULS2WMA, seg_pos={0 0}, upload=21193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dqLB6LVQJaSdEfjKmu5nXqRST733hn5rTxCcMQS8YJVv8Hwdc): protocol: expected piece hash; context canceled; EOF Aug 8 06:07:46.474309412 (20h27m46.063654389s) [noise=true , address=104.36.82.59:4329 , piece_id=P2M7FFPITQ7NHY6VBGGU3ITOULIQKDRLJSBPGPCLF45OTUFYDWVA, seg_pos={0 0}, upload=21193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1dGY6BG4FULjuRwnEKd9wV4cZPVJsgo32oFHKZn5BgjxVaojbk): protocol: expected piece hash; context canceled; EOF Aug 8 06:07:46.474323630 (20h27m46.063668617s) [noise=true , address=104.36.82.36:4622 , piece_id=WRHWIU7JGTCE3RLJN4IACGOTG3BSLLNMIRVCGE7L2RTWXG66KQXA, seg_pos={0 0}, upload=21193]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xEK5XL3sYcip7PsQcZBQYihgnEZykdMmsKkCr2TUmbTFYncfs): protocol: expected piece hash; context canceled; EOF Aug 8 06:07:46.474364438 (20h27m46.063709425s) [seg_pos={0 0}, upload=21193]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 06:07:46.474435173 (20h27m46.063780161s) [upload=21193]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 06:07:46.474438840 (20h27m46.063783827s) [upload=21193]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:46.869006200 (20h27m46.458351217s) [upload=21193]: Done uploading segments... Aug 8 06:07:46.869027080 (20h27m46.458372067s) [upload=21193]: Upload finished. err: <nil> Duration: 5.656376595s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [...X..........X......X.............X............X........X..] duration: 1.865551627s FAIL (2025-08-08 06:07:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Aug 8 06:01:37.986483141 (20h21m37.575828158s) [upload=21092]: Starting upload Aug 8 06:01:37.986576620 (20h21m37.575921597s) [upload=21092]: Done starting upload Aug 8 06:01:37.986640021 (20h21m37.575985088s) [upload=21092]: Uploading segments... Aug 8 06:01:37.986703933 (20h21m37.57604892s) [upload=21092]: Got next segment. Inline: true Aug 8 06:01:37.986709013 (20h21m37.576054s) [upload=21092]: Waiting for error group managing segments... Aug 8 06:01:37.986745603 (20h21m37.57609059s) [upload=21092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:37.986749901 (20h21m37.576094878s) [upload=21092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:37.986752807 (20h21m37.576097794s) [upload=21092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:38.252261658 (20h21m37.841606645s) [upload=21092]: Done uploading segments... Aug 8 06:01:38.252277178 (20h21m37.841622165s) [upload=21092]: Upload finished. err: <nil> Aug 8 06:02:26.619669407 (20h22m26.209014394s) [upload=21104]: Starting upload Aug 8 06:02:26.619708563 (20h22m26.20905354s) [upload=21104]: Done starting upload Aug 8 06:02:26.619756935 (20h22m26.209101912s) [upload=21104]: Uploading segments... Aug 8 06:02:26.619785379 (20h22m26.209130366s) [upload=21104]: Got next segment. Inline: true Aug 8 06:02:26.619788816 (20h22m26.209133804s) [upload=21104]: Waiting for error group managing segments... Aug 8 06:02:26.619820136 (20h22m26.209165113s) [upload=21104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:02:26.619824024 (20h22m26.209169011s) [upload=21104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:02:26.619826458 (20h22m26.209171445s) [upload=21104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:02:26.964000279 (20h22m26.553345266s) [upload=21104]: Done uploading segments... Aug 8 06:02:26.964016459 (20h22m26.553361446s) [upload=21104]: Upload finished. err: <nil> Aug 8 06:03:26.281167800 (20h23m25.870512787s) [upload=21119]: Starting upload Aug 8 06:03:26.281216803 (20h23m25.87056179s) [upload=21119]: Done starting upload Aug 8 06:03:26.281267360 (20h23m25.870612337s) [upload=21119]: Uploading segments... Aug 8 06:03:26.281298389 (20h23m25.870643376s) [upload=21119]: Got next segment. Inline: true Aug 8 06:03:26.281302347 (20h23m25.870647334s) [upload=21119]: Waiting for error group managing segments... Aug 8 06:03:26.281334770 (20h23m25.870679747s) [upload=21119]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:03:26.281338837 (20h23m25.870683814s) [upload=21119]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:03:26.281341202 (20h23m25.870686189s) [upload=21119]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:03:26.746110970 (20h23m26.335455957s) [upload=21119]: Done uploading segments... Aug 8 06:03:26.746129696 (20h23m26.335474683s) [upload=21119]: Upload finished. err: <nil> Aug 8 06:03:42.106238303 (20h23m41.69558329s) [upload=21123]: Starting upload Aug 8 06:03:42.106286295 (20h23m41.695631283s) [upload=21123]: Done starting upload Aug 8 06:03:42.106336652 (20h23m41.695681629s) [upload=21123]: Uploading segments... Aug 8 06:03:42.106366679 (20h23m41.695711676s) [upload=21123]: Got next segment. Inline: true Aug 8 06:03:42.106370577 (20h23m41.695715554s) [upload=21123]: Waiting for error group managing segments... Aug 8 06:03:42.106401967 (20h23m41.695746954s) [upload=21123]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:03:42.106405835 (20h23m41.695750822s) [upload=21123]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:03:42.106408029 (20h23m41.695753016s) [upload=21123]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:03:42.377020835 (20h23m41.966365832s) [upload=21123]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Duration: 1.865585222s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.188322984s FAIL (2025-08-08 06:07:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.188345296s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [X...X..........X......X.............X............X........X.] duration: 1.829037304s FAIL (2025-08-08 06:07:23 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Aug 8 06:01:37.986483141 (20h21m37.575828158s) [upload=21092]: Starting upload Aug 8 06:01:37.986576620 (20h21m37.575921597s) [upload=21092]: Done starting upload Aug 8 06:01:37.986640021 (20h21m37.575985088s) [upload=21092]: Uploading segments... Aug 8 06:01:37.986703933 (20h21m37.57604892s) [upload=21092]: Got next segment. Inline: true Aug 8 06:01:37.986709013 (20h21m37.576054s) [upload=21092]: Waiting for error group managing segments... Aug 8 06:01:37.986745603 (20h21m37.57609059s) [upload=21092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:37.986749901 (20h21m37.576094878s) [upload=21092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:37.986752807 (20h21m37.576097794s) [upload=21092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:38.252261658 (20h21m37.841606645s) [upload=21092]: Done uploading segments... Aug 8 06:01:38.252277178 (20h21m37.841622165s) [upload=21092]: Upload finished. err: <nil> Aug 8 06:02:26.619669407 (20h22m26.209014394s) [upload=21104]: Starting upload Aug 8 06:02:26.619708563 (20h22m26.20905354s) [upload=21104]: Done starting upload Aug 8 06:02:26.619756935 (20h22m26.209101912s) [upload=21104]: Uploading segments... Aug 8 06:02:26.619785379 (20h22m26.209130366s) [upload=21104]: Got next segment. Inline: true Aug 8 06:02:26.619788816 (20h22m26.209133804s) [upload=21104]: Waiting for error group managing segments... Aug 8 06:02:26.619820136 (20h22m26.209165113s) [upload=21104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:02:26.619824024 (20h22m26.209169011s) [upload=21104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:02:26.619826458 (20h22m26.209171445s) [upload=21104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:02:26.964000279 (20h22m26.553345266s) [upload=21104]: Done uploading segments... Aug 8 06:02:26.964016459 (20h22m26.553361446s) [upload=21104]: Upload finished. err: <nil> Aug 8 06:03:26.281167800 (20h23m25.870512787s) [upload=21119]: Starting upload Aug 8 06:03:26.281216803 (20h23m25.87056179s) [upload=21119]: Done starting upload Aug 8 06:03:26.281267360 (20h23m25.870612337s) [upload=21119]: Uploading segments... Aug 8 06:03:26.281298389 (20h23m25.870643376s) [upload=21119]: Got next segment. Inline: true Aug 8 06:03:26.281302347 (20h23m25.870647334s) [upload=21119]: Waiting for error group managing segments... Aug 8 06:03:26.281334770 (20h23m25.870679747s) [upload=21119]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:03:26.281338837 (20h23m25.870683814s) [upload=21119]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:03:26.281341202 (20h23m25.870686189s) [upload=21119]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:03:26.746110970 (20h23m26.335455957s) [upload=21119]: Done uploading segments... Aug 8 06:03:26.746129696 (20h23m26.335474683s) [upload=21119]: Upload finished. err: <nil> Aug 8 06:03:42.106238303 (20h23m41.69558329s) [upload=21123]: Starting upload Aug 8 06:03:42.106286295 (20h23m41.695631283s) [upload=21123]: Done starting upload Aug 8 06:03:42.106336652 (20h23m41.695681629s) [upload=21123]: Uploading segments... Aug 8 06:03:42.106366679 (20h23m41.695711676s) [upload=21123]: Got next segment. Inline: true Aug 8 06:03:42.106370577 (20h23m41.695715554s) [upload=21123]: Waiting for error group managing segments... Aug 8 06:03:42.106401967 (20h23m41.695746954s) [upload=21123]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:03:42.106405835 (20h23m41.695750822s) [upload=21123]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:03:42.106408029 (20h23m41.695753016s) [upload=21123]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:03:42.377020835 (20h23m41.966365832s) [upload=21123]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Duration: 1.829065739s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X.X.......................X.....................] duration: 5.962020791s FAIL (2025-08-08 06:07:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.962046889s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 6.269988304s FAIL (2025-08-08 06:07:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.27036699s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 7 out of 60 is failed (threshold=3) [.X...X..........X......X.............X............X........X] duration: 1.401707838s FAIL (2025-08-08 06:07:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Aug 8 06:01:37.986483141 (20h21m37.575828158s) [upload=21092]: Starting upload Aug 8 06:01:37.986576620 (20h21m37.575921597s) [upload=21092]: Done starting upload Aug 8 06:01:37.986640021 (20h21m37.575985088s) [upload=21092]: Uploading segments... Aug 8 06:01:37.986703933 (20h21m37.57604892s) [upload=21092]: Got next segment. Inline: true Aug 8 06:01:37.986709013 (20h21m37.576054s) [upload=21092]: Waiting for error group managing segments... Aug 8 06:01:37.986745603 (20h21m37.57609059s) [upload=21092]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:37.986749901 (20h21m37.576094878s) [upload=21092]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:37.986752807 (20h21m37.576097794s) [upload=21092]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:38.252261658 (20h21m37.841606645s) [upload=21092]: Done uploading segments... Aug 8 06:01:38.252277178 (20h21m37.841622165s) [upload=21092]: Upload finished. err: <nil> Aug 8 06:02:26.619669407 (20h22m26.209014394s) [upload=21104]: Starting upload Aug 8 06:02:26.619708563 (20h22m26.20905354s) [upload=21104]: Done starting upload Aug 8 06:02:26.619756935 (20h22m26.209101912s) [upload=21104]: Uploading segments... Aug 8 06:02:26.619785379 (20h22m26.209130366s) [upload=21104]: Got next segment. Inline: true Aug 8 06:02:26.619788816 (20h22m26.209133804s) [upload=21104]: Waiting for error group managing segments... Aug 8 06:02:26.619820136 (20h22m26.209165113s) [upload=21104]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:02:26.619824024 (20h22m26.209169011s) [upload=21104]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:02:26.619826458 (20h22m26.209171445s) [upload=21104]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:02:26.964000279 (20h22m26.553345266s) [upload=21104]: Done uploading segments... Aug 8 06:02:26.964016459 (20h22m26.553361446s) [upload=21104]: Upload finished. err: <nil> Aug 8 06:03:26.281167800 (20h23m25.870512787s) [upload=21119]: Starting upload Aug 8 06:03:26.281216803 (20h23m25.87056179s) [upload=21119]: Done starting upload Aug 8 06:03:26.281267360 (20h23m25.870612337s) [upload=21119]: Uploading segments... Aug 8 06:03:26.281298389 (20h23m25.870643376s) [upload=21119]: Got next segment. Inline: true Aug 8 06:03:26.281302347 (20h23m25.870647334s) [upload=21119]: Waiting for error group managing segments... Aug 8 06:03:26.281334770 (20h23m25.870679747s) [upload=21119]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:03:26.281338837 (20h23m25.870683814s) [upload=21119]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:03:26.281341202 (20h23m25.870686189s) [upload=21119]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:03:26.746110970 (20h23m26.335455957s) [upload=21119]: Done uploading segments... Aug 8 06:03:26.746129696 (20h23m26.335474683s) [upload=21119]: Upload finished. err: <nil> Aug 8 06:03:42.106238303 (20h23m41.69558329s) [upload=21123]: Starting upload Aug 8 06:03:42.106286295 (20h23m41.695631283s) [upload=21123]: Done starting upload Aug 8 06:03:42.106336652 (20h23m41.695681629s) [upload=21123]: Uploading segments... Aug 8 06:03:42.106366679 (20h23m41.695711676s) [upload=21123]: Got next segment. Inline: true Aug 8 06:03:42.106370577 (20h23m41.695715554s) [upload=21123]: Waiting for error group managing segments... Aug 8 06:03:42.106401967 (20h23m41.695746954s) [upload=21123]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:03:42.106405835 (20h23m41.695750822s) [upload=21123]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:03:42.106408029 (20h23m41.695753016s) [upload=21123]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:03:42.377020835 (20h23m41.966365832s) [upload=21123]: Done uploading segments... Aug 8 06:03:42.377043818 (20h23m41.966388805s) [upload=21123]: Upload finished. err: <nil> Aug 8 06:04:27.605307743 (20h24m27.19465273s) [upload=21135]: Starting upload Aug 8 06:04:27.605353229 (20h24m27.194698217s) [upload=21135]: Done starting upload Aug 8 06:04:27.605429385 (20h24m27.194774372s) [upload=21135]: Uploading segments... Aug 8 06:04:27.605462118 (20h24m27.194807105s) [upload=21135]: Got next segment. Inline: true Aug 8 06:04:27.605465845 (20h24m27.194810822s) [upload=21135]: Waiting for error group managing segments... Aug 8 06:04:27.605498357 (20h24m27.194843344s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:04:27.605502055 (20h24m27.194847042s) [upload=21135]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:04:27.605504259 (20h24m27.194849236s) [upload=21135]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:04:27.876458378 (20h24m27.465803365s) [upload=21135]: Done uploading segments... Aug 8 06:04:27.876468517 (20h24m27.465813504s) [upload=21135]: Upload finished. err: <nil> Aug 8 06:05:08.888110997 (20h25m8.477455984s) [upload=21149]: Starting upload Aug 8 06:05:08.888173817 (20h25m8.477518794s) [upload=21149]: Done starting upload Aug 8 06:05:08.888243831 (20h25m8.477588818s) [upload=21149]: Uploading segments... Aug 8 06:05:08.888275992 (20h25m8.47762098s) [upload=21149]: Got next segment. Inline: true Aug 8 06:05:08.888280140 (20h25m8.477625127s) [upload=21149]: Waiting for error group managing segments... Aug 8 06:05:08.888340385 (20h25m8.477685372s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:08.888345456 (20h25m8.477690443s) [upload=21149]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:08.888349113 (20h25m8.47769411s) [upload=21149]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:09.162698898 (20h25m8.752043895s) [upload=21149]: Done uploading segments... Aug 8 06:05:09.162721772 (20h25m8.752066759s) [upload=21149]: Upload finished. err: <nil> Aug 8 06:05:30.700033708 (20h25m30.289378695s) [upload=21158]: Starting upload Aug 8 06:05:30.700114242 (20h25m30.28945924s) [upload=21158]: Done starting upload Aug 8 06:05:30.700167735 (20h25m30.289512722s) [upload=21158]: Uploading segments... Aug 8 06:05:30.700209255 (20h25m30.289554242s) [upload=21158]: Got next segment. Inline: true Aug 8 06:05:30.700213703 (20h25m30.28955869s) [upload=21158]: Waiting for error group managing segments... Aug 8 06:05:30.700246315 (20h25m30.289591302s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:05:30.700250132 (20h25m30.28959511s) [upload=21158]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:05:30.700252697 (20h25m30.289597684s) [upload=21158]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:05:30.977839978 (20h25m30.567184965s) [upload=21158]: Done uploading segments... Aug 8 06:05:30.977848705 (20h25m30.567193692s) [upload=21158]: Upload finished. err: <nil> Aug 8 06:06:12.643901120 (20h26m12.233246107s) [upload=21168]: Starting upload Aug 8 06:06:12.643951446 (20h26m12.233296433s) [upload=21168]: Done starting upload Aug 8 06:06:12.644021351 (20h26m12.233366338s) [upload=21168]: Uploading segments... Aug 8 06:06:12.644054173 (20h26m12.23339916s) [upload=21168]: Got next segment. Inline: true Aug 8 06:06:12.644058061 (20h26m12.233403048s) [upload=21168]: Waiting for error group managing segments... Aug 8 06:06:12.644096965 (20h26m12.233441942s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:12.644101284 (20h26m12.233446271s) [upload=21168]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:12.644103688 (20h26m12.233448665s) [upload=21168]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:06:12.916349758 (20h26m12.505694755s) [upload=21168]: Done uploading segments... Aug 8 06:06:12.916368715 (20h26m12.505713702s) [upload=21168]: Upload finished. err: <nil> Aug 8 06:06:59.920081255 (20h26m59.509426282s) [upload=21178]: Starting upload Aug 8 06:06:59.920166629 (20h26m59.509511646s) [upload=21178]: Done starting upload Aug 8 06:06:59.920249898 (20h26m59.509594905s) [upload=21178]: Uploading segments... Aug 8 06:06:59.920301216 (20h26m59.509646233s) [upload=21178]: Got next segment. Inline: true Aug 8 06:06:59.920307568 (20h26m59.509652575s) [upload=21178]: Waiting for error group managing segments... Aug 8 06:06:59.920361261 (20h26m59.509706288s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:06:59.920368185 (20h26m59.509713192s) [upload=21178]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:06:59.920373675 (20h26m59.509718682s) [upload=21178]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:07:00.194799837 (20h26m59.784144824s) [upload=21178]: Done uploading segments... Aug 8 06:07:00.194821649 (20h26m59.784166636s) [upload=21178]: Upload finished. err: <nil> Duration: 1.401737183s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [..X...X..........X......X.............X............X........] duration: 1.854413837s FAIL (2025-08-08 06:06:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 160951s) [upload=20968]: Done uploading segments... Aug 8 05:54:36.926841433 (20h14m36.51618642s) [upload=20968]: Upload finished. err: <nil> Aug 8 05:55:27.854993433 (20h15m27.44433842s) [upload=20984]: Starting upload Aug 8 05:55:27.855037267 (20h15m27.444382254s) [upload=20984]: Done starting upload Aug 8 05:55:27.855083446 (20h15m27.444428433s) [upload=20984]: Uploading segments... Aug 8 05:55:27.855122760 (20h15m27.444467737s) [upload=20984]: Got next segment. Inline: true Aug 8 05:55:27.855126417 (20h15m27.444471404s) [upload=20984]: Waiting for error group managing segments... Aug 8 05:55:27.855155914 (20h15m27.444500901s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:55:27.855159560 (20h15m27.444504547s) [upload=20984]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:55:27.855163459 (20h15m27.444508446s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:55:28.125690519 (20h15m27.715035507s) [upload=20984]: Done uploading segments... Aug 8 05:55:28.125709145 (20h15m27.715054132s) [upload=20984]: Upload finished. err: <nil> Aug 8 05:56:12.975108195 (20h16m12.564453192s) [upload=20997]: Starting upload Aug 8 05:56:12.975180884 (20h16m12.564525871s) [upload=20997]: Done starting upload Aug 8 05:56:12.975225229 (20h16m12.564570206s) [upload=20997]: Uploading segments... Aug 8 05:56:12.975287538 (20h16m12.564632525s) [upload=20997]: Got next segment. Inline: true Aug 8 05:56:12.975292537 (20h16m12.564637524s) [upload=20997]: Waiting for error group managing segments... Aug 8 05:56:12.975330330 (20h16m12.564675317s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:56:12.975334578 (20h16m12.564679565s) [upload=20997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:56:12.975337123 (20h16m12.5646821s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:56:13.249013471 (20h16m12.838358478s) [upload=20997]: Done uploading segments... Aug 8 05:56:13.249036024 (20h16m12.838381011s) [upload=20997]: Upload finished. err: <nil> Aug 8 05:57:00.963085117 (20h17m0.552430125s) [upload=21012]: Starting upload Aug 8 05:57:00.963153639 (20h17m0.552498626s) [upload=21012]: Done starting upload Aug 8 05:57:00.963221999 (20h17m0.552566996s) [upload=21012]: Uploading segments... Aug 8 05:57:00.963261165 (20h17m0.552606152s) [upload=21012]: Got next segment. Inline: true Aug 8 05:57:00.963266154 (20h17m0.552611141s) [upload=21012]: Waiting for error group managing segments... Aug 8 05:57:00.963311341 (20h17m0.552656348s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:00.963316741 (20h17m0.552661738s) [upload=21012]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:00.963320128 (20h17m0.552665115s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:01.228868724 (20h17m0.818213711s) [upload=21012]: Done uploading segments... Aug 8 05:57:01.228887450 (20h17m0.818232437s) [upload=21012]: Upload finished. err: <nil> Aug 8 05:57:24.321170903 (20h17m23.91051589s) [upload=21016]: Starting upload Aug 8 05:57:24.321217862 (20h17m23.910562849s) [upload=21016]: Done starting upload Aug 8 05:57:24.321267848 (20h17m23.910612835s) [upload=21016]: Uploading segments... Aug 8 05:57:24.321295200 (20h17m23.910640187s) [upload=21016]: Got next segment. Inline: true Aug 8 05:57:24.321299188 (20h17m23.910644175s) [upload=21016]: Waiting for error group managing segments... Aug 8 05:57:24.321332873 (20h17m23.91067786s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:24.321337021 (20h17m23.910682008s) [upload=21016]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:24.321339625 (20h17m23.910684613s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:24.588125509 (20h17m24.177470496s) [upload=21016]: Done uploading segments... Aug 8 05:57:24.588141280 (20h17m24.177486267s) [upload=21016]: Upload finished. err: <nil> Aug 8 05:57:44.984884963 (20h17m44.57422994s) [upload=21023]: Starting upload Aug 8 05:57:44.984936812 (20h17m44.574281799s) [upload=21023]: Done starting upload Aug 8 05:57:44.984983341 (20h17m44.574328318s) [upload=21023]: Uploading segments... Aug 8 05:57:44.985012868 (20h17m44.574357855s) [upload=21023]: Got next segment. Inline: true Aug 8 05:57:44.985016384 (20h17m44.574361371s) [upload=21023]: Waiting for error group managing segments... Aug 8 05:57:44.985049217 (20h17m44.574394204s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:44.985053685 (20h17m44.574398672s) [upload=21023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:44.985056100 (20h17m44.574401087s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:45.266330504 (20h17m44.855675502s) [upload=21023]: Done uploading segments... Aug 8 05:57:45.266352646 (20h17m44.855697673s) [upload=21023]: Upload finished. err: <nil> Aug 8 05:58:38.485929103 (20h18m38.07527409s) [upload=21038]: Starting upload Aug 8 05:58:38.485976022 (20h18m38.075321009s) [upload=21038]: Done starting upload Aug 8 05:58:38.486076905 (20h18m38.075421892s) [upload=21038]: Uploading segments... Aug 8 05:58:38.486169102 (20h18m38.07551409s) [upload=21038]: Got next segment. Inline: true Aug 8 05:58:38.486175585 (20h18m38.075520572s) [upload=21038]: Waiting for error group managing segments... Aug 8 05:58:38.486240599 (20h18m38.075585586s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:58:38.486248534 (20h18m38.075593521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:58:38.486253514 (20h18m38.075598521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:58:38.744419005 (20h18m38.333763992s) [upload=21038]: Done uploading segments... Aug 8 05:58:38.744438663 (20h18m38.33378365s) [upload=21038]: Upload finished. err: <nil> Aug 8 05:59:50.694095379 (20h19m50.283440366s) [upload=21061]: Starting upload Aug 8 05:59:50.694206050 (20h19m50.283551037s) [upload=21061]: Done starting upload Aug 8 05:59:50.694302564 (20h19m50.283647552s) [upload=21061]: Uploading segments... Aug 8 05:59:50.694344205 (20h19m50.283689192s) [upload=21061]: Got next segment. Inline: true Aug 8 05:59:50.694348683 (20h19m50.28369367s) [upload=21061]: Waiting for error group managing segments... Aug 8 05:59:50.694393579 (20h19m50.283738566s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:59:50.694398278 (20h19m50.283743265s) [upload=21061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:59:50.694400452 (20h19m50.283745439s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:59:50.960603812 (20h19m50.549948799s) [upload=21061]: Done uploading segments... Aug 8 05:59:50.960623008 (20h19m50.549967996s) [upload=21061]: Upload finished. err: <nil> Aug 8 06:00:05.820178578 (20h20m5.409523575s) [upload=21064]: Starting upload Aug 8 06:00:05.820224024 (20h20m5.409569011s) [upload=21064]: Done starting upload Aug 8 06:00:05.820280151 (20h20m5.409625148s) [upload=21064]: Uploading segments... Aug 8 06:00:05.820313224 (20h20m5.409658211s) [upload=21064]: Got next segment. Inline: true Aug 8 06:00:05.820317283 (20h20m5.40966227s) [upload=21064]: Waiting for error group managing segments... Aug 8 06:00:05.820356718 (20h20m5.409701705s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:05.820361287 (20h20m5.409706284s) [upload=21064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:05.820363932 (20h20m5.409708919s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:06.105183529 (20h20m5.694528516s) [upload=21064]: Done uploading segments... Aug 8 06:00:06.105206524 (20h20m5.694551511s) [upload=21064]: Upload finished. err: <nil> Aug 8 06:00:39.721535110 (20h20m39.310880097s) [upload=21078]: Starting upload Aug 8 06:00:39.721598201 (20h20m39.310943188s) [upload=21078]: Done starting upload Aug 8 06:00:39.721649058 (20h20m39.310994045s) [upload=21078]: Uploading segments... Aug 8 06:00:39.721702660 (20h20m39.311047647s) [upload=21078]: Got next segment. Inline: true Aug 8 06:00:39.721706318 (20h20m39.311051305s) [upload=21078]: Waiting for error group managing segments... Aug 8 06:00:39.721750833 (20h20m39.31109582s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:39.721755371 (20h20m39.311100358s) [upload=21078]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:39.721757786 (20h20m39.311102773s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:39.985732442 (20h20m39.575077429s) [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Duration: 1.854458602s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X.X.......................X....................] duration: 5.663593893s FAIL (2025-08-08 06:06:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.663627979s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.918621801s FAIL (2025-08-08 06:05:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.9186468s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X.X.......................X...................] duration: 5.699306357s FAIL (2025-08-08 06:05:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.699329983s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [...X...X..........X......X.............X............X.......] duration: 1.837550283s FAIL (2025-08-08 06:05:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 160951s) [upload=20968]: Done uploading segments... Aug 8 05:54:36.926841433 (20h14m36.51618642s) [upload=20968]: Upload finished. err: <nil> Aug 8 05:55:27.854993433 (20h15m27.44433842s) [upload=20984]: Starting upload Aug 8 05:55:27.855037267 (20h15m27.444382254s) [upload=20984]: Done starting upload Aug 8 05:55:27.855083446 (20h15m27.444428433s) [upload=20984]: Uploading segments... Aug 8 05:55:27.855122760 (20h15m27.444467737s) [upload=20984]: Got next segment. Inline: true Aug 8 05:55:27.855126417 (20h15m27.444471404s) [upload=20984]: Waiting for error group managing segments... Aug 8 05:55:27.855155914 (20h15m27.444500901s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:55:27.855159560 (20h15m27.444504547s) [upload=20984]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:55:27.855163459 (20h15m27.444508446s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:55:28.125690519 (20h15m27.715035507s) [upload=20984]: Done uploading segments... Aug 8 05:55:28.125709145 (20h15m27.715054132s) [upload=20984]: Upload finished. err: <nil> Aug 8 05:56:12.975108195 (20h16m12.564453192s) [upload=20997]: Starting upload Aug 8 05:56:12.975180884 (20h16m12.564525871s) [upload=20997]: Done starting upload Aug 8 05:56:12.975225229 (20h16m12.564570206s) [upload=20997]: Uploading segments... Aug 8 05:56:12.975287538 (20h16m12.564632525s) [upload=20997]: Got next segment. Inline: true Aug 8 05:56:12.975292537 (20h16m12.564637524s) [upload=20997]: Waiting for error group managing segments... Aug 8 05:56:12.975330330 (20h16m12.564675317s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:56:12.975334578 (20h16m12.564679565s) [upload=20997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:56:12.975337123 (20h16m12.5646821s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:56:13.249013471 (20h16m12.838358478s) [upload=20997]: Done uploading segments... Aug 8 05:56:13.249036024 (20h16m12.838381011s) [upload=20997]: Upload finished. err: <nil> Aug 8 05:57:00.963085117 (20h17m0.552430125s) [upload=21012]: Starting upload Aug 8 05:57:00.963153639 (20h17m0.552498626s) [upload=21012]: Done starting upload Aug 8 05:57:00.963221999 (20h17m0.552566996s) [upload=21012]: Uploading segments... Aug 8 05:57:00.963261165 (20h17m0.552606152s) [upload=21012]: Got next segment. Inline: true Aug 8 05:57:00.963266154 (20h17m0.552611141s) [upload=21012]: Waiting for error group managing segments... Aug 8 05:57:00.963311341 (20h17m0.552656348s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:00.963316741 (20h17m0.552661738s) [upload=21012]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:00.963320128 (20h17m0.552665115s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:01.228868724 (20h17m0.818213711s) [upload=21012]: Done uploading segments... Aug 8 05:57:01.228887450 (20h17m0.818232437s) [upload=21012]: Upload finished. err: <nil> Aug 8 05:57:24.321170903 (20h17m23.91051589s) [upload=21016]: Starting upload Aug 8 05:57:24.321217862 (20h17m23.910562849s) [upload=21016]: Done starting upload Aug 8 05:57:24.321267848 (20h17m23.910612835s) [upload=21016]: Uploading segments... Aug 8 05:57:24.321295200 (20h17m23.910640187s) [upload=21016]: Got next segment. Inline: true Aug 8 05:57:24.321299188 (20h17m23.910644175s) [upload=21016]: Waiting for error group managing segments... Aug 8 05:57:24.321332873 (20h17m23.91067786s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:24.321337021 (20h17m23.910682008s) [upload=21016]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:24.321339625 (20h17m23.910684613s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:24.588125509 (20h17m24.177470496s) [upload=21016]: Done uploading segments... Aug 8 05:57:24.588141280 (20h17m24.177486267s) [upload=21016]: Upload finished. err: <nil> Aug 8 05:57:44.984884963 (20h17m44.57422994s) [upload=21023]: Starting upload Aug 8 05:57:44.984936812 (20h17m44.574281799s) [upload=21023]: Done starting upload Aug 8 05:57:44.984983341 (20h17m44.574328318s) [upload=21023]: Uploading segments... Aug 8 05:57:44.985012868 (20h17m44.574357855s) [upload=21023]: Got next segment. Inline: true Aug 8 05:57:44.985016384 (20h17m44.574361371s) [upload=21023]: Waiting for error group managing segments... Aug 8 05:57:44.985049217 (20h17m44.574394204s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:44.985053685 (20h17m44.574398672s) [upload=21023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:44.985056100 (20h17m44.574401087s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:45.266330504 (20h17m44.855675502s) [upload=21023]: Done uploading segments... Aug 8 05:57:45.266352646 (20h17m44.855697673s) [upload=21023]: Upload finished. err: <nil> Aug 8 05:58:38.485929103 (20h18m38.07527409s) [upload=21038]: Starting upload Aug 8 05:58:38.485976022 (20h18m38.075321009s) [upload=21038]: Done starting upload Aug 8 05:58:38.486076905 (20h18m38.075421892s) [upload=21038]: Uploading segments... Aug 8 05:58:38.486169102 (20h18m38.07551409s) [upload=21038]: Got next segment. Inline: true Aug 8 05:58:38.486175585 (20h18m38.075520572s) [upload=21038]: Waiting for error group managing segments... Aug 8 05:58:38.486240599 (20h18m38.075585586s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:58:38.486248534 (20h18m38.075593521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:58:38.486253514 (20h18m38.075598521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:58:38.744419005 (20h18m38.333763992s) [upload=21038]: Done uploading segments... Aug 8 05:58:38.744438663 (20h18m38.33378365s) [upload=21038]: Upload finished. err: <nil> Aug 8 05:59:50.694095379 (20h19m50.283440366s) [upload=21061]: Starting upload Aug 8 05:59:50.694206050 (20h19m50.283551037s) [upload=21061]: Done starting upload Aug 8 05:59:50.694302564 (20h19m50.283647552s) [upload=21061]: Uploading segments... Aug 8 05:59:50.694344205 (20h19m50.283689192s) [upload=21061]: Got next segment. Inline: true Aug 8 05:59:50.694348683 (20h19m50.28369367s) [upload=21061]: Waiting for error group managing segments... Aug 8 05:59:50.694393579 (20h19m50.283738566s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:59:50.694398278 (20h19m50.283743265s) [upload=21061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:59:50.694400452 (20h19m50.283745439s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:59:50.960603812 (20h19m50.549948799s) [upload=21061]: Done uploading segments... Aug 8 05:59:50.960623008 (20h19m50.549967996s) [upload=21061]: Upload finished. err: <nil> Aug 8 06:00:05.820178578 (20h20m5.409523575s) [upload=21064]: Starting upload Aug 8 06:00:05.820224024 (20h20m5.409569011s) [upload=21064]: Done starting upload Aug 8 06:00:05.820280151 (20h20m5.409625148s) [upload=21064]: Uploading segments... Aug 8 06:00:05.820313224 (20h20m5.409658211s) [upload=21064]: Got next segment. Inline: true Aug 8 06:00:05.820317283 (20h20m5.40966227s) [upload=21064]: Waiting for error group managing segments... Aug 8 06:00:05.820356718 (20h20m5.409701705s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:05.820361287 (20h20m5.409706284s) [upload=21064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:05.820363932 (20h20m5.409708919s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:06.105183529 (20h20m5.694528516s) [upload=21064]: Done uploading segments... Aug 8 06:00:06.105206524 (20h20m5.694551511s) [upload=21064]: Upload finished. err: <nil> Aug 8 06:00:39.721535110 (20h20m39.310880097s) [upload=21078]: Starting upload Aug 8 06:00:39.721598201 (20h20m39.310943188s) [upload=21078]: Done starting upload Aug 8 06:00:39.721649058 (20h20m39.310994045s) [upload=21078]: Uploading segments... Aug 8 06:00:39.721702660 (20h20m39.311047647s) [upload=21078]: Got next segment. Inline: true Aug 8 06:00:39.721706318 (20h20m39.311051305s) [upload=21078]: Waiting for error group managing segments... Aug 8 06:00:39.721750833 (20h20m39.31109582s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:39.721755371 (20h20m39.311100358s) [upload=21078]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:39.721757786 (20h20m39.311102773s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:39.985732442 (20h20m39.575077429s) [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Duration: 1.83757513s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [....X...X..........X......X.............X............X......] duration: 1.851328995s FAIL (2025-08-08 06:05:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 160951s) [upload=20968]: Done uploading segments... Aug 8 05:54:36.926841433 (20h14m36.51618642s) [upload=20968]: Upload finished. err: <nil> Aug 8 05:55:27.854993433 (20h15m27.44433842s) [upload=20984]: Starting upload Aug 8 05:55:27.855037267 (20h15m27.444382254s) [upload=20984]: Done starting upload Aug 8 05:55:27.855083446 (20h15m27.444428433s) [upload=20984]: Uploading segments... Aug 8 05:55:27.855122760 (20h15m27.444467737s) [upload=20984]: Got next segment. Inline: true Aug 8 05:55:27.855126417 (20h15m27.444471404s) [upload=20984]: Waiting for error group managing segments... Aug 8 05:55:27.855155914 (20h15m27.444500901s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:55:27.855159560 (20h15m27.444504547s) [upload=20984]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:55:27.855163459 (20h15m27.444508446s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:55:28.125690519 (20h15m27.715035507s) [upload=20984]: Done uploading segments... Aug 8 05:55:28.125709145 (20h15m27.715054132s) [upload=20984]: Upload finished. err: <nil> Aug 8 05:56:12.975108195 (20h16m12.564453192s) [upload=20997]: Starting upload Aug 8 05:56:12.975180884 (20h16m12.564525871s) [upload=20997]: Done starting upload Aug 8 05:56:12.975225229 (20h16m12.564570206s) [upload=20997]: Uploading segments... Aug 8 05:56:12.975287538 (20h16m12.564632525s) [upload=20997]: Got next segment. Inline: true Aug 8 05:56:12.975292537 (20h16m12.564637524s) [upload=20997]: Waiting for error group managing segments... Aug 8 05:56:12.975330330 (20h16m12.564675317s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:56:12.975334578 (20h16m12.564679565s) [upload=20997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:56:12.975337123 (20h16m12.5646821s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:56:13.249013471 (20h16m12.838358478s) [upload=20997]: Done uploading segments... Aug 8 05:56:13.249036024 (20h16m12.838381011s) [upload=20997]: Upload finished. err: <nil> Aug 8 05:57:00.963085117 (20h17m0.552430125s) [upload=21012]: Starting upload Aug 8 05:57:00.963153639 (20h17m0.552498626s) [upload=21012]: Done starting upload Aug 8 05:57:00.963221999 (20h17m0.552566996s) [upload=21012]: Uploading segments... Aug 8 05:57:00.963261165 (20h17m0.552606152s) [upload=21012]: Got next segment. Inline: true Aug 8 05:57:00.963266154 (20h17m0.552611141s) [upload=21012]: Waiting for error group managing segments... Aug 8 05:57:00.963311341 (20h17m0.552656348s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:00.963316741 (20h17m0.552661738s) [upload=21012]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:00.963320128 (20h17m0.552665115s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:01.228868724 (20h17m0.818213711s) [upload=21012]: Done uploading segments... Aug 8 05:57:01.228887450 (20h17m0.818232437s) [upload=21012]: Upload finished. err: <nil> Aug 8 05:57:24.321170903 (20h17m23.91051589s) [upload=21016]: Starting upload Aug 8 05:57:24.321217862 (20h17m23.910562849s) [upload=21016]: Done starting upload Aug 8 05:57:24.321267848 (20h17m23.910612835s) [upload=21016]: Uploading segments... Aug 8 05:57:24.321295200 (20h17m23.910640187s) [upload=21016]: Got next segment. Inline: true Aug 8 05:57:24.321299188 (20h17m23.910644175s) [upload=21016]: Waiting for error group managing segments... Aug 8 05:57:24.321332873 (20h17m23.91067786s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:24.321337021 (20h17m23.910682008s) [upload=21016]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:24.321339625 (20h17m23.910684613s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:24.588125509 (20h17m24.177470496s) [upload=21016]: Done uploading segments... Aug 8 05:57:24.588141280 (20h17m24.177486267s) [upload=21016]: Upload finished. err: <nil> Aug 8 05:57:44.984884963 (20h17m44.57422994s) [upload=21023]: Starting upload Aug 8 05:57:44.984936812 (20h17m44.574281799s) [upload=21023]: Done starting upload Aug 8 05:57:44.984983341 (20h17m44.574328318s) [upload=21023]: Uploading segments... Aug 8 05:57:44.985012868 (20h17m44.574357855s) [upload=21023]: Got next segment. Inline: true Aug 8 05:57:44.985016384 (20h17m44.574361371s) [upload=21023]: Waiting for error group managing segments... Aug 8 05:57:44.985049217 (20h17m44.574394204s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:44.985053685 (20h17m44.574398672s) [upload=21023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:44.985056100 (20h17m44.574401087s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:45.266330504 (20h17m44.855675502s) [upload=21023]: Done uploading segments... Aug 8 05:57:45.266352646 (20h17m44.855697673s) [upload=21023]: Upload finished. err: <nil> Aug 8 05:58:38.485929103 (20h18m38.07527409s) [upload=21038]: Starting upload Aug 8 05:58:38.485976022 (20h18m38.075321009s) [upload=21038]: Done starting upload Aug 8 05:58:38.486076905 (20h18m38.075421892s) [upload=21038]: Uploading segments... Aug 8 05:58:38.486169102 (20h18m38.07551409s) [upload=21038]: Got next segment. Inline: true Aug 8 05:58:38.486175585 (20h18m38.075520572s) [upload=21038]: Waiting for error group managing segments... Aug 8 05:58:38.486240599 (20h18m38.075585586s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:58:38.486248534 (20h18m38.075593521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:58:38.486253514 (20h18m38.075598521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:58:38.744419005 (20h18m38.333763992s) [upload=21038]: Done uploading segments... Aug 8 05:58:38.744438663 (20h18m38.33378365s) [upload=21038]: Upload finished. err: <nil> Aug 8 05:59:50.694095379 (20h19m50.283440366s) [upload=21061]: Starting upload Aug 8 05:59:50.694206050 (20h19m50.283551037s) [upload=21061]: Done starting upload Aug 8 05:59:50.694302564 (20h19m50.283647552s) [upload=21061]: Uploading segments... Aug 8 05:59:50.694344205 (20h19m50.283689192s) [upload=21061]: Got next segment. Inline: true Aug 8 05:59:50.694348683 (20h19m50.28369367s) [upload=21061]: Waiting for error group managing segments... Aug 8 05:59:50.694393579 (20h19m50.283738566s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:59:50.694398278 (20h19m50.283743265s) [upload=21061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:59:50.694400452 (20h19m50.283745439s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:59:50.960603812 (20h19m50.549948799s) [upload=21061]: Done uploading segments... Aug 8 05:59:50.960623008 (20h19m50.549967996s) [upload=21061]: Upload finished. err: <nil> Aug 8 06:00:05.820178578 (20h20m5.409523575s) [upload=21064]: Starting upload Aug 8 06:00:05.820224024 (20h20m5.409569011s) [upload=21064]: Done starting upload Aug 8 06:00:05.820280151 (20h20m5.409625148s) [upload=21064]: Uploading segments... Aug 8 06:00:05.820313224 (20h20m5.409658211s) [upload=21064]: Got next segment. Inline: true Aug 8 06:00:05.820317283 (20h20m5.40966227s) [upload=21064]: Waiting for error group managing segments... Aug 8 06:00:05.820356718 (20h20m5.409701705s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:05.820361287 (20h20m5.409706284s) [upload=21064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:05.820363932 (20h20m5.409708919s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:06.105183529 (20h20m5.694528516s) [upload=21064]: Done uploading segments... Aug 8 06:00:06.105206524 (20h20m5.694551511s) [upload=21064]: Upload finished. err: <nil> Aug 8 06:00:39.721535110 (20h20m39.310880097s) [upload=21078]: Starting upload Aug 8 06:00:39.721598201 (20h20m39.310943188s) [upload=21078]: Done starting upload Aug 8 06:00:39.721649058 (20h20m39.310994045s) [upload=21078]: Uploading segments... Aug 8 06:00:39.721702660 (20h20m39.311047647s) [upload=21078]: Got next segment. Inline: true Aug 8 06:00:39.721706318 (20h20m39.311051305s) [upload=21078]: Waiting for error group managing segments... Aug 8 06:00:39.721750833 (20h20m39.31109582s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:39.721755371 (20h20m39.311100358s) [upload=21078]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:39.721757786 (20h20m39.311102773s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:39.985732442 (20h20m39.575077429s) [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Duration: 1.851354064s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X.X.......................X..................] duration: 5.907431346s FAIL (2025-08-08 06:05:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.907459149s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 6.392876613s FAIL (2025-08-08 06:04:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.392903575s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [X...............X.X.......................X.................] duration: 5.591559422s FAIL (2025-08-08 06:04:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.591585863s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.....X...X..........X......X.............X............X.....] duration: 1.858901431s FAIL (2025-08-08 06:04:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 160951s) [upload=20968]: Done uploading segments... Aug 8 05:54:36.926841433 (20h14m36.51618642s) [upload=20968]: Upload finished. err: <nil> Aug 8 05:55:27.854993433 (20h15m27.44433842s) [upload=20984]: Starting upload Aug 8 05:55:27.855037267 (20h15m27.444382254s) [upload=20984]: Done starting upload Aug 8 05:55:27.855083446 (20h15m27.444428433s) [upload=20984]: Uploading segments... Aug 8 05:55:27.855122760 (20h15m27.444467737s) [upload=20984]: Got next segment. Inline: true Aug 8 05:55:27.855126417 (20h15m27.444471404s) [upload=20984]: Waiting for error group managing segments... Aug 8 05:55:27.855155914 (20h15m27.444500901s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:55:27.855159560 (20h15m27.444504547s) [upload=20984]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:55:27.855163459 (20h15m27.444508446s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:55:28.125690519 (20h15m27.715035507s) [upload=20984]: Done uploading segments... Aug 8 05:55:28.125709145 (20h15m27.715054132s) [upload=20984]: Upload finished. err: <nil> Aug 8 05:56:12.975108195 (20h16m12.564453192s) [upload=20997]: Starting upload Aug 8 05:56:12.975180884 (20h16m12.564525871s) [upload=20997]: Done starting upload Aug 8 05:56:12.975225229 (20h16m12.564570206s) [upload=20997]: Uploading segments... Aug 8 05:56:12.975287538 (20h16m12.564632525s) [upload=20997]: Got next segment. Inline: true Aug 8 05:56:12.975292537 (20h16m12.564637524s) [upload=20997]: Waiting for error group managing segments... Aug 8 05:56:12.975330330 (20h16m12.564675317s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:56:12.975334578 (20h16m12.564679565s) [upload=20997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:56:12.975337123 (20h16m12.5646821s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:56:13.249013471 (20h16m12.838358478s) [upload=20997]: Done uploading segments... Aug 8 05:56:13.249036024 (20h16m12.838381011s) [upload=20997]: Upload finished. err: <nil> Aug 8 05:57:00.963085117 (20h17m0.552430125s) [upload=21012]: Starting upload Aug 8 05:57:00.963153639 (20h17m0.552498626s) [upload=21012]: Done starting upload Aug 8 05:57:00.963221999 (20h17m0.552566996s) [upload=21012]: Uploading segments... Aug 8 05:57:00.963261165 (20h17m0.552606152s) [upload=21012]: Got next segment. Inline: true Aug 8 05:57:00.963266154 (20h17m0.552611141s) [upload=21012]: Waiting for error group managing segments... Aug 8 05:57:00.963311341 (20h17m0.552656348s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:00.963316741 (20h17m0.552661738s) [upload=21012]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:00.963320128 (20h17m0.552665115s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:01.228868724 (20h17m0.818213711s) [upload=21012]: Done uploading segments... Aug 8 05:57:01.228887450 (20h17m0.818232437s) [upload=21012]: Upload finished. err: <nil> Aug 8 05:57:24.321170903 (20h17m23.91051589s) [upload=21016]: Starting upload Aug 8 05:57:24.321217862 (20h17m23.910562849s) [upload=21016]: Done starting upload Aug 8 05:57:24.321267848 (20h17m23.910612835s) [upload=21016]: Uploading segments... Aug 8 05:57:24.321295200 (20h17m23.910640187s) [upload=21016]: Got next segment. Inline: true Aug 8 05:57:24.321299188 (20h17m23.910644175s) [upload=21016]: Waiting for error group managing segments... Aug 8 05:57:24.321332873 (20h17m23.91067786s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:24.321337021 (20h17m23.910682008s) [upload=21016]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:24.321339625 (20h17m23.910684613s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:24.588125509 (20h17m24.177470496s) [upload=21016]: Done uploading segments... Aug 8 05:57:24.588141280 (20h17m24.177486267s) [upload=21016]: Upload finished. err: <nil> Aug 8 05:57:44.984884963 (20h17m44.57422994s) [upload=21023]: Starting upload Aug 8 05:57:44.984936812 (20h17m44.574281799s) [upload=21023]: Done starting upload Aug 8 05:57:44.984983341 (20h17m44.574328318s) [upload=21023]: Uploading segments... Aug 8 05:57:44.985012868 (20h17m44.574357855s) [upload=21023]: Got next segment. Inline: true Aug 8 05:57:44.985016384 (20h17m44.574361371s) [upload=21023]: Waiting for error group managing segments... Aug 8 05:57:44.985049217 (20h17m44.574394204s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:44.985053685 (20h17m44.574398672s) [upload=21023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:44.985056100 (20h17m44.574401087s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:45.266330504 (20h17m44.855675502s) [upload=21023]: Done uploading segments... Aug 8 05:57:45.266352646 (20h17m44.855697673s) [upload=21023]: Upload finished. err: <nil> Aug 8 05:58:38.485929103 (20h18m38.07527409s) [upload=21038]: Starting upload Aug 8 05:58:38.485976022 (20h18m38.075321009s) [upload=21038]: Done starting upload Aug 8 05:58:38.486076905 (20h18m38.075421892s) [upload=21038]: Uploading segments... Aug 8 05:58:38.486169102 (20h18m38.07551409s) [upload=21038]: Got next segment. Inline: true Aug 8 05:58:38.486175585 (20h18m38.075520572s) [upload=21038]: Waiting for error group managing segments... Aug 8 05:58:38.486240599 (20h18m38.075585586s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:58:38.486248534 (20h18m38.075593521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:58:38.486253514 (20h18m38.075598521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:58:38.744419005 (20h18m38.333763992s) [upload=21038]: Done uploading segments... Aug 8 05:58:38.744438663 (20h18m38.33378365s) [upload=21038]: Upload finished. err: <nil> Aug 8 05:59:50.694095379 (20h19m50.283440366s) [upload=21061]: Starting upload Aug 8 05:59:50.694206050 (20h19m50.283551037s) [upload=21061]: Done starting upload Aug 8 05:59:50.694302564 (20h19m50.283647552s) [upload=21061]: Uploading segments... Aug 8 05:59:50.694344205 (20h19m50.283689192s) [upload=21061]: Got next segment. Inline: true Aug 8 05:59:50.694348683 (20h19m50.28369367s) [upload=21061]: Waiting for error group managing segments... Aug 8 05:59:50.694393579 (20h19m50.283738566s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:59:50.694398278 (20h19m50.283743265s) [upload=21061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:59:50.694400452 (20h19m50.283745439s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:59:50.960603812 (20h19m50.549948799s) [upload=21061]: Done uploading segments... Aug 8 05:59:50.960623008 (20h19m50.549967996s) [upload=21061]: Upload finished. err: <nil> Aug 8 06:00:05.820178578 (20h20m5.409523575s) [upload=21064]: Starting upload Aug 8 06:00:05.820224024 (20h20m5.409569011s) [upload=21064]: Done starting upload Aug 8 06:00:05.820280151 (20h20m5.409625148s) [upload=21064]: Uploading segments... Aug 8 06:00:05.820313224 (20h20m5.409658211s) [upload=21064]: Got next segment. Inline: true Aug 8 06:00:05.820317283 (20h20m5.40966227s) [upload=21064]: Waiting for error group managing segments... Aug 8 06:00:05.820356718 (20h20m5.409701705s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:05.820361287 (20h20m5.409706284s) [upload=21064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:05.820363932 (20h20m5.409708919s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:06.105183529 (20h20m5.694528516s) [upload=21064]: Done uploading segments... Aug 8 06:00:06.105206524 (20h20m5.694551511s) [upload=21064]: Upload finished. err: <nil> Aug 8 06:00:39.721535110 (20h20m39.310880097s) [upload=21078]: Starting upload Aug 8 06:00:39.721598201 (20h20m39.310943188s) [upload=21078]: Done starting upload Aug 8 06:00:39.721649058 (20h20m39.310994045s) [upload=21078]: Uploading segments... Aug 8 06:00:39.721702660 (20h20m39.311047647s) [upload=21078]: Got next segment. Inline: true Aug 8 06:00:39.721706318 (20h20m39.311051305s) [upload=21078]: Waiting for error group managing segments... Aug 8 06:00:39.721750833 (20h20m39.31109582s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:39.721755371 (20h20m39.311100358s) [upload=21078]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:39.721757786 (20h20m39.311102773s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:39.985732442 (20h20m39.575077429s) [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Duration: 1.858935946s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 6.276971327s FAIL (2025-08-08 06:03:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.277002716s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [......X...X..........X......X.............X............X....] duration: 1.834250117s FAIL (2025-08-08 06:03:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 160951s) [upload=20968]: Done uploading segments... Aug 8 05:54:36.926841433 (20h14m36.51618642s) [upload=20968]: Upload finished. err: <nil> Aug 8 05:55:27.854993433 (20h15m27.44433842s) [upload=20984]: Starting upload Aug 8 05:55:27.855037267 (20h15m27.444382254s) [upload=20984]: Done starting upload Aug 8 05:55:27.855083446 (20h15m27.444428433s) [upload=20984]: Uploading segments... Aug 8 05:55:27.855122760 (20h15m27.444467737s) [upload=20984]: Got next segment. Inline: true Aug 8 05:55:27.855126417 (20h15m27.444471404s) [upload=20984]: Waiting for error group managing segments... Aug 8 05:55:27.855155914 (20h15m27.444500901s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:55:27.855159560 (20h15m27.444504547s) [upload=20984]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:55:27.855163459 (20h15m27.444508446s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:55:28.125690519 (20h15m27.715035507s) [upload=20984]: Done uploading segments... Aug 8 05:55:28.125709145 (20h15m27.715054132s) [upload=20984]: Upload finished. err: <nil> Aug 8 05:56:12.975108195 (20h16m12.564453192s) [upload=20997]: Starting upload Aug 8 05:56:12.975180884 (20h16m12.564525871s) [upload=20997]: Done starting upload Aug 8 05:56:12.975225229 (20h16m12.564570206s) [upload=20997]: Uploading segments... Aug 8 05:56:12.975287538 (20h16m12.564632525s) [upload=20997]: Got next segment. Inline: true Aug 8 05:56:12.975292537 (20h16m12.564637524s) [upload=20997]: Waiting for error group managing segments... Aug 8 05:56:12.975330330 (20h16m12.564675317s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:56:12.975334578 (20h16m12.564679565s) [upload=20997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:56:12.975337123 (20h16m12.5646821s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:56:13.249013471 (20h16m12.838358478s) [upload=20997]: Done uploading segments... Aug 8 05:56:13.249036024 (20h16m12.838381011s) [upload=20997]: Upload finished. err: <nil> Aug 8 05:57:00.963085117 (20h17m0.552430125s) [upload=21012]: Starting upload Aug 8 05:57:00.963153639 (20h17m0.552498626s) [upload=21012]: Done starting upload Aug 8 05:57:00.963221999 (20h17m0.552566996s) [upload=21012]: Uploading segments... Aug 8 05:57:00.963261165 (20h17m0.552606152s) [upload=21012]: Got next segment. Inline: true Aug 8 05:57:00.963266154 (20h17m0.552611141s) [upload=21012]: Waiting for error group managing segments... Aug 8 05:57:00.963311341 (20h17m0.552656348s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:00.963316741 (20h17m0.552661738s) [upload=21012]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:00.963320128 (20h17m0.552665115s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:01.228868724 (20h17m0.818213711s) [upload=21012]: Done uploading segments... Aug 8 05:57:01.228887450 (20h17m0.818232437s) [upload=21012]: Upload finished. err: <nil> Aug 8 05:57:24.321170903 (20h17m23.91051589s) [upload=21016]: Starting upload Aug 8 05:57:24.321217862 (20h17m23.910562849s) [upload=21016]: Done starting upload Aug 8 05:57:24.321267848 (20h17m23.910612835s) [upload=21016]: Uploading segments... Aug 8 05:57:24.321295200 (20h17m23.910640187s) [upload=21016]: Got next segment. Inline: true Aug 8 05:57:24.321299188 (20h17m23.910644175s) [upload=21016]: Waiting for error group managing segments... Aug 8 05:57:24.321332873 (20h17m23.91067786s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:24.321337021 (20h17m23.910682008s) [upload=21016]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:24.321339625 (20h17m23.910684613s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:24.588125509 (20h17m24.177470496s) [upload=21016]: Done uploading segments... Aug 8 05:57:24.588141280 (20h17m24.177486267s) [upload=21016]: Upload finished. err: <nil> Aug 8 05:57:44.984884963 (20h17m44.57422994s) [upload=21023]: Starting upload Aug 8 05:57:44.984936812 (20h17m44.574281799s) [upload=21023]: Done starting upload Aug 8 05:57:44.984983341 (20h17m44.574328318s) [upload=21023]: Uploading segments... Aug 8 05:57:44.985012868 (20h17m44.574357855s) [upload=21023]: Got next segment. Inline: true Aug 8 05:57:44.985016384 (20h17m44.574361371s) [upload=21023]: Waiting for error group managing segments... Aug 8 05:57:44.985049217 (20h17m44.574394204s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:44.985053685 (20h17m44.574398672s) [upload=21023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:44.985056100 (20h17m44.574401087s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:45.266330504 (20h17m44.855675502s) [upload=21023]: Done uploading segments... Aug 8 05:57:45.266352646 (20h17m44.855697673s) [upload=21023]: Upload finished. err: <nil> Aug 8 05:58:38.485929103 (20h18m38.07527409s) [upload=21038]: Starting upload Aug 8 05:58:38.485976022 (20h18m38.075321009s) [upload=21038]: Done starting upload Aug 8 05:58:38.486076905 (20h18m38.075421892s) [upload=21038]: Uploading segments... Aug 8 05:58:38.486169102 (20h18m38.07551409s) [upload=21038]: Got next segment. Inline: true Aug 8 05:58:38.486175585 (20h18m38.075520572s) [upload=21038]: Waiting for error group managing segments... Aug 8 05:58:38.486240599 (20h18m38.075585586s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:58:38.486248534 (20h18m38.075593521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:58:38.486253514 (20h18m38.075598521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:58:38.744419005 (20h18m38.333763992s) [upload=21038]: Done uploading segments... Aug 8 05:58:38.744438663 (20h18m38.33378365s) [upload=21038]: Upload finished. err: <nil> Aug 8 05:59:50.694095379 (20h19m50.283440366s) [upload=21061]: Starting upload Aug 8 05:59:50.694206050 (20h19m50.283551037s) [upload=21061]: Done starting upload Aug 8 05:59:50.694302564 (20h19m50.283647552s) [upload=21061]: Uploading segments... Aug 8 05:59:50.694344205 (20h19m50.283689192s) [upload=21061]: Got next segment. Inline: true Aug 8 05:59:50.694348683 (20h19m50.28369367s) [upload=21061]: Waiting for error group managing segments... Aug 8 05:59:50.694393579 (20h19m50.283738566s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:59:50.694398278 (20h19m50.283743265s) [upload=21061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:59:50.694400452 (20h19m50.283745439s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:59:50.960603812 (20h19m50.549948799s) [upload=21061]: Done uploading segments... Aug 8 05:59:50.960623008 (20h19m50.549967996s) [upload=21061]: Upload finished. err: <nil> Aug 8 06:00:05.820178578 (20h20m5.409523575s) [upload=21064]: Starting upload Aug 8 06:00:05.820224024 (20h20m5.409569011s) [upload=21064]: Done starting upload Aug 8 06:00:05.820280151 (20h20m5.409625148s) [upload=21064]: Uploading segments... Aug 8 06:00:05.820313224 (20h20m5.409658211s) [upload=21064]: Got next segment. Inline: true Aug 8 06:00:05.820317283 (20h20m5.40966227s) [upload=21064]: Waiting for error group managing segments... Aug 8 06:00:05.820356718 (20h20m5.409701705s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:05.820361287 (20h20m5.409706284s) [upload=21064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:05.820363932 (20h20m5.409708919s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:06.105183529 (20h20m5.694528516s) [upload=21064]: Done uploading segments... Aug 8 06:00:06.105206524 (20h20m5.694551511s) [upload=21064]: Upload finished. err: <nil> Aug 8 06:00:39.721535110 (20h20m39.310880097s) [upload=21078]: Starting upload Aug 8 06:00:39.721598201 (20h20m39.310943188s) [upload=21078]: Done starting upload Aug 8 06:00:39.721649058 (20h20m39.310994045s) [upload=21078]: Uploading segments... Aug 8 06:00:39.721702660 (20h20m39.311047647s) [upload=21078]: Got next segment. Inline: true Aug 8 06:00:39.721706318 (20h20m39.311051305s) [upload=21078]: Waiting for error group managing segments... Aug 8 06:00:39.721750833 (20h20m39.31109582s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:39.721755371 (20h20m39.311100358s) [upload=21078]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:39.721757786 (20h20m39.311102773s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:39.985732442 (20h20m39.575077429s) [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Duration: 1.834274505s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [XX...............X.X.......................X................] duration: 5.570704962s FAIL (2025-08-08 06:03:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== ad finished. err: <nil> Aug 8 05:50:40.893567535 (20h10m40.482912522s) [upload=20903]: Starting upload Aug 8 05:50:40.893617581 (20h10m40.482962568s) [upload=20903]: Done starting upload Aug 8 05:50:40.893745836 (20h10m40.483090823s) [upload=20903]: Uploading segments... Aug 8 05:50:40.893860175 (20h10m40.483205162s) [upload=20903]: Got next segment. Inline: false Aug 8 05:50:40.893898729 (20h10m40.483243706s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:50:40.893904339 (20h10m40.483249326s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 05:50:41.341218008 (20h10m40.930562995s) [seg_pos={0 0}, upload=20903]: Begin upload segment... Aug 8 05:50:41.341265508 (20h10m40.930610495s) [seg_pos={0 0}, upload=20903]: Done begin upload segment. Aug 8 05:50:41.341287290 (20h10m40.930632267s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341358447 (20h10m40.930703434s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341670363 (20h10m40.93101535s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341830500 (20h10m40.931175487s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.341990977 (20h10m40.931335954s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342205478 (20h10m40.931550465s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342313615 (20h10m40.931658602s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342583129 (20h10m40.931928117s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342596976 (20h10m40.931941953s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342935484 (20h10m40.932280471s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.342953539 (20h10m40.932298526s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343204499 (20h10m40.932549486s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343223045 (20h10m40.932568032s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343469105 (20h10m40.932814092s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343567834 (20h10m40.932912821s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.343687393 (20h10m40.93303237s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.344008046 (20h10m40.933353033s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:41.345979839 (20h10m40.935324816s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Uploading piece... Aug 8 05:50:42.438670912 (20h10m42.028015899s) [upload=20903]: Next returned nil segment Aug 8 05:50:42.438688716 (20h10m42.028033703s) [upload=20903]: Waiting for error group managing segments... Aug 8 05:50:42.778812377 (20h10m42.368157364s) [noise=true , address=193.149.164.143:4696 , piece_id=FNRXKJGRXG64FVEF7U6WLJT56RBHEONLJF5FM3K7ZRBCQVBL3VFQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.793688260 (20h10m42.383033237s) [noise=true , address=64.49.13.140:4509 , piece_id=52T2SWYDXGGJ2IGMUAX5DJQZUFAQUHQTBW4NFC27RQQFLERI2EBQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.814603478 (20h10m42.403948465s) [noise=true , address=64.49.13.155:4916 , piece_id=R4EDGKGU5O3XMIEDBT3P3YDZ6M5NDSW627JISIFRRYM3YFY7OJ7A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:42.846619684 (20h10m42.435964671s) [noise=true , address=64.49.13.138:4481 , piece_id=HDNKCDGYH2LAFM2DRIW364W5XRSKF5XK7YZI47ATAAC5A6EBTOUQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.248617890 (20h10m42.837962877s) [noise=true , address=104.36.82.47:4529 , piece_id=UESMFD5UVKCQ4F5XKAG6OMNTA4BS6QV2BME5E7DMIJP7XWHJHT6A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.252848605 (20h10m42.842193592s) [noise=true , address=104.36.82.39:4735 , piece_id=VYEESGWFD57OTLITJU27YFV3IKI34JW7GANQ2U34PV6WAGMPEFXQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.255650606 (20h10m42.844995593s) [noise=true , address=104.36.82.61:4406 , piece_id=WQCH472JAJNEAGQGOF5LYU6RAUICVUOFXDTJC52NWFCEU43YTHEA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.261140931 (20h10m42.850485918s) [noise=true , address=104.36.82.23:4460 , piece_id=GKYZZOHC5J2FV2PWHI4IVTZV7FMVP2OFSJ2UOF24W5USG734RH7Q, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.269129284 (20h10m42.858474261s) [noise=true , address=104.36.82.58:4273 , piece_id=WGPLZNLVUSYYJF7FJSBWAKRZ4LDAXSGBVWSTFRJ3KPBJIXOFSDGQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.274156393 (20h10m42.86350137s) [noise=true , address=104.36.82.43:4868 , piece_id=BM2WYHNTNNQAZHBSITN3ZIACMJLHLO6QACEZFCLYHODB4FYVYHNA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.313273526 (20h10m42.902618513s) [noise=true , address=45.91.116.10:4092 , piece_id=FDHA5FCWTAFZ5N6AJA254W7QKGN3RGCGT7ZGWBIGLTI65DEIG4ZQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.330724515 (20h10m42.920069502s) [noise=true , address=104.36.82.44:4881 , piece_id=JQKJCCUHCJSWLBDF5G5IEP2HAQJXH3FA6H7X4RNUH342SM6CNB5A, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345245168 (20h10m42.934590155s) [noise=true , address=104.36.82.20:4457 , piece_id=COVFTVTMO3DGUFVMZH633Q7RMZQRV7P2SRYOVJ2JZFP7RY5N7RHA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345588405 (20h10m42.934933392s) [noise=true , address=104.36.82.60:4348 , piece_id=DSQCOTEIOHDKJSUZYR7RQGXLT6A3FQNPBHZ36UKT3G56PNEWBKZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: <nil> Aug 8 05:50:43.345621758 (20h10m42.934966745s) [seg_pos={0 0}, upload=20903]: Segment reached optimal threshold of 14 pieces. Aug 8 05:50:43.345774391 (20h10m42.935119378s) [noise=true , address=104.36.82.13:4202 , piece_id=GNTUDR6M4TV66KTCUMQKC33ESLZAQP4WK3PWS5CDQN5M6FE4ALQQ, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18wf5KnaR6WaR7MJivJkMJ7FejbuR6KnyvtRQgazNKfDb8fbsH): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345829917 (20h10m42.935174914s) [noise=true , address=104.36.82.36:4633 , piece_id=N6ZYWVZ7CODZ3SWA3T2KL6HWOPISACLE6YNECGDNL6S6NHP6TYZA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dvBPvb9YEtM4NieVCXL71Pak5zwiMg14MSXH4RuLZts4dByG8): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345878609 (20h10m42.935223607s) [noise=true , address=104.36.82.44:4873 , piece_id=OGMZZTN6R646OCIKFIN2ARH7HBXIYI4RG3RHOVEFGTGOS6EFLPFA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12b5GdYtmYz9D1QW2z78W3Z2fWvMJGtrvrMJ1njbcqbtCDUdwHo): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345924307 (20h10m42.935269294s) [noise=true , address=104.36.82.37:4657 , piece_id=6G2JI22ZFKN72YYNJZ4Q3PK4ODRBF4QOK5OH3XNI245MOEV4INRA, seg_pos={0 0}, upload=20903]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF Aug 8 05:50:43.345954214 (20h10m42.935299282s) [seg_pos={0 0}, upload=20903]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 05:50:43.346042142 (20h10m42.93538716s) [upload=20903]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 05:50:43.346050880 (20h10m42.935395897s) [upload=20903]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:50:43.643950132 (20h10m43.233295119s) [upload=20903]: Done uploading segments... Aug 8 05:50:43.643971202 (20h10m43.233316189s) [upload=20903]: Upload finished. err: <nil> Duration: 5.570728536s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 6 out of 60 is failed (threshold=3) [.......X...X..........X......X.............X............X...] duration: 2.014786368s FAIL (2025-08-08 06:03:27 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== 160951s) [upload=20968]: Done uploading segments... Aug 8 05:54:36.926841433 (20h14m36.51618642s) [upload=20968]: Upload finished. err: <nil> Aug 8 05:55:27.854993433 (20h15m27.44433842s) [upload=20984]: Starting upload Aug 8 05:55:27.855037267 (20h15m27.444382254s) [upload=20984]: Done starting upload Aug 8 05:55:27.855083446 (20h15m27.444428433s) [upload=20984]: Uploading segments... Aug 8 05:55:27.855122760 (20h15m27.444467737s) [upload=20984]: Got next segment. Inline: true Aug 8 05:55:27.855126417 (20h15m27.444471404s) [upload=20984]: Waiting for error group managing segments... Aug 8 05:55:27.855155914 (20h15m27.444500901s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:55:27.855159560 (20h15m27.444504547s) [upload=20984]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:55:27.855163459 (20h15m27.444508446s) [upload=20984]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:55:28.125690519 (20h15m27.715035507s) [upload=20984]: Done uploading segments... Aug 8 05:55:28.125709145 (20h15m27.715054132s) [upload=20984]: Upload finished. err: <nil> Aug 8 05:56:12.975108195 (20h16m12.564453192s) [upload=20997]: Starting upload Aug 8 05:56:12.975180884 (20h16m12.564525871s) [upload=20997]: Done starting upload Aug 8 05:56:12.975225229 (20h16m12.564570206s) [upload=20997]: Uploading segments... Aug 8 05:56:12.975287538 (20h16m12.564632525s) [upload=20997]: Got next segment. Inline: true Aug 8 05:56:12.975292537 (20h16m12.564637524s) [upload=20997]: Waiting for error group managing segments... Aug 8 05:56:12.975330330 (20h16m12.564675317s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:56:12.975334578 (20h16m12.564679565s) [upload=20997]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:56:12.975337123 (20h16m12.5646821s) [upload=20997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:56:13.249013471 (20h16m12.838358478s) [upload=20997]: Done uploading segments... Aug 8 05:56:13.249036024 (20h16m12.838381011s) [upload=20997]: Upload finished. err: <nil> Aug 8 05:57:00.963085117 (20h17m0.552430125s) [upload=21012]: Starting upload Aug 8 05:57:00.963153639 (20h17m0.552498626s) [upload=21012]: Done starting upload Aug 8 05:57:00.963221999 (20h17m0.552566996s) [upload=21012]: Uploading segments... Aug 8 05:57:00.963261165 (20h17m0.552606152s) [upload=21012]: Got next segment. Inline: true Aug 8 05:57:00.963266154 (20h17m0.552611141s) [upload=21012]: Waiting for error group managing segments... Aug 8 05:57:00.963311341 (20h17m0.552656348s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:00.963316741 (20h17m0.552661738s) [upload=21012]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:00.963320128 (20h17m0.552665115s) [upload=21012]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:01.228868724 (20h17m0.818213711s) [upload=21012]: Done uploading segments... Aug 8 05:57:01.228887450 (20h17m0.818232437s) [upload=21012]: Upload finished. err: <nil> Aug 8 05:57:24.321170903 (20h17m23.91051589s) [upload=21016]: Starting upload Aug 8 05:57:24.321217862 (20h17m23.910562849s) [upload=21016]: Done starting upload Aug 8 05:57:24.321267848 (20h17m23.910612835s) [upload=21016]: Uploading segments... Aug 8 05:57:24.321295200 (20h17m23.910640187s) [upload=21016]: Got next segment. Inline: true Aug 8 05:57:24.321299188 (20h17m23.910644175s) [upload=21016]: Waiting for error group managing segments... Aug 8 05:57:24.321332873 (20h17m23.91067786s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:24.321337021 (20h17m23.910682008s) [upload=21016]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:24.321339625 (20h17m23.910684613s) [upload=21016]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:24.588125509 (20h17m24.177470496s) [upload=21016]: Done uploading segments... Aug 8 05:57:24.588141280 (20h17m24.177486267s) [upload=21016]: Upload finished. err: <nil> Aug 8 05:57:44.984884963 (20h17m44.57422994s) [upload=21023]: Starting upload Aug 8 05:57:44.984936812 (20h17m44.574281799s) [upload=21023]: Done starting upload Aug 8 05:57:44.984983341 (20h17m44.574328318s) [upload=21023]: Uploading segments... Aug 8 05:57:44.985012868 (20h17m44.574357855s) [upload=21023]: Got next segment. Inline: true Aug 8 05:57:44.985016384 (20h17m44.574361371s) [upload=21023]: Waiting for error group managing segments... Aug 8 05:57:44.985049217 (20h17m44.574394204s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:57:44.985053685 (20h17m44.574398672s) [upload=21023]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:57:44.985056100 (20h17m44.574401087s) [upload=21023]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:57:45.266330504 (20h17m44.855675502s) [upload=21023]: Done uploading segments... Aug 8 05:57:45.266352646 (20h17m44.855697673s) [upload=21023]: Upload finished. err: <nil> Aug 8 05:58:38.485929103 (20h18m38.07527409s) [upload=21038]: Starting upload Aug 8 05:58:38.485976022 (20h18m38.075321009s) [upload=21038]: Done starting upload Aug 8 05:58:38.486076905 (20h18m38.075421892s) [upload=21038]: Uploading segments... Aug 8 05:58:38.486169102 (20h18m38.07551409s) [upload=21038]: Got next segment. Inline: true Aug 8 05:58:38.486175585 (20h18m38.075520572s) [upload=21038]: Waiting for error group managing segments... Aug 8 05:58:38.486240599 (20h18m38.075585586s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:58:38.486248534 (20h18m38.075593521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:58:38.486253514 (20h18m38.075598521s) [upload=21038]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:58:38.744419005 (20h18m38.333763992s) [upload=21038]: Done uploading segments... Aug 8 05:58:38.744438663 (20h18m38.33378365s) [upload=21038]: Upload finished. err: <nil> Aug 8 05:59:50.694095379 (20h19m50.283440366s) [upload=21061]: Starting upload Aug 8 05:59:50.694206050 (20h19m50.283551037s) [upload=21061]: Done starting upload Aug 8 05:59:50.694302564 (20h19m50.283647552s) [upload=21061]: Uploading segments... Aug 8 05:59:50.694344205 (20h19m50.283689192s) [upload=21061]: Got next segment. Inline: true Aug 8 05:59:50.694348683 (20h19m50.28369367s) [upload=21061]: Waiting for error group managing segments... Aug 8 05:59:50.694393579 (20h19m50.283738566s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 05:59:50.694398278 (20h19m50.283743265s) [upload=21061]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 05:59:50.694400452 (20h19m50.283745439s) [upload=21061]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 05:59:50.960603812 (20h19m50.549948799s) [upload=21061]: Done uploading segments... Aug 8 05:59:50.960623008 (20h19m50.549967996s) [upload=21061]: Upload finished. err: <nil> Aug 8 06:00:05.820178578 (20h20m5.409523575s) [upload=21064]: Starting upload Aug 8 06:00:05.820224024 (20h20m5.409569011s) [upload=21064]: Done starting upload Aug 8 06:00:05.820280151 (20h20m5.409625148s) [upload=21064]: Uploading segments... Aug 8 06:00:05.820313224 (20h20m5.409658211s) [upload=21064]: Got next segment. Inline: true Aug 8 06:00:05.820317283 (20h20m5.40966227s) [upload=21064]: Waiting for error group managing segments... Aug 8 06:00:05.820356718 (20h20m5.409701705s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:05.820361287 (20h20m5.409706284s) [upload=21064]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:05.820363932 (20h20m5.409708919s) [upload=21064]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:06.105183529 (20h20m5.694528516s) [upload=21064]: Done uploading segments... Aug 8 06:00:06.105206524 (20h20m5.694551511s) [upload=21064]: Upload finished. err: <nil> Aug 8 06:00:39.721535110 (20h20m39.310880097s) [upload=21078]: Starting upload Aug 8 06:00:39.721598201 (20h20m39.310943188s) [upload=21078]: Done starting upload Aug 8 06:00:39.721649058 (20h20m39.310994045s) [upload=21078]: Uploading segments... Aug 8 06:00:39.721702660 (20h20m39.311047647s) [upload=21078]: Got next segment. Inline: true Aug 8 06:00:39.721706318 (20h20m39.311051305s) [upload=21078]: Waiting for error group managing segments... Aug 8 06:00:39.721750833 (20h20m39.31109582s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:00:39.721755371 (20h20m39.311100358s) [upload=21078]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:00:39.721757786 (20h20m39.311102773s) [upload=21078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:00:39.985732442 (20h20m39.575077429s) [upload=21078]: Done uploading segments... Aug 8 06:00:39.985751518 (20h20m39.575096505s) [upload=21078]: Upload finished. err: <nil> Aug 8 06:01:01.755195514 (20h21m1.344540511s) [upload=21083]: Starting upload Aug 8 06:01:01.755269686 (20h21m1.344614683s) [upload=21083]: Done starting upload Aug 8 06:01:01.755363906 (20h21m1.344708893s) [upload=21083]: Uploading segments... Aug 8 06:01:01.755543540 (20h21m1.344888537s) [upload=21083]: Got next segment. Inline: true Aug 8 06:01:01.755549311 (20h21m1.344894308s) [upload=21083]: Waiting for error group managing segments... Aug 8 06:01:01.755615418 (20h21m1.344960415s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 06:01:01.755620938 (20h21m1.344965925s) [upload=21083]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 06:01:01.755623503 (20h21m1.34496849s) [upload=21083]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 06:01:02.090931160 (20h21m1.680276157s) [upload=21083]: Done uploading segments... Aug 8 06:01:02.090955637 (20h21m1.680300624s) [upload=21083]: Upload finished. err: <nil> Duration: 2.014816917s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)