Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 8.931377887s FAIL (2025-09-08 13:35:06 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 8.931401602s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 15.166499381s FAIL (2025-09-08 13:34:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 15.16652486s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 27 out of 60 is failed (threshold=3) [.X..X..XX.......X.......X.XX.XX.X....XXXXXXXXX.XX....XX.XX.X] duration: 30.001717411s FAIL (2025-09-08 13:34:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 13:34:04.006416921 (48h5m40.045990041s) [upload=42253]: Starting upload Sep 8 13:34:04.006496163 (48h5m40.046069273s) [upload=42253]: Done starting upload Sep 8 13:34:04.006629378 (48h5m40.046202498s) [upload=42253]: Uploading segments... Sep 8 13:34:04.006778943 (48h5m40.046352053s) [upload=42253]: Got next segment. Inline: false Sep 8 13:34:04.006813350 (48h5m40.04638647s) [upload=42253]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 13:34:04.006818309 (48h5m40.046391419s) [upload=42253]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 13:34:06.494565538 (48h5m42.534138668s) [seg_pos={0 0}, upload=42253]: Begin upload segment... Sep 8 13:34:06.494631834 (48h5m42.534205004s) [seg_pos={0 0}, upload=42253]: Done begin upload segment. Sep 8 13:34:06.494737426 (48h5m42.534310546s) [noise=true , address=145.79.227.18:4007 , piece_id=6FLWMIGADAI54ROWLGWI2DE4ODOJM2RH7VPKVEPXH2N3E2KSFHTA, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.494760741 (48h5m42.534333901s) [noise=true , address=45.91.116.9:4262 , piece_id=THNDZ3BCCZEFZECKRBSQD5FNSJEOMDV65CVDCQ2R2QGSPJUQFR7Q, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.495189322 (48h5m42.534762442s) [noise=true , address=45.91.116.4:4937 , piece_id=THQ52TU4SSQ6FB6X2UWZWOFOALZGUEO5TUPWVKQ5YW533MPGPX5Q, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.495484936 (48h5m42.535058056s) [noise=true , address=77.90.31.14:4663 , piece_id=3I3UHNOC76ZTDE4AV43GCDJLB36WRV4HA5I6VCL2R3DUGJJPUSBQ, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.495509283 (48h5m42.535082403s) [noise=true , address=45.91.116.8:4045 , piece_id=SWW6G3B6V25TEZBJVILH5SBYNQLCDCBQUEGNN3Z2H2CHW26ET72Q, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.495815830 (48h5m42.535388951s) [noise=true , address=77.90.31.15:4699 , piece_id=FA5JIEWHJHBWYGHTPJ7EVZYCLSNQ3TOK44QI56RDDANRN6ZF3GPA, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.496020602 (48h5m42.535593722s) [noise=true , address=45.91.116.5:4299 , piece_id=RXQGBOPUPYPRQITALKDWCEQR6OVDY5SAWPUJBZENUFBGHULRLZ5A, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.496252366 (48h5m42.535825496s) [noise=true , address=45.91.116.13:4153 , piece_id=NR23UMOASQGE3TYRBTN6RGOVOLXKQTR6FAV4OAH3NAFKRZBYCM5Q, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.496322439 (48h5m42.535895559s) [noise=true , address=145.79.227.11:4730 , piece_id=RRI7RUOX2VU64KB5MCJJ7XICPTULYPNGNFVIDCCHVFRZNY4J6KGQ, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.496557720 (48h5m42.53613084s) [noise=true , address=77.90.31.18:4807 , piece_id=TJOSKSNPROPX5SXW5HCOBCHB6UDCRYAWS6USD5AZUHAN3O7P6RZA, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.496801897 (48h5m42.536375007s) [noise=true , address=77.90.31.19:4841 , piece_id=5B4JVKCOT7QM3GKMXRNHJYD266RTEFQ7Q2Y44TEE5QQMMDT3I73A, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.497026056 (48h5m42.536599176s) [noise=true , address=145.79.227.14:4839 , piece_id=BKJP343FTF5FLTMF2K3QA4KZZ26FMQFSJJ4ZWZPTMZJJNCEBU53A, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.497299018 (48h5m42.536872138s) [noise=true , address=145.79.227.13:4802 , piece_id=D44DI6ENDIGKZPO35CHALLOTY7APM3VL3MQTF5RIKUJ5KA34X57A, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.497630472 (48h5m42.537203593s) [noise=true , address=45.91.116.14:4189 , piece_id=4JECRRANRTHXY7UUQY4TCP7DYFUKMA65QPFJPQJG3TSZVUZKK7SQ, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.497922251 (48h5m42.537495371s) [noise=true , address=45.91.116.11:4119 , piece_id=O2734TCS5Z2DY62UOYWEWYGTPCF442QJU2IIIWJBXMYPUYSQ22SA, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:06.499479271 (48h5m42.539052391s) [noise=true , address=45.91.116.6:4973 , piece_id=2BCEUMQFNJGYTKDGATIYHBSWWHVTY7IGQ3DQXSLRUI3SCEK2EY2Q, seg_pos={0 0}, upload=42253]: Uploading piece... Sep 8 13:34:08.401630240 (48h5m44.4412034s) [upload=42253]: Next returned nil segment Sep 8 13:34:08.401650639 (48h5m44.441223789s) [upload=42253]: Waiting for error group managing segments... Sep 8 13:34:08.720321066 (48h5m44.759894186s) [noise=true , address=45.91.116.5:4299 , piece_id=RXQGBOPUPYPRQITALKDWCEQR6OVDY5SAWPUJBZENUFBGHULRLZ5A, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:08.747418880 (48h5m44.786992s) [noise=true , address=45.91.116.13:4153 , piece_id=NR23UMOASQGE3TYRBTN6RGOVOLXKQTR6FAV4OAH3NAFKRZBYCM5Q, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:08.747886695 (48h5m44.787459815s) [noise=true , address=45.91.116.9:4262 , piece_id=THNDZ3BCCZEFZECKRBSQD5FNSJEOMDV65CVDCQ2R2QGSPJUQFR7Q, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:08.768352006 (48h5m44.807925116s) [noise=true , address=77.90.31.18:4807 , piece_id=TJOSKSNPROPX5SXW5HCOBCHB6UDCRYAWS6USD5AZUHAN3O7P6RZA, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:08.780642896 (48h5m44.820216006s) [noise=true , address=145.79.227.14:4839 , piece_id=BKJP343FTF5FLTMF2K3QA4KZZ26FMQFSJJ4ZWZPTMZJJNCEBU53A, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:08.811935015 (48h5m44.851508135s) [noise=true , address=45.91.116.4:4937 , piece_id=THQ52TU4SSQ6FB6X2UWZWOFOALZGUEO5TUPWVKQ5YW533MPGPX5Q, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:08.840900673 (48h5m44.880473793s) [noise=true , address=45.91.116.8:4045 , piece_id=SWW6G3B6V25TEZBJVILH5SBYNQLCDCBQUEGNN3Z2H2CHW26ET72Q, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:08.925286310 (48h5m44.96485943s) [noise=true , address=77.90.31.14:4663 , piece_id=3I3UHNOC76ZTDE4AV43GCDJLB36WRV4HA5I6VCL2R3DUGJJPUSBQ, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:08.930123496 (48h5m44.969696616s) [noise=true , address=77.90.31.15:4699 , piece_id=FA5JIEWHJHBWYGHTPJ7EVZYCLSNQ3TOK44QI56RDDANRN6ZF3GPA, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:08.993190689 (48h5m45.032763809s) [noise=true , address=45.91.116.14:4189 , piece_id=4JECRRANRTHXY7UUQY4TCP7DYFUKMA65QPFJPQJG3TSZVUZKK7SQ, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:09.029312711 (48h5m45.068885831s) [noise=true , address=45.91.116.6:4973 , piece_id=2BCEUMQFNJGYTKDGATIYHBSWWHVTY7IGQ3DQXSLRUI3SCEK2EY2Q, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:09.034492022 (48h5m45.074065142s) [noise=true , address=45.91.116.11:4119 , piece_id=O2734TCS5Z2DY62UOYWEWYGTPCF442QJU2IIIWJBXMYPUYSQ22SA, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:09.152937014 (48h5m45.192510134s) [noise=true , address=145.79.227.11:4730 , piece_id=RRI7RUOX2VU64KB5MCJJ7XICPTULYPNGNFVIDCCHVFRZNY4J6KGQ, seg_pos={0 0}, upload=42253]: Done uploading piece. err: <nil> Sep 8 13:34:09.152960149 (48h5m45.192533269s) [seg_pos={0 0}, upload=42253]: Segment reached optimal threshold of 13 pieces. Sep 8 13:34:09.153343682 (48h5m45.192916802s) [noise=true , address=77.90.31.19:4841 , piece_id=5B4JVKCOT7QM3GKMXRNHJYD266RTEFQ7Q2Y44TEE5QQMMDT3I73A, seg_pos={0 0}, upload=42253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA): protocol: write tcp 188.166.225.170:52718->77.90.31.19:4841: use of closed network connection; write tcp 188.166.225.170:52718->77.90.31.19:4841: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52718->77.90.31.19:4841: use of closed network connection Sep 8 13:34:09.153402515 (48h5m45.192975635s) [noise=true , address=145.79.227.18:4007 , piece_id=6FLWMIGADAI54ROWLGWI2DE4ODOJM2RH7VPKVEPXH2N3E2KSFHTA, seg_pos={0 0}, upload=42253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19A6vk5g5ajUnXEtmXKDb9TqtjEBLYEdDvwqYsCtXKdhYUxrnp): protocol: expected piece hash; context canceled; EOF Sep 8 13:34:09.153545809 (48h5m45.193118929s) [noise=true , address=145.79.227.13:4802 , piece_id=D44DI6ENDIGKZPO35CHALLOTY7APM3VL3MQTF5RIKUJ5KA34X57A, seg_pos={0 0}, upload=42253]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1v2RSYwuQZPTLdWGz4QEeEa9STJy1X6HkexD4RYkVjTHGrNcx4): protocol: read tcp 188.166.225.170:36502->145.79.227.13:4802: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 8 13:34:09.153556740 (48h5m45.19312986s) [seg_pos={0 0}, upload=42253]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 13:34:09.153623938 (48h5m45.193197058s) [upload=42253]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 13:34:09.153628106 (48h5m45.193201226s) [upload=42253]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 13:34:09.592514476 (48h5m45.632087596s) [upload=42253]: Done uploading segments... Sep 8 13:34:09.592532419 (48h5m45.632105539s) [upload=42253]: Upload finished. err: <nil> Duration: 30.001741017s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.378929478s FAIL (2025-09-08 13:34:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.378956449s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.331366623s FAIL (2025-09-08 13:34:25 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 2.331399867s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.35232513s FAIL (2025-09-08 13:34:25 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.352353683s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.386526294s FAIL (2025-09-08 13:34:04 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.386571462s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 23.511958821s FAIL (2025-09-08 13:34:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 23.511985492s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 13.474746187s FAIL (2025-09-08 13:34:01 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 13.474782948s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.411531795s FAIL (2025-09-08 13:34:00 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 2.411564819s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.194483661s FAIL (2025-09-08 13:33:37 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.194505712s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.19816197s FAIL (2025-09-08 13:33:31 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.198190464s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.4525787s FAIL (2025-09-08 13:33:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.45266287s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 26 out of 60 is failed (threshold=3) [..X..X..XX.......X.......X.XX.XX.X....XXXXXXXXX.XX....XX.XX.] duration: 29.283762232s FAIL (2025-09-08 13:33:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 13:31:58.753199933 (48h3m34.792773063s) [upload=42221]: Starting upload Sep 8 13:31:58.753256351 (48h3m34.792829481s) [upload=42221]: Done starting upload Sep 8 13:31:58.753439211 (48h3m34.793012331s) [upload=42221]: Uploading segments... Sep 8 13:31:58.753473677 (48h3m34.793046787s) [upload=42221]: Got next segment. Inline: false Sep 8 13:31:58.753496350 (48h3m34.79306947s) [upload=42221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 13:31:58.753500438 (48h3m34.793073558s) [upload=42221]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 13:31:59.318340147 (48h3m35.357913267s) [seg_pos={0 0}, upload=42221]: Begin upload segment... Sep 8 13:31:59.318393739 (48h3m35.357966859s) [seg_pos={0 0}, upload=42221]: Done begin upload segment. Sep 8 13:31:59.318409539 (48h3m35.357982659s) [noise=true , address=77.90.31.18:4807 , piece_id=7NUUFZBDP4KRALDXM7HVMB5JLXVZTZ6LOTX4LPTUV3YQXDEPIF2Q, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.318419268 (48h3m35.357992388s) [noise=true , address=45.91.116.8:4045 , piece_id=G562KLXIKQDFBWB6Z5ZXGYW4G6ISYE3XF2CLU2IAMIZWXO3G2A4Q, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.318913284 (48h3m35.358486394s) [noise=true , address=45.91.116.13:4153 , piece_id=A4T2F42FJV2ZJISGCVRWDYM2ZHL4P4SB7L53MXUYZHPBARKOJR4Q, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.318934854 (48h3m35.358507974s) [noise=true , address=45.91.116.12:4226 , piece_id=HR7T23H4KFVCZAG4KIFM64ID3AH52NJD4OMDBGIEXWLQQGMWLWRQ, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.319219960 (48h3m35.35879308s) [noise=true , address=45.91.116.9:4262 , piece_id=3RKVNGBQ2RYIATMN75HLDZU4UH3MAQINQSUOJ7LPLP5XIR3UBAMQ, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.319919047 (48h3m35.359492227s) [noise=true , address=77.90.31.14:4663 , piece_id=FPCGFM36Q35G3PMOZ7HS3TJU5ZVS4QR7QJ5U7G2IIXSFZGPXYHDQ, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.320233860 (48h3m35.35980698s) [noise=true , address=77.90.31.12:4589 , piece_id=3R7JI7VAQ56NF6T27WGE6G34NR7DAZRNNZFCR7LOLVTCRDQ2WEXQ, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.320470383 (48h3m35.360043503s) [noise=true , address=77.90.31.13:4628 , piece_id=QWHVZ4YDRPUNC2ED2ZXWTSQTLLHLTHVBQR22YC7FTNUYE7RWLLZQ, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.320709039 (48h3m35.360282159s) [noise=true , address=45.91.116.7:4009 , piece_id=MZLZ32LSDXTN6TLTD55ZNGU5U4TDWQWDJBFBM6JFFUD2PWCIDB3Q, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.320958166 (48h3m35.360531286s) [noise=true , address=45.91.116.8:4047 , piece_id=Q2J5K4XEO64M7IX7GCM2A2RAE2K6N642INM3DRFM22DY4TSYTOCA, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.321174931 (48h3m35.360748041s) [noise=true , address=45.91.116.4:4938 , piece_id=5TZIZ7PGIDEUO7WB3MIHBJR2RF55S4QB5SXASL6LP7EDIQWQZ4MA, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.321432374 (48h3m35.361005494s) [noise=true , address=145.79.227.15:4874 , piece_id=OGEXCUXKO7N6B5UZOABZPLJE3QVHHL6S7SODPOTGW5XN75FY6G5A, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.321660159 (48h3m35.361233289s) [noise=true , address=45.91.116.14:4190 , piece_id=MVS7UFMKNAJ34UM4NEB67RC37PKVC5QN26OZR7BNPBNHRVPAQ3DA, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.321963590 (48h3m35.36153671s) [noise=true , address=45.91.116.6:4973 , piece_id=XORGADDOB4NYJEBUKKV3VL77RAA3EFPRTF2QH2OZWLUXEOK4D7EA, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.322229288 (48h3m35.361802409s) [noise=true , address=45.91.116.4:4937 , piece_id=5FJR3SWFXVMECN3G4USY5YND3DUNGBBJUCOVI6LWIFKRMLBVKV6A, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.322497542 (48h3m35.362070662s) [noise=true , address=45.91.116.5:4298 , piece_id=BH26VY5Z5WMCYFT475L7OXYGEBFIZL4VR2XXGMAC5HFPBCVZKUDA, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:32:01.209283423 (48h3m37.248856543s) [upload=42221]: Next returned nil segment Sep 8 13:32:01.209304914 (48h3m37.248878044s) [upload=42221]: Waiting for error group managing segments... Sep 8 13:32:01.549065909 (48h3m37.588639059s) [noise=true , address=45.91.116.8:4047 , piece_id=Q2J5K4XEO64M7IX7GCM2A2RAE2K6N642INM3DRFM22DY4TSYTOCA, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.555028518 (48h3m37.594601648s) [noise=true , address=77.90.31.13:4628 , piece_id=QWHVZ4YDRPUNC2ED2ZXWTSQTLLHLTHVBQR22YC7FTNUYE7RWLLZQ, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.572873987 (48h3m37.612447117s) [noise=true , address=77.90.31.14:4663 , piece_id=FPCGFM36Q35G3PMOZ7HS3TJU5ZVS4QR7QJ5U7G2IIXSFZGPXYHDQ, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.573292708 (48h3m37.612865838s) [noise=true , address=45.91.116.4:4937 , piece_id=5FJR3SWFXVMECN3G4USY5YND3DUNGBBJUCOVI6LWIFKRMLBVKV6A, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.574255069 (48h3m37.613828199s) [noise=true , address=45.91.116.7:4009 , piece_id=MZLZ32LSDXTN6TLTD55ZNGU5U4TDWQWDJBFBM6JFFUD2PWCIDB3Q, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.586965702 (48h3m37.626538832s) [noise=true , address=45.91.116.6:4973 , piece_id=XORGADDOB4NYJEBUKKV3VL77RAA3EFPRTF2QH2OZWLUXEOK4D7EA, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.614974739 (48h3m37.654547859s) [noise=true , address=45.91.116.9:4262 , piece_id=3RKVNGBQ2RYIATMN75HLDZU4UH3MAQINQSUOJ7LPLP5XIR3UBAMQ, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.672242214 (48h3m37.711815344s) [noise=true , address=145.79.227.15:4874 , piece_id=OGEXCUXKO7N6B5UZOABZPLJE3QVHHL6S7SODPOTGW5XN75FY6G5A, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.680924368 (48h3m37.720497488s) [noise=true , address=77.90.31.18:4807 , piece_id=7NUUFZBDP4KRALDXM7HVMB5JLXVZTZ6LOTX4LPTUV3YQXDEPIF2Q, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.691223577 (48h3m37.730796707s) [noise=true , address=45.91.116.12:4226 , piece_id=HR7T23H4KFVCZAG4KIFM64ID3AH52NJD4OMDBGIEXWLQQGMWLWRQ, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.692878122 (48h3m37.732451242s) [noise=true , address=45.91.116.5:4298 , piece_id=BH26VY5Z5WMCYFT475L7OXYGEBFIZL4VR2XXGMAC5HFPBCVZKUDA, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.699499924 (48h3m37.739073044s) [noise=true , address=45.91.116.13:4153 , piece_id=A4T2F42FJV2ZJISGCVRWDYM2ZHL4P4SB7L53MXUYZHPBARKOJR4Q, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.743066572 (48h3m37.782639702s) [noise=true , address=77.90.31.12:4589 , piece_id=3R7JI7VAQ56NF6T27WGE6G34NR7DAZRNNZFCR7LOLVTCRDQ2WEXQ, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.743106228 (48h3m37.782679348s) [seg_pos={0 0}, upload=42221]: Segment reached optimal threshold of 13 pieces. Sep 8 13:32:01.743279189 (48h3m37.782852319s) [noise=true , address=45.91.116.4:4938 , piece_id=5TZIZ7PGIDEUO7WB3MIHBJR2RF55S4QB5SXASL6LP7EDIQWQZ4MA, seg_pos={0 0}, upload=42221]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: expected piece hash; context canceled; EOF Sep 8 13:32:01.743412654 (48h3m37.782985784s) [noise=true , address=45.91.116.14:4190 , piece_id=MVS7UFMKNAJ34UM4NEB67RC37PKVC5QN26OZR7BNPBNHRVPAQ3DA, seg_pos={0 0}, upload=42221]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Sep 8 13:32:01.743421351 (48h3m37.782994472s) [noise=true , address=45.91.116.8:4045 , piece_id=G562KLXIKQDFBWB6Z5ZXGYW4G6ISYE3XF2CLU2IAMIZWXO3G2A4Q, seg_pos={0 0}, upload=42221]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:42052->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:42052->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42052->45.91.116.8:4045: use of closed network connection Sep 8 13:32:01.743448212 (48h3m37.783021332s) [seg_pos={0 0}, upload=42221]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 13:32:01.743553624 (48h3m37.783126744s) [upload=42221]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 13:32:01.743561510 (48h3m37.78313463s) [upload=42221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 13:32:02.972482653 (48h3m39.012055784s) [upload=42221]: Done uploading segments... Sep 8 13:32:02.972511218 (48h3m39.012084338s) [upload=42221]: Upload finished. err: <nil> Duration: 29.283800645s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.676584832s FAIL (2025-09-08 13:33:19 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.676622082s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 13.222305319s FAIL (2025-09-08 13:33:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 13.222333662s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 20.105824464s FAIL (2025-09-08 13:32:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 20.105867156s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.534092201s FAIL (2025-09-08 13:32:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.534111929s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.209998829s FAIL (2025-09-08 13:32:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 2.210029017s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 9.591570844s FAIL (2025-09-08 13:32:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 9.591594198s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 7.476717738s FAIL (2025-09-08 13:32:48 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 7.476739869s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.280828095s FAIL (2025-09-08 13:32:34 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.280852572s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 19.155993085s FAIL (2025-09-08 13:32:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 19.15601176s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.495179165s FAIL (2025-09-08 13:32:33 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.495206688s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 3.828011221s FAIL (2025-09-08 13:32:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 3.828036139s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 26 out of 60 is failed (threshold=3) [...X..X..XX.......X.......X.XX.XX.X....XXXXXXXXX.XX....XX.XX] duration: 30.001941107s FAIL (2025-09-08 13:32:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 13:31:58.753199933 (48h3m34.792773063s) [upload=42221]: Starting upload Sep 8 13:31:58.753256351 (48h3m34.792829481s) [upload=42221]: Done starting upload Sep 8 13:31:58.753439211 (48h3m34.793012331s) [upload=42221]: Uploading segments... Sep 8 13:31:58.753473677 (48h3m34.793046787s) [upload=42221]: Got next segment. Inline: false Sep 8 13:31:58.753496350 (48h3m34.79306947s) [upload=42221]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 13:31:58.753500438 (48h3m34.793073558s) [upload=42221]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 13:31:59.318340147 (48h3m35.357913267s) [seg_pos={0 0}, upload=42221]: Begin upload segment... Sep 8 13:31:59.318393739 (48h3m35.357966859s) [seg_pos={0 0}, upload=42221]: Done begin upload segment. Sep 8 13:31:59.318409539 (48h3m35.357982659s) [noise=true , address=77.90.31.18:4807 , piece_id=7NUUFZBDP4KRALDXM7HVMB5JLXVZTZ6LOTX4LPTUV3YQXDEPIF2Q, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.318419268 (48h3m35.357992388s) [noise=true , address=45.91.116.8:4045 , piece_id=G562KLXIKQDFBWB6Z5ZXGYW4G6ISYE3XF2CLU2IAMIZWXO3G2A4Q, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.318913284 (48h3m35.358486394s) [noise=true , address=45.91.116.13:4153 , piece_id=A4T2F42FJV2ZJISGCVRWDYM2ZHL4P4SB7L53MXUYZHPBARKOJR4Q, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.318934854 (48h3m35.358507974s) [noise=true , address=45.91.116.12:4226 , piece_id=HR7T23H4KFVCZAG4KIFM64ID3AH52NJD4OMDBGIEXWLQQGMWLWRQ, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.319219960 (48h3m35.35879308s) [noise=true , address=45.91.116.9:4262 , piece_id=3RKVNGBQ2RYIATMN75HLDZU4UH3MAQINQSUOJ7LPLP5XIR3UBAMQ, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.319919047 (48h3m35.359492227s) [noise=true , address=77.90.31.14:4663 , piece_id=FPCGFM36Q35G3PMOZ7HS3TJU5ZVS4QR7QJ5U7G2IIXSFZGPXYHDQ, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.320233860 (48h3m35.35980698s) [noise=true , address=77.90.31.12:4589 , piece_id=3R7JI7VAQ56NF6T27WGE6G34NR7DAZRNNZFCR7LOLVTCRDQ2WEXQ, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.320470383 (48h3m35.360043503s) [noise=true , address=77.90.31.13:4628 , piece_id=QWHVZ4YDRPUNC2ED2ZXWTSQTLLHLTHVBQR22YC7FTNUYE7RWLLZQ, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.320709039 (48h3m35.360282159s) [noise=true , address=45.91.116.7:4009 , piece_id=MZLZ32LSDXTN6TLTD55ZNGU5U4TDWQWDJBFBM6JFFUD2PWCIDB3Q, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.320958166 (48h3m35.360531286s) [noise=true , address=45.91.116.8:4047 , piece_id=Q2J5K4XEO64M7IX7GCM2A2RAE2K6N642INM3DRFM22DY4TSYTOCA, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.321174931 (48h3m35.360748041s) [noise=true , address=45.91.116.4:4938 , piece_id=5TZIZ7PGIDEUO7WB3MIHBJR2RF55S4QB5SXASL6LP7EDIQWQZ4MA, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.321432374 (48h3m35.361005494s) [noise=true , address=145.79.227.15:4874 , piece_id=OGEXCUXKO7N6B5UZOABZPLJE3QVHHL6S7SODPOTGW5XN75FY6G5A, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.321660159 (48h3m35.361233289s) [noise=true , address=45.91.116.14:4190 , piece_id=MVS7UFMKNAJ34UM4NEB67RC37PKVC5QN26OZR7BNPBNHRVPAQ3DA, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.321963590 (48h3m35.36153671s) [noise=true , address=45.91.116.6:4973 , piece_id=XORGADDOB4NYJEBUKKV3VL77RAA3EFPRTF2QH2OZWLUXEOK4D7EA, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.322229288 (48h3m35.361802409s) [noise=true , address=45.91.116.4:4937 , piece_id=5FJR3SWFXVMECN3G4USY5YND3DUNGBBJUCOVI6LWIFKRMLBVKV6A, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:31:59.322497542 (48h3m35.362070662s) [noise=true , address=45.91.116.5:4298 , piece_id=BH26VY5Z5WMCYFT475L7OXYGEBFIZL4VR2XXGMAC5HFPBCVZKUDA, seg_pos={0 0}, upload=42221]: Uploading piece... Sep 8 13:32:01.209283423 (48h3m37.248856543s) [upload=42221]: Next returned nil segment Sep 8 13:32:01.209304914 (48h3m37.248878044s) [upload=42221]: Waiting for error group managing segments... Sep 8 13:32:01.549065909 (48h3m37.588639059s) [noise=true , address=45.91.116.8:4047 , piece_id=Q2J5K4XEO64M7IX7GCM2A2RAE2K6N642INM3DRFM22DY4TSYTOCA, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.555028518 (48h3m37.594601648s) [noise=true , address=77.90.31.13:4628 , piece_id=QWHVZ4YDRPUNC2ED2ZXWTSQTLLHLTHVBQR22YC7FTNUYE7RWLLZQ, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.572873987 (48h3m37.612447117s) [noise=true , address=77.90.31.14:4663 , piece_id=FPCGFM36Q35G3PMOZ7HS3TJU5ZVS4QR7QJ5U7G2IIXSFZGPXYHDQ, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.573292708 (48h3m37.612865838s) [noise=true , address=45.91.116.4:4937 , piece_id=5FJR3SWFXVMECN3G4USY5YND3DUNGBBJUCOVI6LWIFKRMLBVKV6A, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.574255069 (48h3m37.613828199s) [noise=true , address=45.91.116.7:4009 , piece_id=MZLZ32LSDXTN6TLTD55ZNGU5U4TDWQWDJBFBM6JFFUD2PWCIDB3Q, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.586965702 (48h3m37.626538832s) [noise=true , address=45.91.116.6:4973 , piece_id=XORGADDOB4NYJEBUKKV3VL77RAA3EFPRTF2QH2OZWLUXEOK4D7EA, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.614974739 (48h3m37.654547859s) [noise=true , address=45.91.116.9:4262 , piece_id=3RKVNGBQ2RYIATMN75HLDZU4UH3MAQINQSUOJ7LPLP5XIR3UBAMQ, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.672242214 (48h3m37.711815344s) [noise=true , address=145.79.227.15:4874 , piece_id=OGEXCUXKO7N6B5UZOABZPLJE3QVHHL6S7SODPOTGW5XN75FY6G5A, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.680924368 (48h3m37.720497488s) [noise=true , address=77.90.31.18:4807 , piece_id=7NUUFZBDP4KRALDXM7HVMB5JLXVZTZ6LOTX4LPTUV3YQXDEPIF2Q, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.691223577 (48h3m37.730796707s) [noise=true , address=45.91.116.12:4226 , piece_id=HR7T23H4KFVCZAG4KIFM64ID3AH52NJD4OMDBGIEXWLQQGMWLWRQ, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.692878122 (48h3m37.732451242s) [noise=true , address=45.91.116.5:4298 , piece_id=BH26VY5Z5WMCYFT475L7OXYGEBFIZL4VR2XXGMAC5HFPBCVZKUDA, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.699499924 (48h3m37.739073044s) [noise=true , address=45.91.116.13:4153 , piece_id=A4T2F42FJV2ZJISGCVRWDYM2ZHL4P4SB7L53MXUYZHPBARKOJR4Q, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.743066572 (48h3m37.782639702s) [noise=true , address=77.90.31.12:4589 , piece_id=3R7JI7VAQ56NF6T27WGE6G34NR7DAZRNNZFCR7LOLVTCRDQ2WEXQ, seg_pos={0 0}, upload=42221]: Done uploading piece. err: <nil> Sep 8 13:32:01.743106228 (48h3m37.782679348s) [seg_pos={0 0}, upload=42221]: Segment reached optimal threshold of 13 pieces. Sep 8 13:32:01.743279189 (48h3m37.782852319s) [noise=true , address=45.91.116.4:4938 , piece_id=5TZIZ7PGIDEUO7WB3MIHBJR2RF55S4QB5SXASL6LP7EDIQWQZ4MA, seg_pos={0 0}, upload=42221]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW): protocol: expected piece hash; context canceled; EOF Sep 8 13:32:01.743412654 (48h3m37.782985784s) [noise=true , address=45.91.116.14:4190 , piece_id=MVS7UFMKNAJ34UM4NEB67RC37PKVC5QN26OZR7BNPBNHRVPAQ3DA, seg_pos={0 0}, upload=42221]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JVvtSnmC6UL5tNSGeJg27797Z4T1DBsMLqVche429yRKvZZyG): protocol: expected piece hash; context canceled; EOF Sep 8 13:32:01.743421351 (48h3m37.782994472s) [noise=true , address=45.91.116.8:4045 , piece_id=G562KLXIKQDFBWB6Z5ZXGYW4G6ISYE3XF2CLU2IAMIZWXO3G2A4Q, seg_pos={0 0}, upload=42221]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9): protocol: write tcp 188.166.225.170:42052->45.91.116.8:4045: use of closed network connection; write tcp 188.166.225.170:42052->45.91.116.8:4045: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42052->45.91.116.8:4045: use of closed network connection Sep 8 13:32:01.743448212 (48h3m37.783021332s) [seg_pos={0 0}, upload=42221]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 13:32:01.743553624 (48h3m37.783126744s) [upload=42221]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 13:32:01.743561510 (48h3m37.78313463s) [upload=42221]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 13:32:02.972482653 (48h3m39.012055784s) [upload=42221]: Done uploading segments... Sep 8 13:32:02.972511218 (48h3m39.012084338s) [upload=42221]: Upload finished. err: <nil> Duration: 30.001956468s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 35.040938216s FAIL (2025-09-08 13:32:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 35.040972701s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.119840584s FAIL (2025-09-08 13:32:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 5.119900338s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.985790766s FAIL (2025-09-08 13:32:00 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.985820913s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 25 out of 60 is failed (threshold=3) [....X..X..XX.......X.......X.XX.XX.X....XXXXXXXXX.XX....XX.X] duration: 30.003352376s FAIL (2025-09-08 13:31:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 13:31:28.116599946 (48h3m4.156173066s) [upload=42211]: Starting upload Sep 8 13:31:28.116744603 (48h3m4.156317723s) [upload=42211]: Done starting upload Sep 8 13:31:28.116849093 (48h3m4.156422213s) [upload=42211]: Uploading segments... Sep 8 13:31:28.117032202 (48h3m4.156605322s) [upload=42211]: Got next segment. Inline: false Sep 8 13:31:28.117074664 (48h3m4.156647784s) [upload=42211]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 13:31:28.117079283 (48h3m4.156652403s) [upload=42211]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 13:31:28.470386629 (48h3m4.509959749s) [seg_pos={0 0}, upload=42211]: Begin upload segment... Sep 8 13:31:28.470438178 (48h3m4.510011298s) [seg_pos={0 0}, upload=42211]: Done begin upload segment. Sep 8 13:31:28.470463596 (48h3m4.510036716s) [noise=true , address=45.91.116.7:4011 , piece_id=P5PD4NDKCIWEF2KLUCAVSZOVBYPRS4WOHI7UCMXWRK7F5RIA2EEQ, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.470525725 (48h3m4.510098845s) [noise=true , address=77.90.31.10:4518 , piece_id=WFM753BAQUEFRO4NEIDEH7EKWUV7EY4RGOYXVKHS5UEM6TBXLPMQ, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.470858442 (48h3m4.510431562s) [noise=true , address=45.91.116.4:4940 , piece_id=USK6ZEYTBAAFXZ4D2IRBVACRKDLOLLYHWOBIK2SBY2GLKMDNC6LQ, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.470981918 (48h3m4.510555039s) [noise=true , address=45.91.116.10:4083 , piece_id=RU4S45DAQTJRZBRU33ECMLMH7TGHGNU7CTPR7AU6BLKDWKVVWNZQ, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.471154278 (48h3m4.510727398s) [noise=true , address=145.79.227.13:4801 , piece_id=OOADFT7GV6Y6BBCQZYJYJKTEXU46L6UGDUVITVHM5L7XSLUZP2PA, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.471335786 (48h3m4.510908916s) [noise=true , address=145.79.227.17:4972 , piece_id=YIJBVBJRCYJR2XA2VPJAJIH6OA7V5USMHS7JBGAMOJUHB34B2QHA, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.471448942 (48h3m4.511022062s) [noise=true , address=45.91.116.9:4261 , piece_id=RALN5QX4UJXGIRYPNWEG7YSNTXF3K2ZL4YLW4Z6IKFKLO7VHCRSQ, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.471640158 (48h3m4.511213278s) [noise=true , address=45.91.116.6:4974 , piece_id=6A2JYXLKKDMNZRZTJC6W5JXYM6XJUYJN6J7RWT2JNFHO5MJNYMUQ, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.471713548 (48h3m4.511286668s) [noise=true , address=45.91.116.4:4937 , piece_id=74PK6VEQ5AZQCUN3JHCF7GGZAFMMEJXTWZ57L4DBG6EN6A2KDE2Q, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.471938830 (48h3m4.51151197s) [noise=true , address=45.91.116.13:4155 , piece_id=XE3ZCY37QJRS3GF3WTFJM6BCRRCN4LZIX53QUAA2FT2WUE66EXDQ, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.471983845 (48h3m4.511556965s) [noise=true , address=145.79.227.15:4874 , piece_id=GTFEUW7YB7VXRMRIQFJ6GNNMLWVGMPXA5TVZNVYJJ2O6V4T6QAQQ, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.472184550 (48h3m4.51175767s) [noise=true , address=77.90.31.14:4663 , piece_id=YRDH6DQ5MOAAQBNQHQTW3VU6RET5RF5FAWB4KPWNWHHMGYMJBDVA, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.472237812 (48h3m4.511810932s) [noise=true , address=145.79.227.19:4078 , piece_id=SQVLB573PV4K4X4SLY77SXJ42KKD3ADCOBZGCCT7YAIAFRDUWYNQ, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.472403218 (48h3m4.511976328s) [noise=true , address=77.90.31.17:4770 , piece_id=EJAO6QDIIC5LN3D7WDRX73ON6JKH24QV4SJP4BQAFXQF5QITFEDA, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.472556120 (48h3m4.51212924s) [noise=true , address=45.91.116.12:4227 , piece_id=J7ZFU3TZHZ6UOAO6N75JDANY2URS6IF2G3SY2TR5S7GDGWES5WUA, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.472608871 (48h3m4.512181991s) [noise=true , address=77.90.31.18:4806 , piece_id=I4SCZWRFEOHIJLLOCM2OW5ZV2GH7S44RNRMQTT2BO3QCTX4E6POQ, seg_pos={0 0}, upload=42211]: Uploading piece... Sep 8 13:31:28.740452779 (48h3m4.780025899s) [noise=true , address=77.90.31.10:4518 , piece_id=WFM753BAQUEFRO4NEIDEH7EKWUV7EY4RGOYXVKHS5UEM6TBXLPMQ, seg_pos={0 0}, upload=42211]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: write tcp 188.166.225.170:49932->77.90.31.10:4518: write: connection refused; conn closed: op Sep 8 13:31:30.361873243 (48h3m6.401446363s) [upload=42211]: Next returned nil segment Sep 8 13:31:30.361926775 (48h3m6.401499895s) [upload=42211]: Waiting for error group managing segments... Sep 8 13:31:30.677914839 (48h3m6.717487959s) [noise=true , address=45.91.116.12:4227 , piece_id=J7ZFU3TZHZ6UOAO6N75JDANY2URS6IF2G3SY2TR5S7GDGWES5WUA, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:30.684915185 (48h3m6.724488315s) [noise=true , address=45.91.116.4:4940 , piece_id=USK6ZEYTBAAFXZ4D2IRBVACRKDLOLLYHWOBIK2SBY2GLKMDNC6LQ, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:30.686619776 (48h3m6.726192896s) [noise=true , address=145.79.227.15:4874 , piece_id=GTFEUW7YB7VXRMRIQFJ6GNNMLWVGMPXA5TVZNVYJJ2O6V4T6QAQQ, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:30.707206712 (48h3m6.746779832s) [noise=true , address=77.90.31.14:4663 , piece_id=YRDH6DQ5MOAAQBNQHQTW3VU6RET5RF5FAWB4KPWNWHHMGYMJBDVA, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:30.713161737 (48h3m6.752734867s) [noise=true , address=77.90.31.17:4770 , piece_id=EJAO6QDIIC5LN3D7WDRX73ON6JKH24QV4SJP4BQAFXQF5QITFEDA, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:30.720699070 (48h3m6.76027219s) [noise=true , address=45.91.116.6:4974 , piece_id=6A2JYXLKKDMNZRZTJC6W5JXYM6XJUYJN6J7RWT2JNFHO5MJNYMUQ, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:30.728085714 (48h3m6.767658834s) [noise=true , address=45.91.116.7:4011 , piece_id=P5PD4NDKCIWEF2KLUCAVSZOVBYPRS4WOHI7UCMXWRK7F5RIA2EEQ, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:30.771462159 (48h3m6.811035279s) [noise=true , address=45.91.116.4:4937 , piece_id=74PK6VEQ5AZQCUN3JHCF7GGZAFMMEJXTWZ57L4DBG6EN6A2KDE2Q, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:30.842464576 (48h3m6.882037706s) [noise=true , address=45.91.116.10:4083 , piece_id=RU4S45DAQTJRZBRU33ECMLMH7TGHGNU7CTPR7AU6BLKDWKVVWNZQ, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:30.920539267 (48h3m6.960112387s) [noise=true , address=45.91.116.9:4261 , piece_id=RALN5QX4UJXGIRYPNWEG7YSNTXF3K2ZL4YLW4Z6IKFKLO7VHCRSQ, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:30.931337811 (48h3m6.970910961s) [noise=true , address=145.79.227.13:4801 , piece_id=OOADFT7GV6Y6BBCQZYJYJKTEXU46L6UGDUVITVHM5L7XSLUZP2PA, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:30.967725040 (48h3m7.007298161s) [noise=true , address=145.79.227.19:4078 , piece_id=SQVLB573PV4K4X4SLY77SXJ42KKD3ADCOBZGCCT7YAIAFRDUWYNQ, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:31.715899903 (48h3m7.755473023s) [noise=true , address=45.91.116.13:4155 , piece_id=XE3ZCY37QJRS3GF3WTFJM6BCRRCN4LZIX53QUAA2FT2WUE66EXDQ, seg_pos={0 0}, upload=42211]: Done uploading piece. err: <nil> Sep 8 13:31:31.715923278 (48h3m7.755496398s) [seg_pos={0 0}, upload=42211]: Segment reached optimal threshold of 13 pieces. Sep 8 13:31:31.716208583 (48h3m7.755781734s) [noise=true , address=77.90.31.18:4806 , piece_id=I4SCZWRFEOHIJLLOCM2OW5ZV2GH7S44RNRMQTT2BO3QCTX4E6POQ, seg_pos={0 0}, upload=42211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ): protocol: write tcp 188.166.225.170:51892->77.90.31.18:4806: use of closed network connection; write tcp 188.166.225.170:51892->77.90.31.18:4806: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:51892->77.90.31.18:4806: use of closed network connection Sep 8 13:31:31.716308695 (48h3m7.755881815s) [noise=true , address=145.79.227.17:4972 , piece_id=YIJBVBJRCYJR2XA2VPJAJIH6OA7V5USMHS7JBGAMOJUHB34B2QHA, seg_pos={0 0}, upload=42211]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12natVZCpE83KmTNWBmNV6FGRy62n2HtcodmHwyDwpoDaP8qVBX): protocol: expected piece hash; context canceled; EOF Sep 8 13:31:31.716320317 (48h3m7.755893437s) [seg_pos={0 0}, upload=42211]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 13:31:31.716380302 (48h3m7.755953422s) [upload=42211]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 13:31:31.716384319 (48h3m7.755957439s) [upload=42211]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 13:31:32.060974395 (48h3m8.100547515s) [upload=42211]: Done uploading segments... Sep 8 13:31:32.060992831 (48h3m8.100565951s) [upload=42211]: Upload finished. err: <nil> Duration: 30.003379708s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.350053307s FAIL (2025-09-08 13:31:57 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.350075199s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.321650163s FAIL (2025-09-08 13:31:50 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 2.321672066s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.046032135s FAIL (2025-09-08 13:31:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 5.046053234s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.561617966s FAIL (2025-09-08 13:31:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.56164665s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.99883915s FAIL (2025-09-08 13:31:41 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.998869267s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.310261252s FAIL (2025-09-08 13:31:38 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.310285298s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.444136034s FAIL (2025-09-08 13:31:35 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.444168086s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.559569444s FAIL (2025-09-08 13:31:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.559590092s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 23.189449931s FAIL (2025-09-08 13:31:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 23.189472194s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 9.423067453s FAIL (2025-09-08 13:31:05 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 9.423095837s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.118604862s FAIL (2025-09-08 13:30:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 2.118676117s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 11.219649538s FAIL (2025-09-08 13:30:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 11.219672592s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 24 out of 60 is failed (threshold=3) [.....X..X..XX.......X.......X.XX.XX.X....XXXXXXXXX.XX....XX.] duration: 28.63687192s FAIL (2025-09-08 13:30:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 13:29:15.585971948 (48h0m51.625545068s) [upload=42180]: Starting upload Sep 8 13:29:15.586029267 (48h0m51.625602377s) [upload=42180]: Done starting upload Sep 8 13:29:15.586135461 (48h0m51.625708581s) [upload=42180]: Uploading segments... Sep 8 13:29:15.586268135 (48h0m51.625841255s) [upload=42180]: Got next segment. Inline: false Sep 8 13:29:15.586305516 (48h0m51.625878636s) [upload=42180]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 13:29:15.586309945 (48h0m51.625883065s) [upload=42180]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 13:29:15.832761167 (48h0m51.872334287s) [seg_pos={0 0}, upload=42180]: Begin upload segment... Sep 8 13:29:15.832812986 (48h0m51.872386106s) [seg_pos={0 0}, upload=42180]: Done begin upload segment. Sep 8 13:29:15.832844136 (48h0m51.872417256s) [noise=true , address=145.79.227.15:4875 , piece_id=PZFVDJVAGMS7YJN573LEBOHLA6FIFDEUD2YBMER4MPAAWPCZ5OLQ, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.832856609 (48h0m51.872429729s) [noise=true , address=45.91.116.5:4299 , piece_id=A4VK2TMKXX4FQL2SCSL2QOPBCPHCSZXIW6MRN6XJ2JMM4HEIOG5Q, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.832903910 (48h0m51.87247703s) [noise=true , address=77.90.31.13:4628 , piece_id=HB75C6RALUL2BHGUBEEF3GEK3KPIVXVNOCTFUXKNCAXKZAF34M2Q, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.833281072 (48h0m51.872854192s) [noise=true , address=77.90.31.12:4589 , piece_id=2Z2IGNQFSCXPIPI7KBZP2PYVWZPIGC3MGYDREAZM3PU26OU2OLMA, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.833342499 (48h0m51.872915619s) [noise=true , address=77.90.31.21:4878 , piece_id=FZQSLO4YUX4YN25HI2PN2B4PN3LZ43E5ZYSY6FZGI52NSFMXS2BA, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.833620711 (48h0m51.873193831s) [noise=true , address=77.90.31.16:4735 , piece_id=AW54UVYV4DZSQP2AV6DENYKXIR74BPVPYB2AS6FYNP7R6EQ4SUOQ, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.833828890 (48h0m51.873402s) [noise=true , address=145.79.227.19:4077 , piece_id=YDECF7HATZAQJDTWWVWLETKHIJDC65VXT3Z5UZCHQFX3L4M5HACA, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.833976262 (48h0m51.873549382s) [noise=true , address=45.91.116.6:4973 , piece_id=2DPHFDGAESHC4XCUJH2QLJN34NQH5Z5EFAYCNLBHY64X3UUN6CZA, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.834279342 (48h0m51.873852462s) [noise=true , address=45.91.116.12:4227 , piece_id=BKP3HIRDISNLVGOYXOFNNESNUALS4CCWEZNHD6YH2R7IOQ3N6PEQ, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.834622509 (48h0m51.874195629s) [noise=true , address=45.91.116.5:4298 , piece_id=C6RHSLJOQFQJUB5R6COHY4WNRDCSREBGW7D75NPCXNKU5YMTWKAA, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.834929776 (48h0m51.874502896s) [noise=true , address=77.90.31.19:4842 , piece_id=DPIPM22QEBLVQXAXLPMT2FFPW4W7UNQLH4O5BLEFUO5L6A6NZCEQ, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.835014228 (48h0m51.874587348s) [noise=true , address=145.79.227.7:4294 , piece_id=KJEJMGEHLHLSXIVRXGJZWORYQVPBBSRAV3MTSN3COOP74SIFLCLQ, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.835311286 (48h0m51.874884406s) [noise=true , address=45.91.116.8:4045 , piece_id=FCIEXJRBEH3E6UYUCDTVY23REQG6FSDXNX4JJI5P2RWFCTIJJRTQ, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.835337246 (48h0m51.874910366s) [noise=true , address=45.91.116.9:4262 , piece_id=PKPZ3JRMYCRBOWQLLKEUFVPVEFQ7JQL36ZIL3MZAKWK3E4F6BT3Q, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.835732914 (48h0m51.875306044s) [noise=true , address=145.79.227.19:4079 , piece_id=SHFBFENBZZG6NKH2TYFZE577534YIIH7RN7MDJ6MP3MD3JMBB6UQ, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:15.836106578 (48h0m51.875679698s) [noise=true , address=45.91.116.4:4938 , piece_id=CEUIXNTOCNA2VH4D4JANJOE6L4PDO4PEATYL5RNN6GXF2GIURJ7Q, seg_pos={0 0}, upload=42180]: Uploading piece... Sep 8 13:29:17.687456716 (48h0m53.727029836s) [upload=42180]: Next returned nil segment Sep 8 13:29:17.687473719 (48h0m53.727046839s) [upload=42180]: Waiting for error group managing segments... Sep 8 13:29:18.034255398 (48h0m54.073828518s) [noise=true , address=45.91.116.9:4262 , piece_id=PKPZ3JRMYCRBOWQLLKEUFVPVEFQ7JQL36ZIL3MZAKWK3E4F6BT3Q, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.038055550 (48h0m54.07762868s) [noise=true , address=45.91.116.4:4938 , piece_id=CEUIXNTOCNA2VH4D4JANJOE6L4PDO4PEATYL5RNN6GXF2GIURJ7Q, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.053407196 (48h0m54.092980316s) [noise=true , address=77.90.31.12:4589 , piece_id=2Z2IGNQFSCXPIPI7KBZP2PYVWZPIGC3MGYDREAZM3PU26OU2OLMA, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.144458419 (48h0m54.184031529s) [noise=true , address=45.91.116.8:4045 , piece_id=FCIEXJRBEH3E6UYUCDTVY23REQG6FSDXNX4JJI5P2RWFCTIJJRTQ, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.146332115 (48h0m54.185905235s) [noise=true , address=145.79.227.7:4294 , piece_id=KJEJMGEHLHLSXIVRXGJZWORYQVPBBSRAV3MTSN3COOP74SIFLCLQ, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.151222923 (48h0m54.190796043s) [noise=true , address=77.90.31.19:4842 , piece_id=DPIPM22QEBLVQXAXLPMT2FFPW4W7UNQLH4O5BLEFUO5L6A6NZCEQ, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.188955697 (48h0m54.228528817s) [noise=true , address=145.79.227.19:4077 , piece_id=YDECF7HATZAQJDTWWVWLETKHIJDC65VXT3Z5UZCHQFX3L4M5HACA, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.189134370 (48h0m54.22870749s) [noise=true , address=45.91.116.6:4973 , piece_id=2DPHFDGAESHC4XCUJH2QLJN34NQH5Z5EFAYCNLBHY64X3UUN6CZA, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.205786214 (48h0m54.245359334s) [noise=true , address=45.91.116.12:4227 , piece_id=BKP3HIRDISNLVGOYXOFNNESNUALS4CCWEZNHD6YH2R7IOQ3N6PEQ, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.215590284 (48h0m54.255163394s) [noise=true , address=45.91.116.5:4298 , piece_id=C6RHSLJOQFQJUB5R6COHY4WNRDCSREBGW7D75NPCXNKU5YMTWKAA, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.220903201 (48h0m54.260476321s) [noise=true , address=45.91.116.5:4299 , piece_id=A4VK2TMKXX4FQL2SCSL2QOPBCPHCSZXIW6MRN6XJ2JMM4HEIOG5Q, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.290983534 (48h0m54.330556664s) [noise=true , address=77.90.31.21:4878 , piece_id=FZQSLO4YUX4YN25HI2PN2B4PN3LZ43E5ZYSY6FZGI52NSFMXS2BA, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.294390163 (48h0m54.333963273s) [noise=true , address=77.90.31.13:4628 , piece_id=HB75C6RALUL2BHGUBEEF3GEK3KPIVXVNOCTFUXKNCAXKZAF34M2Q, seg_pos={0 0}, upload=42180]: Done uploading piece. err: <nil> Sep 8 13:29:18.294407977 (48h0m54.333981097s) [seg_pos={0 0}, upload=42180]: Segment reached optimal threshold of 13 pieces. Sep 8 13:29:18.294643608 (48h0m54.334216728s) [noise=true , address=77.90.31.16:4735 , piece_id=AW54UVYV4DZSQP2AV6DENYKXIR74BPVPYB2AS6FYNP7R6EQ4SUOQ, seg_pos={0 0}, upload=42180]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 8 13:29:18.294760081 (48h0m54.334333191s) [noise=true , address=145.79.227.19:4079 , piece_id=SHFBFENBZZG6NKH2TYFZE577534YIIH7RN7MDJ6MP3MD3JMBB6UQ, seg_pos={0 0}, upload=42180]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: write tcp 188.166.225.170:37714->145.79.227.19:4079: use of closed network connection; write tcp 188.166.225.170:37714->145.79.227.19:4079: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37714->145.79.227.19:4079: use of closed network connection Sep 8 13:29:18.294833171 (48h0m54.334406281s) [noise=true , address=145.79.227.15:4875 , piece_id=PZFVDJVAGMS7YJN573LEBOHLA6FIFDEUD2YBMER4MPAAWPCZ5OLQ, seg_pos={0 0}, upload=42180]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rxmCJKvyoD8UiguHRdctfRTQ1Fiu9x29M5Xbf69ihF8uBG6m2): protocol: write tcp 188.166.225.170:46486->145.79.227.15:4875: use of closed network connection; write tcp 188.166.225.170:46486->145.79.227.15:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:46486->145.79.227.15:4875: use of closed network connection Sep 8 13:29:18.294880251 (48h0m54.334453371s) [seg_pos={0 0}, upload=42180]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 13:29:18.294962839 (48h0m54.334535959s) [upload=42180]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 13:29:18.294967137 (48h0m54.334540247s) [upload=42180]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 13:29:18.635872441 (48h0m54.675445551s) [upload=42180]: Done uploading segments... Sep 8 13:29:18.635890005 (48h0m54.675463115s) [upload=42180]: Upload finished. err: <nil> Duration: 28.636902879s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 6.633513111s FAIL (2025-09-08 13:30:45 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.633535485s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 7.400882444s FAIL (2025-09-08 13:30:40 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 7.400904036s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.334540616s FAIL (2025-09-08 13:30:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.334601724s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 3.557847435s FAIL (2025-09-08 13:30:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 3.557874818s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 35.238306436s FAIL (2025-09-08 13:30:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 35.238335933s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 11.969530233s FAIL (2025-09-08 13:30:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 11.969602913s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.630625045s FAIL (2025-09-08 13:30:23 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.630658479s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)