Orbiter History

Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 704248 reports (Page 13732 of 14085)

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.477395583s FAIL (2025-07-11 22:49:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.477417155s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [X.X.........................................................] duration: 6.617549204s FAIL (2025-07-11 22:49:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.61757317s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [XXX.........................................................] duration: 6.024699917s FAIL (2025-07-11 22:49:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.024731408s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.566640781s FAIL (2025-07-11 22:49:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 47]: Done begin upload segment. Jul 11 22:05:25.250192172 (444h55m0.020833497s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250231017 (444h55m0.020872352s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250569715 (444h55m0.02121105s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250766191 (444h55m0.021407526s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250847707 (444h55m0.021489042s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251107715 (444h55m0.02174905s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251178610 (444h55m0.021819945s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251489936 (444h55m0.022131341s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251521937 (444h55m0.022163272s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251908417 (444h55m0.022549742s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.252223779 (444h55m0.022865115s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253148930 (444h55m0.023790265s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253471086 (444h55m0.024112411s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253751101 (444h55m0.024392436s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254046447 (444h55m0.024687802s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254400644 (444h55m0.025041979s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254676783 (444h55m0.025318108s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254923645 (444h55m0.02556498s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:26.394518518 (444h55m1.165159853s) [upload=355847]: Next returned nil segment Jul 11 22:05:26.394534878 (444h55m1.165176213s) [upload=355847]: Waiting for error group managing segments... Jul 11 22:05:26.700772093 (444h55m1.471413428s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:29.109783784 (444h55m3.880425109s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:33.759174840 (444h55m8.529816165s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:34.089773700 (444h55m8.860415035s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:35.743647957 (444h55m10.514289292s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.189380742 (444h55m15.960022077s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.645213384 (444h55m16.415854719s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.866575910 (444h55m16.637217245s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:44.740074006 (444h55m19.510715341s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:46.188108286 (444h55m20.958749621s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:55.408676041 (444h55m30.179317376s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:06:24.142005152 (444h55m58.912646487s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1gzELQ4cJ6iXuHuRJTUE1gSGj2Wz2VYoqLdZpEzey5RQRvGQv8, address:45.91.95.5:4034): protocol: expected piece hash; context deadline exceeded; EOF Jul 11 22:06:24.142454010 (444h55m58.913095375s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: write tcp 188.166.225.170:46732->104.36.82.3:4799: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142530917 (444h55m58.913172282s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: write tcp 188.166.225.170:41510->104.36.82.6:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142582606 (444h55m58.913223991s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: write tcp 188.166.225.170:59368->104.36.82.19:4414: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142659403 (444h55m58.913300739s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: write tcp 188.166.225.170:57218->104.36.82.4:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142696935 (444h55m58.91333832s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:104.36.82.51:4081): protocol: write tcp 188.166.225.170:43764->104.36.82.51:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142743154 (444h55m58.913384489s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:104.36.82.50:4035): protocol: rpc: dial tcp 104.36.82.50:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142774984 (444h55m58.91341635s) [seg_pos={0 0}, upload=355847]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 11 22:06:24.374341223 (444h55m59.144982558s) [upload=355847]: Done uploading segments... Jul 11 22:06:24.374371692 (444h55m59.145013097s) [upload=355847]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.566667273s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [XX.XXXXX....................................................] duration: 5.872044348s FAIL (2025-07-11 22:48:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== {0 0}, upload=355880]: Done begin upload segment. Jul 11 22:08:00.702599502 (444h57m35.473240837s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702603690 (444h57m35.473245025s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702956284 (444h57m35.473597619s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703119166 (444h57m35.473760501s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703227583 (444h57m35.473868918s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703520243 (444h57m35.474161578s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703530502 (444h57m35.474171837s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703797383 (444h57m35.474438718s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703880252 (444h57m35.474521587s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704039647 (444h57m35.474680972s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704271750 (444h57m35.474913075s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705204535 (444h57m35.47584587s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705557110 (444h57m35.476198445s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705766800 (444h57m35.476408126s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705974929 (444h57m35.476616254s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.706188308 (444h57m35.476829643s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:02.412760756 (444h57m37.183402091s) [upload=355880]: Next returned nil segment Jul 11 22:08:02.412778691 (444h57m37.183420026s) [upload=355880]: Waiting for error group managing segments... Jul 11 22:08:02.760975870 (444h57m37.531617205s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.038510834 (444h57m37.809152169s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.058278492 (444h57m37.828919817s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.256226865 (444h57m38.0268682s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.258807431 (444h57m38.029448776s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:29.815430122 (444h58m4.586071457s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:104.36.82.8:4969): protocol: rpc: dial tcp 104.36.82.8:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815487462 (444h58m4.586128857s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: rpc: dial tcp 104.36.82.13:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815517309 (444h58m4.586158644s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:104.36.82.5:4837): protocol: rpc: dial tcp 104.36.82.5:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815582673 (444h58m4.586224029s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: rpc: dial tcp 104.36.82.6:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815631728 (444h58m4.586273063s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:104.36.82.7:4909): protocol: rpc: dial tcp 104.36.82.7:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815657246 (444h58m4.586298581s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815691662 (444h58m4.586332997s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:104.36.82.15:4258): protocol: rpc: dial tcp 104.36.82.15:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815727029 (444h58m4.586368364s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815755385 (444h58m4.58639672s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: write tcp 188.166.225.170:49458->104.36.82.14:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815777556 (444h58m4.586418891s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: rpc: dial tcp 104.36.82.4:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815783548 (444h58m4.586424894s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: write tcp 188.166.225.170:45820->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815817934 (444h58m4.586459269s) [seg_pos={0 0}, upload=355880]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 11 22:08:30.047483492 (444h58m4.818124817s) [upload=355880]: Done uploading segments... Jul 11 22:08:30.047507088 (444h58m4.818148423s) [upload=355880]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.872072211s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [XXXX........................................................] duration: 6.069635849s FAIL (2025-07-11 22:48:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.069653984s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [XX.X........................................................] duration: 5.558269135s FAIL (2025-07-11 22:47:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.558307939s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 5.812994471s FAIL (2025-07-11 22:47:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 47]: Done begin upload segment. Jul 11 22:05:25.250192172 (444h55m0.020833497s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250231017 (444h55m0.020872352s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250569715 (444h55m0.02121105s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250766191 (444h55m0.021407526s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250847707 (444h55m0.021489042s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251107715 (444h55m0.02174905s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251178610 (444h55m0.021819945s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251489936 (444h55m0.022131341s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251521937 (444h55m0.022163272s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251908417 (444h55m0.022549742s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.252223779 (444h55m0.022865115s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253148930 (444h55m0.023790265s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253471086 (444h55m0.024112411s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253751101 (444h55m0.024392436s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254046447 (444h55m0.024687802s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254400644 (444h55m0.025041979s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254676783 (444h55m0.025318108s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254923645 (444h55m0.02556498s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:26.394518518 (444h55m1.165159853s) [upload=355847]: Next returned nil segment Jul 11 22:05:26.394534878 (444h55m1.165176213s) [upload=355847]: Waiting for error group managing segments... Jul 11 22:05:26.700772093 (444h55m1.471413428s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:29.109783784 (444h55m3.880425109s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:33.759174840 (444h55m8.529816165s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:34.089773700 (444h55m8.860415035s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:35.743647957 (444h55m10.514289292s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.189380742 (444h55m15.960022077s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.645213384 (444h55m16.415854719s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.866575910 (444h55m16.637217245s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:44.740074006 (444h55m19.510715341s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:46.188108286 (444h55m20.958749621s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:55.408676041 (444h55m30.179317376s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:06:24.142005152 (444h55m58.912646487s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1gzELQ4cJ6iXuHuRJTUE1gSGj2Wz2VYoqLdZpEzey5RQRvGQv8, address:45.91.95.5:4034): protocol: expected piece hash; context deadline exceeded; EOF Jul 11 22:06:24.142454010 (444h55m58.913095375s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: write tcp 188.166.225.170:46732->104.36.82.3:4799: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142530917 (444h55m58.913172282s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: write tcp 188.166.225.170:41510->104.36.82.6:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142582606 (444h55m58.913223991s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: write tcp 188.166.225.170:59368->104.36.82.19:4414: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142659403 (444h55m58.913300739s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: write tcp 188.166.225.170:57218->104.36.82.4:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142696935 (444h55m58.91333832s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:104.36.82.51:4081): protocol: write tcp 188.166.225.170:43764->104.36.82.51:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142743154 (444h55m58.913384489s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:104.36.82.50:4035): protocol: rpc: dial tcp 104.36.82.50:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142774984 (444h55m58.91341635s) [seg_pos={0 0}, upload=355847]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 11 22:06:24.374341223 (444h55m59.144982558s) [upload=355847]: Done uploading segments... Jul 11 22:06:24.374371692 (444h55m59.145013097s) [upload=355847]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.813025381s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [XXXXX.......................................................] duration: 6.179874302s FAIL (2025-07-11 22:47:26 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.179895752s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [XXX.XXXXX...................................................] duration: 5.74445089s FAIL (2025-07-11 22:47:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== {0 0}, upload=355880]: Done begin upload segment. Jul 11 22:08:00.702599502 (444h57m35.473240837s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702603690 (444h57m35.473245025s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702956284 (444h57m35.473597619s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703119166 (444h57m35.473760501s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703227583 (444h57m35.473868918s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703520243 (444h57m35.474161578s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703530502 (444h57m35.474171837s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703797383 (444h57m35.474438718s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703880252 (444h57m35.474521587s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704039647 (444h57m35.474680972s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704271750 (444h57m35.474913075s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705204535 (444h57m35.47584587s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705557110 (444h57m35.476198445s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705766800 (444h57m35.476408126s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705974929 (444h57m35.476616254s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.706188308 (444h57m35.476829643s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:02.412760756 (444h57m37.183402091s) [upload=355880]: Next returned nil segment Jul 11 22:08:02.412778691 (444h57m37.183420026s) [upload=355880]: Waiting for error group managing segments... Jul 11 22:08:02.760975870 (444h57m37.531617205s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.038510834 (444h57m37.809152169s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.058278492 (444h57m37.828919817s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.256226865 (444h57m38.0268682s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.258807431 (444h57m38.029448776s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:29.815430122 (444h58m4.586071457s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:104.36.82.8:4969): protocol: rpc: dial tcp 104.36.82.8:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815487462 (444h58m4.586128857s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: rpc: dial tcp 104.36.82.13:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815517309 (444h58m4.586158644s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:104.36.82.5:4837): protocol: rpc: dial tcp 104.36.82.5:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815582673 (444h58m4.586224029s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: rpc: dial tcp 104.36.82.6:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815631728 (444h58m4.586273063s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:104.36.82.7:4909): protocol: rpc: dial tcp 104.36.82.7:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815657246 (444h58m4.586298581s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815691662 (444h58m4.586332997s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:104.36.82.15:4258): protocol: rpc: dial tcp 104.36.82.15:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815727029 (444h58m4.586368364s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815755385 (444h58m4.58639672s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: write tcp 188.166.225.170:49458->104.36.82.14:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815777556 (444h58m4.586418891s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: rpc: dial tcp 104.36.82.4:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815783548 (444h58m4.586424894s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: write tcp 188.166.225.170:45820->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815817934 (444h58m4.586459269s) [seg_pos={0 0}, upload=355880]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 11 22:08:30.047483492 (444h58m4.818124817s) [upload=355880]: Done uploading segments... Jul 11 22:08:30.047507088 (444h58m4.818148423s) [upload=355880]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.744473172s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.XXXXX......................................................] duration: 6.109327041s FAIL (2025-07-11 22:47:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.109353061s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 6.122322796s FAIL (2025-07-11 22:46:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 47]: Done begin upload segment. Jul 11 22:05:25.250192172 (444h55m0.020833497s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250231017 (444h55m0.020872352s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250569715 (444h55m0.02121105s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250766191 (444h55m0.021407526s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250847707 (444h55m0.021489042s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251107715 (444h55m0.02174905s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251178610 (444h55m0.021819945s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251489936 (444h55m0.022131341s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251521937 (444h55m0.022163272s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251908417 (444h55m0.022549742s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.252223779 (444h55m0.022865115s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253148930 (444h55m0.023790265s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253471086 (444h55m0.024112411s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253751101 (444h55m0.024392436s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254046447 (444h55m0.024687802s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254400644 (444h55m0.025041979s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254676783 (444h55m0.025318108s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254923645 (444h55m0.02556498s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:26.394518518 (444h55m1.165159853s) [upload=355847]: Next returned nil segment Jul 11 22:05:26.394534878 (444h55m1.165176213s) [upload=355847]: Waiting for error group managing segments... Jul 11 22:05:26.700772093 (444h55m1.471413428s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:29.109783784 (444h55m3.880425109s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:33.759174840 (444h55m8.529816165s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:34.089773700 (444h55m8.860415035s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:35.743647957 (444h55m10.514289292s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.189380742 (444h55m15.960022077s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.645213384 (444h55m16.415854719s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.866575910 (444h55m16.637217245s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:44.740074006 (444h55m19.510715341s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:46.188108286 (444h55m20.958749621s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:55.408676041 (444h55m30.179317376s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:06:24.142005152 (444h55m58.912646487s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1gzELQ4cJ6iXuHuRJTUE1gSGj2Wz2VYoqLdZpEzey5RQRvGQv8, address:45.91.95.5:4034): protocol: expected piece hash; context deadline exceeded; EOF Jul 11 22:06:24.142454010 (444h55m58.913095375s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: write tcp 188.166.225.170:46732->104.36.82.3:4799: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142530917 (444h55m58.913172282s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: write tcp 188.166.225.170:41510->104.36.82.6:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142582606 (444h55m58.913223991s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: write tcp 188.166.225.170:59368->104.36.82.19:4414: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142659403 (444h55m58.913300739s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: write tcp 188.166.225.170:57218->104.36.82.4:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142696935 (444h55m58.91333832s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:104.36.82.51:4081): protocol: write tcp 188.166.225.170:43764->104.36.82.51:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142743154 (444h55m58.913384489s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:104.36.82.50:4035): protocol: rpc: dial tcp 104.36.82.50:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142774984 (444h55m58.91341635s) [seg_pos={0 0}, upload=355847]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 11 22:06:24.374341223 (444h55m59.144982558s) [upload=355847]: Done uploading segments... Jul 11 22:06:24.374371692 (444h55m59.145013097s) [upload=355847]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 6.122352682s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [XXXX.XXXXX..................................................] duration: 6.670198548s FAIL (2025-07-11 22:46:52 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== {0 0}, upload=355880]: Done begin upload segment. Jul 11 22:08:00.702599502 (444h57m35.473240837s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702603690 (444h57m35.473245025s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702956284 (444h57m35.473597619s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703119166 (444h57m35.473760501s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703227583 (444h57m35.473868918s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703520243 (444h57m35.474161578s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703530502 (444h57m35.474171837s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703797383 (444h57m35.474438718s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703880252 (444h57m35.474521587s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704039647 (444h57m35.474680972s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704271750 (444h57m35.474913075s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705204535 (444h57m35.47584587s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705557110 (444h57m35.476198445s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705766800 (444h57m35.476408126s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705974929 (444h57m35.476616254s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.706188308 (444h57m35.476829643s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:02.412760756 (444h57m37.183402091s) [upload=355880]: Next returned nil segment Jul 11 22:08:02.412778691 (444h57m37.183420026s) [upload=355880]: Waiting for error group managing segments... Jul 11 22:08:02.760975870 (444h57m37.531617205s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.038510834 (444h57m37.809152169s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.058278492 (444h57m37.828919817s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.256226865 (444h57m38.0268682s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.258807431 (444h57m38.029448776s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:29.815430122 (444h58m4.586071457s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:104.36.82.8:4969): protocol: rpc: dial tcp 104.36.82.8:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815487462 (444h58m4.586128857s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: rpc: dial tcp 104.36.82.13:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815517309 (444h58m4.586158644s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:104.36.82.5:4837): protocol: rpc: dial tcp 104.36.82.5:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815582673 (444h58m4.586224029s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: rpc: dial tcp 104.36.82.6:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815631728 (444h58m4.586273063s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:104.36.82.7:4909): protocol: rpc: dial tcp 104.36.82.7:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815657246 (444h58m4.586298581s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815691662 (444h58m4.586332997s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:104.36.82.15:4258): protocol: rpc: dial tcp 104.36.82.15:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815727029 (444h58m4.586368364s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815755385 (444h58m4.58639672s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: write tcp 188.166.225.170:49458->104.36.82.14:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815777556 (444h58m4.586418891s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: rpc: dial tcp 104.36.82.4:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815783548 (444h58m4.586424894s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: write tcp 188.166.225.170:45820->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815817934 (444h58m4.586459269s) [seg_pos={0 0}, upload=355880]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 11 22:08:30.047483492 (444h58m4.818124817s) [upload=355880]: Done uploading segments... Jul 11 22:08:30.047507088 (444h58m4.818148423s) [upload=355880]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 6.67022595s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.XX.X.......................................................] duration: 5.530987566s FAIL (2025-07-11 22:46:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.531011421s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.XXXX.XXXXX.................................................] duration: 5.63847484s FAIL (2025-07-11 22:46:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== {0 0}, upload=355880]: Done begin upload segment. Jul 11 22:08:00.702599502 (444h57m35.473240837s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702603690 (444h57m35.473245025s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702956284 (444h57m35.473597619s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703119166 (444h57m35.473760501s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703227583 (444h57m35.473868918s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703520243 (444h57m35.474161578s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703530502 (444h57m35.474171837s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703797383 (444h57m35.474438718s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703880252 (444h57m35.474521587s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704039647 (444h57m35.474680972s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704271750 (444h57m35.474913075s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705204535 (444h57m35.47584587s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705557110 (444h57m35.476198445s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705766800 (444h57m35.476408126s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705974929 (444h57m35.476616254s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.706188308 (444h57m35.476829643s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:02.412760756 (444h57m37.183402091s) [upload=355880]: Next returned nil segment Jul 11 22:08:02.412778691 (444h57m37.183420026s) [upload=355880]: Waiting for error group managing segments... Jul 11 22:08:02.760975870 (444h57m37.531617205s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.038510834 (444h57m37.809152169s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.058278492 (444h57m37.828919817s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.256226865 (444h57m38.0268682s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.258807431 (444h57m38.029448776s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:29.815430122 (444h58m4.586071457s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:104.36.82.8:4969): protocol: rpc: dial tcp 104.36.82.8:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815487462 (444h58m4.586128857s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: rpc: dial tcp 104.36.82.13:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815517309 (444h58m4.586158644s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:104.36.82.5:4837): protocol: rpc: dial tcp 104.36.82.5:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815582673 (444h58m4.586224029s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: rpc: dial tcp 104.36.82.6:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815631728 (444h58m4.586273063s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:104.36.82.7:4909): protocol: rpc: dial tcp 104.36.82.7:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815657246 (444h58m4.586298581s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815691662 (444h58m4.586332997s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:104.36.82.15:4258): protocol: rpc: dial tcp 104.36.82.15:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815727029 (444h58m4.586368364s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815755385 (444h58m4.58639672s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: write tcp 188.166.225.170:49458->104.36.82.14:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815777556 (444h58m4.586418891s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: rpc: dial tcp 104.36.82.4:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815783548 (444h58m4.586424894s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: write tcp 188.166.225.170:45820->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815817934 (444h58m4.586459269s) [seg_pos={0 0}, upload=355880]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 11 22:08:30.047483492 (444h58m4.818124817s) [upload=355880]: Done uploading segments... Jul 11 22:08:30.047507088 (444h58m4.818148423s) [upload=355880]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.638510007s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 6 out of 60 is failed (threshold=3) [X.XXXXX.....................................................] duration: 6.408844634s FAIL (2025-07-11 22:46:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.408863057s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..XX.X......................................................] duration: 5.542828059s FAIL (2025-07-11 22:45:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.542857285s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 5.709966482s FAIL (2025-07-11 22:45:46 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 47]: Done begin upload segment. Jul 11 22:05:25.250192172 (444h55m0.020833497s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250231017 (444h55m0.020872352s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250569715 (444h55m0.02121105s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250766191 (444h55m0.021407526s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250847707 (444h55m0.021489042s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251107715 (444h55m0.02174905s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251178610 (444h55m0.021819945s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251489936 (444h55m0.022131341s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251521937 (444h55m0.022163272s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251908417 (444h55m0.022549742s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.252223779 (444h55m0.022865115s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253148930 (444h55m0.023790265s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253471086 (444h55m0.024112411s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253751101 (444h55m0.024392436s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254046447 (444h55m0.024687802s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254400644 (444h55m0.025041979s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254676783 (444h55m0.025318108s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254923645 (444h55m0.02556498s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:26.394518518 (444h55m1.165159853s) [upload=355847]: Next returned nil segment Jul 11 22:05:26.394534878 (444h55m1.165176213s) [upload=355847]: Waiting for error group managing segments... Jul 11 22:05:26.700772093 (444h55m1.471413428s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:29.109783784 (444h55m3.880425109s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:33.759174840 (444h55m8.529816165s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:34.089773700 (444h55m8.860415035s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:35.743647957 (444h55m10.514289292s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.189380742 (444h55m15.960022077s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.645213384 (444h55m16.415854719s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.866575910 (444h55m16.637217245s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:44.740074006 (444h55m19.510715341s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:46.188108286 (444h55m20.958749621s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:55.408676041 (444h55m30.179317376s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:06:24.142005152 (444h55m58.912646487s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1gzELQ4cJ6iXuHuRJTUE1gSGj2Wz2VYoqLdZpEzey5RQRvGQv8, address:45.91.95.5:4034): protocol: expected piece hash; context deadline exceeded; EOF Jul 11 22:06:24.142454010 (444h55m58.913095375s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: write tcp 188.166.225.170:46732->104.36.82.3:4799: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142530917 (444h55m58.913172282s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: write tcp 188.166.225.170:41510->104.36.82.6:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142582606 (444h55m58.913223991s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: write tcp 188.166.225.170:59368->104.36.82.19:4414: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142659403 (444h55m58.913300739s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: write tcp 188.166.225.170:57218->104.36.82.4:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142696935 (444h55m58.91333832s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:104.36.82.51:4081): protocol: write tcp 188.166.225.170:43764->104.36.82.51:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142743154 (444h55m58.913384489s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:104.36.82.50:4035): protocol: rpc: dial tcp 104.36.82.50:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142774984 (444h55m58.91341635s) [seg_pos={0 0}, upload=355847]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 11 22:06:24.374341223 (444h55m59.144982558s) [upload=355847]: Done uploading segments... Jul 11 22:06:24.374371692 (444h55m59.145013097s) [upload=355847]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.709998354s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [X..XX.......................................................] duration: 5.848594328s FAIL (2025-07-11 22:45:25 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 47]: Done begin upload segment. Jul 11 22:05:25.250192172 (444h55m0.020833497s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250231017 (444h55m0.020872352s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250569715 (444h55m0.02121105s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250766191 (444h55m0.021407526s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250847707 (444h55m0.021489042s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251107715 (444h55m0.02174905s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251178610 (444h55m0.021819945s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251489936 (444h55m0.022131341s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251521937 (444h55m0.022163272s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251908417 (444h55m0.022549742s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.252223779 (444h55m0.022865115s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253148930 (444h55m0.023790265s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253471086 (444h55m0.024112411s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253751101 (444h55m0.024392436s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254046447 (444h55m0.024687802s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254400644 (444h55m0.025041979s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254676783 (444h55m0.025318108s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254923645 (444h55m0.02556498s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:26.394518518 (444h55m1.165159853s) [upload=355847]: Next returned nil segment Jul 11 22:05:26.394534878 (444h55m1.165176213s) [upload=355847]: Waiting for error group managing segments... Jul 11 22:05:26.700772093 (444h55m1.471413428s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:29.109783784 (444h55m3.880425109s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:33.759174840 (444h55m8.529816165s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:34.089773700 (444h55m8.860415035s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:35.743647957 (444h55m10.514289292s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.189380742 (444h55m15.960022077s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.645213384 (444h55m16.415854719s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.866575910 (444h55m16.637217245s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:44.740074006 (444h55m19.510715341s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:46.188108286 (444h55m20.958749621s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:55.408676041 (444h55m30.179317376s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:06:24.142005152 (444h55m58.912646487s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1gzELQ4cJ6iXuHuRJTUE1gSGj2Wz2VYoqLdZpEzey5RQRvGQv8, address:45.91.95.5:4034): protocol: expected piece hash; context deadline exceeded; EOF Jul 11 22:06:24.142454010 (444h55m58.913095375s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: write tcp 188.166.225.170:46732->104.36.82.3:4799: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142530917 (444h55m58.913172282s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: write tcp 188.166.225.170:41510->104.36.82.6:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142582606 (444h55m58.913223991s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: write tcp 188.166.225.170:59368->104.36.82.19:4414: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142659403 (444h55m58.913300739s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: write tcp 188.166.225.170:57218->104.36.82.4:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142696935 (444h55m58.91333832s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:104.36.82.51:4081): protocol: write tcp 188.166.225.170:43764->104.36.82.51:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142743154 (444h55m58.913384489s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:104.36.82.50:4035): protocol: rpc: dial tcp 104.36.82.50:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142774984 (444h55m58.91341635s) [seg_pos={0 0}, upload=355847]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 11 22:06:24.374341223 (444h55m59.144982558s) [upload=355847]: Done uploading segments... Jul 11 22:06:24.374371692 (444h55m59.145013097s) [upload=355847]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.848621661s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [..XXXX.XXXXX................................................] duration: 5.872663913s FAIL (2025-07-11 22:45:16 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== {0 0}, upload=355880]: Done begin upload segment. Jul 11 22:08:00.702599502 (444h57m35.473240837s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702603690 (444h57m35.473245025s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702956284 (444h57m35.473597619s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703119166 (444h57m35.473760501s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703227583 (444h57m35.473868918s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703520243 (444h57m35.474161578s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703530502 (444h57m35.474171837s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703797383 (444h57m35.474438718s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703880252 (444h57m35.474521587s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704039647 (444h57m35.474680972s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704271750 (444h57m35.474913075s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705204535 (444h57m35.47584587s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705557110 (444h57m35.476198445s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705766800 (444h57m35.476408126s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705974929 (444h57m35.476616254s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.706188308 (444h57m35.476829643s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:02.412760756 (444h57m37.183402091s) [upload=355880]: Next returned nil segment Jul 11 22:08:02.412778691 (444h57m37.183420026s) [upload=355880]: Waiting for error group managing segments... Jul 11 22:08:02.760975870 (444h57m37.531617205s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.038510834 (444h57m37.809152169s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.058278492 (444h57m37.828919817s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.256226865 (444h57m38.0268682s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.258807431 (444h57m38.029448776s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:29.815430122 (444h58m4.586071457s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:104.36.82.8:4969): protocol: rpc: dial tcp 104.36.82.8:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815487462 (444h58m4.586128857s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: rpc: dial tcp 104.36.82.13:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815517309 (444h58m4.586158644s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:104.36.82.5:4837): protocol: rpc: dial tcp 104.36.82.5:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815582673 (444h58m4.586224029s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: rpc: dial tcp 104.36.82.6:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815631728 (444h58m4.586273063s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:104.36.82.7:4909): protocol: rpc: dial tcp 104.36.82.7:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815657246 (444h58m4.586298581s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815691662 (444h58m4.586332997s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:104.36.82.15:4258): protocol: rpc: dial tcp 104.36.82.15:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815727029 (444h58m4.586368364s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815755385 (444h58m4.58639672s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: write tcp 188.166.225.170:49458->104.36.82.14:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815777556 (444h58m4.586418891s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: rpc: dial tcp 104.36.82.4:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815783548 (444h58m4.586424894s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: write tcp 188.166.225.170:45820->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815817934 (444h58m4.586459269s) [seg_pos={0 0}, upload=355880]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 11 22:08:30.047483492 (444h58m4.818124817s) [upload=355880]: Done uploading segments... Jul 11 22:08:30.047507088 (444h58m4.818148423s) [upload=355880]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.872686336s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...XX.X.....................................................] duration: 5.798645928s FAIL (2025-07-11 22:45:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.798671367s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 7 out of 60 is failed (threshold=3) [XX.XXXXX....................................................] duration: 6.295452783s FAIL (2025-07-11 22:45:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.295476017s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [....XX.X....................................................] duration: 5.700732729s FAIL (2025-07-11 22:44:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.700756384s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.X..XX......................................................] duration: 6.239243527s FAIL (2025-07-11 22:44:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 47]: Done begin upload segment. Jul 11 22:05:25.250192172 (444h55m0.020833497s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250231017 (444h55m0.020872352s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250569715 (444h55m0.02121105s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250766191 (444h55m0.021407526s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250847707 (444h55m0.021489042s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251107715 (444h55m0.02174905s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251178610 (444h55m0.021819945s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251489936 (444h55m0.022131341s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251521937 (444h55m0.022163272s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251908417 (444h55m0.022549742s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.252223779 (444h55m0.022865115s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253148930 (444h55m0.023790265s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253471086 (444h55m0.024112411s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253751101 (444h55m0.024392436s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254046447 (444h55m0.024687802s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254400644 (444h55m0.025041979s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254676783 (444h55m0.025318108s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254923645 (444h55m0.02556498s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:26.394518518 (444h55m1.165159853s) [upload=355847]: Next returned nil segment Jul 11 22:05:26.394534878 (444h55m1.165176213s) [upload=355847]: Waiting for error group managing segments... Jul 11 22:05:26.700772093 (444h55m1.471413428s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:29.109783784 (444h55m3.880425109s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:33.759174840 (444h55m8.529816165s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:34.089773700 (444h55m8.860415035s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:35.743647957 (444h55m10.514289292s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.189380742 (444h55m15.960022077s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.645213384 (444h55m16.415854719s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.866575910 (444h55m16.637217245s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:44.740074006 (444h55m19.510715341s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:46.188108286 (444h55m20.958749621s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:55.408676041 (444h55m30.179317376s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:06:24.142005152 (444h55m58.912646487s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1gzELQ4cJ6iXuHuRJTUE1gSGj2Wz2VYoqLdZpEzey5RQRvGQv8, address:45.91.95.5:4034): protocol: expected piece hash; context deadline exceeded; EOF Jul 11 22:06:24.142454010 (444h55m58.913095375s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: write tcp 188.166.225.170:46732->104.36.82.3:4799: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142530917 (444h55m58.913172282s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: write tcp 188.166.225.170:41510->104.36.82.6:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142582606 (444h55m58.913223991s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: write tcp 188.166.225.170:59368->104.36.82.19:4414: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142659403 (444h55m58.913300739s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: write tcp 188.166.225.170:57218->104.36.82.4:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142696935 (444h55m58.91333832s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:104.36.82.51:4081): protocol: write tcp 188.166.225.170:43764->104.36.82.51:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142743154 (444h55m58.913384489s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:104.36.82.50:4035): protocol: rpc: dial tcp 104.36.82.50:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142774984 (444h55m58.91341635s) [seg_pos={0 0}, upload=355847]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 11 22:06:24.374341223 (444h55m59.144982558s) [upload=355847]: Done uploading segments... Jul 11 22:06:24.374371692 (444h55m59.145013097s) [upload=355847]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 6.239263786s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [...XXXX.XXXXX...............................................] duration: 10.272902444s FAIL (2025-07-11 22:44:47 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== {0 0}, upload=355880]: Done begin upload segment. Jul 11 22:08:00.702599502 (444h57m35.473240837s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702603690 (444h57m35.473245025s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702956284 (444h57m35.473597619s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703119166 (444h57m35.473760501s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703227583 (444h57m35.473868918s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703520243 (444h57m35.474161578s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703530502 (444h57m35.474171837s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703797383 (444h57m35.474438718s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703880252 (444h57m35.474521587s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704039647 (444h57m35.474680972s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704271750 (444h57m35.474913075s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705204535 (444h57m35.47584587s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705557110 (444h57m35.476198445s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705766800 (444h57m35.476408126s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705974929 (444h57m35.476616254s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.706188308 (444h57m35.476829643s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:02.412760756 (444h57m37.183402091s) [upload=355880]: Next returned nil segment Jul 11 22:08:02.412778691 (444h57m37.183420026s) [upload=355880]: Waiting for error group managing segments... Jul 11 22:08:02.760975870 (444h57m37.531617205s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.038510834 (444h57m37.809152169s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.058278492 (444h57m37.828919817s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.256226865 (444h57m38.0268682s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.258807431 (444h57m38.029448776s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:29.815430122 (444h58m4.586071457s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:104.36.82.8:4969): protocol: rpc: dial tcp 104.36.82.8:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815487462 (444h58m4.586128857s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: rpc: dial tcp 104.36.82.13:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815517309 (444h58m4.586158644s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:104.36.82.5:4837): protocol: rpc: dial tcp 104.36.82.5:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815582673 (444h58m4.586224029s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: rpc: dial tcp 104.36.82.6:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815631728 (444h58m4.586273063s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:104.36.82.7:4909): protocol: rpc: dial tcp 104.36.82.7:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815657246 (444h58m4.586298581s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815691662 (444h58m4.586332997s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:104.36.82.15:4258): protocol: rpc: dial tcp 104.36.82.15:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815727029 (444h58m4.586368364s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815755385 (444h58m4.58639672s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: write tcp 188.166.225.170:49458->104.36.82.14:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815777556 (444h58m4.586418891s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: rpc: dial tcp 104.36.82.4:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815783548 (444h58m4.586424894s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: write tcp 188.166.225.170:45820->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815817934 (444h58m4.586459269s) [seg_pos={0 0}, upload=355880]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 11 22:08:30.047483492 (444h58m4.818124817s) [upload=355880]: Done uploading segments... Jul 11 22:08:30.047507088 (444h58m4.818148423s) [upload=355880]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 10.272924697s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..X..XX.....................................................] duration: 33.186663096s FAIL (2025-07-11 22:44:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 47]: Done begin upload segment. Jul 11 22:05:25.250192172 (444h55m0.020833497s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250231017 (444h55m0.020872352s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250569715 (444h55m0.02121105s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250766191 (444h55m0.021407526s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250847707 (444h55m0.021489042s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251107715 (444h55m0.02174905s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251178610 (444h55m0.021819945s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251489936 (444h55m0.022131341s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251521937 (444h55m0.022163272s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251908417 (444h55m0.022549742s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.252223779 (444h55m0.022865115s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253148930 (444h55m0.023790265s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253471086 (444h55m0.024112411s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253751101 (444h55m0.024392436s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254046447 (444h55m0.024687802s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254400644 (444h55m0.025041979s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254676783 (444h55m0.025318108s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254923645 (444h55m0.02556498s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:26.394518518 (444h55m1.165159853s) [upload=355847]: Next returned nil segment Jul 11 22:05:26.394534878 (444h55m1.165176213s) [upload=355847]: Waiting for error group managing segments... Jul 11 22:05:26.700772093 (444h55m1.471413428s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:29.109783784 (444h55m3.880425109s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:33.759174840 (444h55m8.529816165s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:34.089773700 (444h55m8.860415035s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:35.743647957 (444h55m10.514289292s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.189380742 (444h55m15.960022077s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.645213384 (444h55m16.415854719s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.866575910 (444h55m16.637217245s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:44.740074006 (444h55m19.510715341s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:46.188108286 (444h55m20.958749621s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:55.408676041 (444h55m30.179317376s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:06:24.142005152 (444h55m58.912646487s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1gzELQ4cJ6iXuHuRJTUE1gSGj2Wz2VYoqLdZpEzey5RQRvGQv8, address:45.91.95.5:4034): protocol: expected piece hash; context deadline exceeded; EOF Jul 11 22:06:24.142454010 (444h55m58.913095375s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: write tcp 188.166.225.170:46732->104.36.82.3:4799: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142530917 (444h55m58.913172282s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: write tcp 188.166.225.170:41510->104.36.82.6:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142582606 (444h55m58.913223991s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: write tcp 188.166.225.170:59368->104.36.82.19:4414: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142659403 (444h55m58.913300739s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: write tcp 188.166.225.170:57218->104.36.82.4:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142696935 (444h55m58.91333832s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:104.36.82.51:4081): protocol: write tcp 188.166.225.170:43764->104.36.82.51:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142743154 (444h55m58.913384489s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:104.36.82.50:4035): protocol: rpc: dial tcp 104.36.82.50:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142774984 (444h55m58.91341635s) [seg_pos={0 0}, upload=355847]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 11 22:06:24.374341223 (444h55m59.144982558s) [upload=355847]: Done uploading segments... Jul 11 22:06:24.374371692 (444h55m59.145013097s) [upload=355847]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 33.186690368s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [XXX.XXXXX...................................................] duration: 6.719531577s FAIL (2025-07-11 22:44:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.719552136s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.....XX.X...................................................] duration: 10.832570666s FAIL (2025-07-11 22:44:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 10.832610842s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [....XXXX.XXXXX..............................................] duration: 5.863698772s FAIL (2025-07-11 22:43:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== {0 0}, upload=355880]: Done begin upload segment. Jul 11 22:08:00.702599502 (444h57m35.473240837s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702603690 (444h57m35.473245025s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702956284 (444h57m35.473597619s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703119166 (444h57m35.473760501s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703227583 (444h57m35.473868918s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703520243 (444h57m35.474161578s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703530502 (444h57m35.474171837s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703797383 (444h57m35.474438718s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703880252 (444h57m35.474521587s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704039647 (444h57m35.474680972s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704271750 (444h57m35.474913075s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705204535 (444h57m35.47584587s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705557110 (444h57m35.476198445s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705766800 (444h57m35.476408126s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705974929 (444h57m35.476616254s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.706188308 (444h57m35.476829643s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:02.412760756 (444h57m37.183402091s) [upload=355880]: Next returned nil segment Jul 11 22:08:02.412778691 (444h57m37.183420026s) [upload=355880]: Waiting for error group managing segments... Jul 11 22:08:02.760975870 (444h57m37.531617205s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.038510834 (444h57m37.809152169s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.058278492 (444h57m37.828919817s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.256226865 (444h57m38.0268682s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.258807431 (444h57m38.029448776s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:29.815430122 (444h58m4.586071457s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:104.36.82.8:4969): protocol: rpc: dial tcp 104.36.82.8:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815487462 (444h58m4.586128857s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: rpc: dial tcp 104.36.82.13:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815517309 (444h58m4.586158644s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:104.36.82.5:4837): protocol: rpc: dial tcp 104.36.82.5:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815582673 (444h58m4.586224029s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: rpc: dial tcp 104.36.82.6:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815631728 (444h58m4.586273063s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:104.36.82.7:4909): protocol: rpc: dial tcp 104.36.82.7:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815657246 (444h58m4.586298581s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815691662 (444h58m4.586332997s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:104.36.82.15:4258): protocol: rpc: dial tcp 104.36.82.15:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815727029 (444h58m4.586368364s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815755385 (444h58m4.58639672s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: write tcp 188.166.225.170:49458->104.36.82.14:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815777556 (444h58m4.586418891s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: rpc: dial tcp 104.36.82.4:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815783548 (444h58m4.586424894s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: write tcp 188.166.225.170:45820->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815817934 (444h58m4.586459269s) [seg_pos={0 0}, upload=355880]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 11 22:08:30.047483492 (444h58m4.818124817s) [upload=355880]: Done uploading segments... Jul 11 22:08:30.047507088 (444h58m4.818148423s) [upload=355880]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.863724682s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.XXX.XXXXX..................................................] duration: 6.237894676s FAIL (2025-07-11 22:43:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.237911297s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [X.XXX.XXXXX.................................................] duration: 6.165577147s FAIL (2025-07-11 22:43:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.165602476s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......XX.X..................................................] duration: 5.582937783s FAIL (2025-07-11 22:43:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.582971277s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...X..XX....................................................] duration: 5.760679668s FAIL (2025-07-11 22:42:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 47]: Done begin upload segment. Jul 11 22:05:25.250192172 (444h55m0.020833497s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250231017 (444h55m0.020872352s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250569715 (444h55m0.02121105s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250766191 (444h55m0.021407526s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250847707 (444h55m0.021489042s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251107715 (444h55m0.02174905s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251178610 (444h55m0.021819945s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251489936 (444h55m0.022131341s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251521937 (444h55m0.022163272s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251908417 (444h55m0.022549742s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.252223779 (444h55m0.022865115s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253148930 (444h55m0.023790265s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253471086 (444h55m0.024112411s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253751101 (444h55m0.024392436s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254046447 (444h55m0.024687802s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254400644 (444h55m0.025041979s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254676783 (444h55m0.025318108s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254923645 (444h55m0.02556498s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:26.394518518 (444h55m1.165159853s) [upload=355847]: Next returned nil segment Jul 11 22:05:26.394534878 (444h55m1.165176213s) [upload=355847]: Waiting for error group managing segments... Jul 11 22:05:26.700772093 (444h55m1.471413428s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:29.109783784 (444h55m3.880425109s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:33.759174840 (444h55m8.529816165s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:34.089773700 (444h55m8.860415035s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:35.743647957 (444h55m10.514289292s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.189380742 (444h55m15.960022077s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.645213384 (444h55m16.415854719s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.866575910 (444h55m16.637217245s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:44.740074006 (444h55m19.510715341s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:46.188108286 (444h55m20.958749621s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:55.408676041 (444h55m30.179317376s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:06:24.142005152 (444h55m58.912646487s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1gzELQ4cJ6iXuHuRJTUE1gSGj2Wz2VYoqLdZpEzey5RQRvGQv8, address:45.91.95.5:4034): protocol: expected piece hash; context deadline exceeded; EOF Jul 11 22:06:24.142454010 (444h55m58.913095375s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: write tcp 188.166.225.170:46732->104.36.82.3:4799: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142530917 (444h55m58.913172282s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: write tcp 188.166.225.170:41510->104.36.82.6:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142582606 (444h55m58.913223991s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: write tcp 188.166.225.170:59368->104.36.82.19:4414: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142659403 (444h55m58.913300739s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: write tcp 188.166.225.170:57218->104.36.82.4:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142696935 (444h55m58.91333832s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:104.36.82.51:4081): protocol: write tcp 188.166.225.170:43764->104.36.82.51:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142743154 (444h55m58.913384489s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:104.36.82.50:4035): protocol: rpc: dial tcp 104.36.82.50:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142774984 (444h55m58.91341635s) [seg_pos={0 0}, upload=355847]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 11 22:06:24.374341223 (444h55m59.144982558s) [upload=355847]: Done uploading segments... Jul 11 22:06:24.374371692 (444h55m59.145013097s) [upload=355847]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.760716477s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.....XXXX.XXXXX.............................................] duration: 5.609438951s FAIL (2025-07-11 22:42:53 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== {0 0}, upload=355880]: Done begin upload segment. Jul 11 22:08:00.702599502 (444h57m35.473240837s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702603690 (444h57m35.473245025s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702956284 (444h57m35.473597619s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703119166 (444h57m35.473760501s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703227583 (444h57m35.473868918s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703520243 (444h57m35.474161578s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703530502 (444h57m35.474171837s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703797383 (444h57m35.474438718s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703880252 (444h57m35.474521587s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704039647 (444h57m35.474680972s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704271750 (444h57m35.474913075s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705204535 (444h57m35.47584587s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705557110 (444h57m35.476198445s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705766800 (444h57m35.476408126s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705974929 (444h57m35.476616254s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.706188308 (444h57m35.476829643s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:02.412760756 (444h57m37.183402091s) [upload=355880]: Next returned nil segment Jul 11 22:08:02.412778691 (444h57m37.183420026s) [upload=355880]: Waiting for error group managing segments... Jul 11 22:08:02.760975870 (444h57m37.531617205s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.038510834 (444h57m37.809152169s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.058278492 (444h57m37.828919817s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.256226865 (444h57m38.0268682s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.258807431 (444h57m38.029448776s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:29.815430122 (444h58m4.586071457s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:104.36.82.8:4969): protocol: rpc: dial tcp 104.36.82.8:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815487462 (444h58m4.586128857s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: rpc: dial tcp 104.36.82.13:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815517309 (444h58m4.586158644s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:104.36.82.5:4837): protocol: rpc: dial tcp 104.36.82.5:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815582673 (444h58m4.586224029s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: rpc: dial tcp 104.36.82.6:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815631728 (444h58m4.586273063s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:104.36.82.7:4909): protocol: rpc: dial tcp 104.36.82.7:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815657246 (444h58m4.586298581s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815691662 (444h58m4.586332997s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:104.36.82.15:4258): protocol: rpc: dial tcp 104.36.82.15:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815727029 (444h58m4.586368364s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815755385 (444h58m4.58639672s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: write tcp 188.166.225.170:49458->104.36.82.14:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815777556 (444h58m4.586418891s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: rpc: dial tcp 104.36.82.4:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815783548 (444h58m4.586424894s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: write tcp 188.166.225.170:45820->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815817934 (444h58m4.586459269s) [seg_pos={0 0}, upload=355880]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 11 22:08:30.047483492 (444h58m4.818124817s) [upload=355880]: Done uploading segments... Jul 11 22:08:30.047507088 (444h58m4.818148423s) [upload=355880]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.609471243s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.X.XXX.XXXXX................................................] duration: 6.665263213s FAIL (2025-07-11 22:42:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.665278041s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.......XX.X.................................................] duration: 5.656998567s FAIL (2025-07-11 22:42:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.657013606s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [....X..XX...................................................] duration: 6.506355023s FAIL (2025-07-11 22:42:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 47]: Done begin upload segment. Jul 11 22:05:25.250192172 (444h55m0.020833497s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250231017 (444h55m0.020872352s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250569715 (444h55m0.02121105s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250766191 (444h55m0.021407526s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250847707 (444h55m0.021489042s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251107715 (444h55m0.02174905s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251178610 (444h55m0.021819945s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251489936 (444h55m0.022131341s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251521937 (444h55m0.022163272s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251908417 (444h55m0.022549742s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.252223779 (444h55m0.022865115s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253148930 (444h55m0.023790265s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253471086 (444h55m0.024112411s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253751101 (444h55m0.024392436s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254046447 (444h55m0.024687802s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254400644 (444h55m0.025041979s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254676783 (444h55m0.025318108s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254923645 (444h55m0.02556498s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:26.394518518 (444h55m1.165159853s) [upload=355847]: Next returned nil segment Jul 11 22:05:26.394534878 (444h55m1.165176213s) [upload=355847]: Waiting for error group managing segments... Jul 11 22:05:26.700772093 (444h55m1.471413428s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:29.109783784 (444h55m3.880425109s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:33.759174840 (444h55m8.529816165s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:34.089773700 (444h55m8.860415035s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:35.743647957 (444h55m10.514289292s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.189380742 (444h55m15.960022077s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.645213384 (444h55m16.415854719s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.866575910 (444h55m16.637217245s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:44.740074006 (444h55m19.510715341s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:46.188108286 (444h55m20.958749621s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:55.408676041 (444h55m30.179317376s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:06:24.142005152 (444h55m58.912646487s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1gzELQ4cJ6iXuHuRJTUE1gSGj2Wz2VYoqLdZpEzey5RQRvGQv8, address:45.91.95.5:4034): protocol: expected piece hash; context deadline exceeded; EOF Jul 11 22:06:24.142454010 (444h55m58.913095375s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: write tcp 188.166.225.170:46732->104.36.82.3:4799: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142530917 (444h55m58.913172282s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: write tcp 188.166.225.170:41510->104.36.82.6:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142582606 (444h55m58.913223991s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: write tcp 188.166.225.170:59368->104.36.82.19:4414: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142659403 (444h55m58.913300739s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: write tcp 188.166.225.170:57218->104.36.82.4:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142696935 (444h55m58.91333832s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:104.36.82.51:4081): protocol: write tcp 188.166.225.170:43764->104.36.82.51:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142743154 (444h55m58.913384489s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:104.36.82.50:4035): protocol: rpc: dial tcp 104.36.82.50:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142774984 (444h55m58.91341635s) [seg_pos={0 0}, upload=355847]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 11 22:06:24.374341223 (444h55m59.144982558s) [upload=355847]: Done uploading segments... Jul 11 22:06:24.374371692 (444h55m59.145013097s) [upload=355847]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 6.506382696s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [..X.XXX.XXXXX...............................................] duration: 6.038032032s FAIL (2025-07-11 22:42:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.038056098s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.....X..XX..................................................] duration: 5.988817471s FAIL (2025-07-11 22:42:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 47]: Done begin upload segment. Jul 11 22:05:25.250192172 (444h55m0.020833497s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250231017 (444h55m0.020872352s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250569715 (444h55m0.02121105s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250766191 (444h55m0.021407526s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250847707 (444h55m0.021489042s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251107715 (444h55m0.02174905s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251178610 (444h55m0.021819945s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251489936 (444h55m0.022131341s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251521937 (444h55m0.022163272s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251908417 (444h55m0.022549742s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.252223779 (444h55m0.022865115s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253148930 (444h55m0.023790265s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253471086 (444h55m0.024112411s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253751101 (444h55m0.024392436s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254046447 (444h55m0.024687802s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254400644 (444h55m0.025041979s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254676783 (444h55m0.025318108s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254923645 (444h55m0.02556498s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:26.394518518 (444h55m1.165159853s) [upload=355847]: Next returned nil segment Jul 11 22:05:26.394534878 (444h55m1.165176213s) [upload=355847]: Waiting for error group managing segments... Jul 11 22:05:26.700772093 (444h55m1.471413428s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:29.109783784 (444h55m3.880425109s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:33.759174840 (444h55m8.529816165s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:34.089773700 (444h55m8.860415035s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:35.743647957 (444h55m10.514289292s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.189380742 (444h55m15.960022077s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.645213384 (444h55m16.415854719s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.866575910 (444h55m16.637217245s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:44.740074006 (444h55m19.510715341s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:46.188108286 (444h55m20.958749621s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:55.408676041 (444h55m30.179317376s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:06:24.142005152 (444h55m58.912646487s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1gzELQ4cJ6iXuHuRJTUE1gSGj2Wz2VYoqLdZpEzey5RQRvGQv8, address:45.91.95.5:4034): protocol: expected piece hash; context deadline exceeded; EOF Jul 11 22:06:24.142454010 (444h55m58.913095375s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: write tcp 188.166.225.170:46732->104.36.82.3:4799: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142530917 (444h55m58.913172282s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: write tcp 188.166.225.170:41510->104.36.82.6:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142582606 (444h55m58.913223991s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: write tcp 188.166.225.170:59368->104.36.82.19:4414: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142659403 (444h55m58.913300739s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: write tcp 188.166.225.170:57218->104.36.82.4:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142696935 (444h55m58.91333832s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:104.36.82.51:4081): protocol: write tcp 188.166.225.170:43764->104.36.82.51:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142743154 (444h55m58.913384489s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:104.36.82.50:4035): protocol: rpc: dial tcp 104.36.82.50:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142774984 (444h55m58.91341635s) [seg_pos={0 0}, upload=355847]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 11 22:06:24.374341223 (444h55m59.144982558s) [upload=355847]: Done uploading segments... Jul 11 22:06:24.374371692 (444h55m59.145013097s) [upload=355847]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.988847598s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [......XXXX.XXXXX............................................] duration: 5.730051103s FAIL (2025-07-11 22:42:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== {0 0}, upload=355880]: Done begin upload segment. Jul 11 22:08:00.702599502 (444h57m35.473240837s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702603690 (444h57m35.473245025s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702956284 (444h57m35.473597619s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703119166 (444h57m35.473760501s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703227583 (444h57m35.473868918s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703520243 (444h57m35.474161578s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703530502 (444h57m35.474171837s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703797383 (444h57m35.474438718s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703880252 (444h57m35.474521587s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704039647 (444h57m35.474680972s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704271750 (444h57m35.474913075s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705204535 (444h57m35.47584587s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705557110 (444h57m35.476198445s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705766800 (444h57m35.476408126s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705974929 (444h57m35.476616254s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.706188308 (444h57m35.476829643s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:02.412760756 (444h57m37.183402091s) [upload=355880]: Next returned nil segment Jul 11 22:08:02.412778691 (444h57m37.183420026s) [upload=355880]: Waiting for error group managing segments... Jul 11 22:08:02.760975870 (444h57m37.531617205s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.038510834 (444h57m37.809152169s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.058278492 (444h57m37.828919817s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.256226865 (444h57m38.0268682s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.258807431 (444h57m38.029448776s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:29.815430122 (444h58m4.586071457s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:104.36.82.8:4969): protocol: rpc: dial tcp 104.36.82.8:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815487462 (444h58m4.586128857s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: rpc: dial tcp 104.36.82.13:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815517309 (444h58m4.586158644s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:104.36.82.5:4837): protocol: rpc: dial tcp 104.36.82.5:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815582673 (444h58m4.586224029s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: rpc: dial tcp 104.36.82.6:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815631728 (444h58m4.586273063s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:104.36.82.7:4909): protocol: rpc: dial tcp 104.36.82.7:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815657246 (444h58m4.586298581s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815691662 (444h58m4.586332997s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:104.36.82.15:4258): protocol: rpc: dial tcp 104.36.82.15:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815727029 (444h58m4.586368364s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815755385 (444h58m4.58639672s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: write tcp 188.166.225.170:49458->104.36.82.14:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815777556 (444h58m4.586418891s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: rpc: dial tcp 104.36.82.4:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815783548 (444h58m4.586424894s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: write tcp 188.166.225.170:45820->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815817934 (444h58m4.586459269s) [seg_pos={0 0}, upload=355880]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 11 22:08:30.047483492 (444h58m4.818124817s) [upload=355880]: Done uploading segments... Jul 11 22:08:30.047507088 (444h58m4.818148423s) [upload=355880]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.730088224s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [........XX.X................................................] duration: 5.569817385s FAIL (2025-07-11 22:41:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.569874585s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [...X.XXX.XXXXX..............................................] duration: 6.190758537s FAIL (2025-07-11 22:41:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.190810997s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........XX.X...............................................] duration: 5.692645406s FAIL (2025-07-11 22:41:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.692672149s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [.......XXXX.XXXXX...........................................] duration: 5.863912931s FAIL (2025-07-11 22:41:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== {0 0}, upload=355880]: Done begin upload segment. Jul 11 22:08:00.702599502 (444h57m35.473240837s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702603690 (444h57m35.473245025s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702956284 (444h57m35.473597619s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703119166 (444h57m35.473760501s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703227583 (444h57m35.473868918s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703520243 (444h57m35.474161578s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703530502 (444h57m35.474171837s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703797383 (444h57m35.474438718s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703880252 (444h57m35.474521587s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704039647 (444h57m35.474680972s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704271750 (444h57m35.474913075s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705204535 (444h57m35.47584587s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705557110 (444h57m35.476198445s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705766800 (444h57m35.476408126s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705974929 (444h57m35.476616254s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.706188308 (444h57m35.476829643s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:02.412760756 (444h57m37.183402091s) [upload=355880]: Next returned nil segment Jul 11 22:08:02.412778691 (444h57m37.183420026s) [upload=355880]: Waiting for error group managing segments... Jul 11 22:08:02.760975870 (444h57m37.531617205s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.038510834 (444h57m37.809152169s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.058278492 (444h57m37.828919817s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.256226865 (444h57m38.0268682s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.258807431 (444h57m38.029448776s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:29.815430122 (444h58m4.586071457s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:104.36.82.8:4969): protocol: rpc: dial tcp 104.36.82.8:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815487462 (444h58m4.586128857s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: rpc: dial tcp 104.36.82.13:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815517309 (444h58m4.586158644s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:104.36.82.5:4837): protocol: rpc: dial tcp 104.36.82.5:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815582673 (444h58m4.586224029s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: rpc: dial tcp 104.36.82.6:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815631728 (444h58m4.586273063s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:104.36.82.7:4909): protocol: rpc: dial tcp 104.36.82.7:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815657246 (444h58m4.586298581s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815691662 (444h58m4.586332997s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:104.36.82.15:4258): protocol: rpc: dial tcp 104.36.82.15:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815727029 (444h58m4.586368364s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815755385 (444h58m4.58639672s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: write tcp 188.166.225.170:49458->104.36.82.14:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815777556 (444h58m4.586418891s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: rpc: dial tcp 104.36.82.4:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815783548 (444h58m4.586424894s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: write tcp 188.166.225.170:45820->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815817934 (444h58m4.586459269s) [seg_pos={0 0}, upload=355880]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 11 22:08:30.047483492 (444h58m4.818124817s) [upload=355880]: Done uploading segments... Jul 11 22:08:30.047507088 (444h58m4.818148423s) [upload=355880]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.863937527s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [......X..XX.................................................] duration: 5.797580129s FAIL (2025-07-11 22:41:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 47]: Done begin upload segment. Jul 11 22:05:25.250192172 (444h55m0.020833497s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250231017 (444h55m0.020872352s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250569715 (444h55m0.02121105s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250766191 (444h55m0.021407526s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250847707 (444h55m0.021489042s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251107715 (444h55m0.02174905s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251178610 (444h55m0.021819945s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251489936 (444h55m0.022131341s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251521937 (444h55m0.022163272s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251908417 (444h55m0.022549742s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.252223779 (444h55m0.022865115s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253148930 (444h55m0.023790265s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253471086 (444h55m0.024112411s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253751101 (444h55m0.024392436s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254046447 (444h55m0.024687802s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254400644 (444h55m0.025041979s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254676783 (444h55m0.025318108s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254923645 (444h55m0.02556498s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:26.394518518 (444h55m1.165159853s) [upload=355847]: Next returned nil segment Jul 11 22:05:26.394534878 (444h55m1.165176213s) [upload=355847]: Waiting for error group managing segments... Jul 11 22:05:26.700772093 (444h55m1.471413428s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:29.109783784 (444h55m3.880425109s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:33.759174840 (444h55m8.529816165s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:34.089773700 (444h55m8.860415035s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:35.743647957 (444h55m10.514289292s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.189380742 (444h55m15.960022077s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.645213384 (444h55m16.415854719s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.866575910 (444h55m16.637217245s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:44.740074006 (444h55m19.510715341s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:46.188108286 (444h55m20.958749621s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:55.408676041 (444h55m30.179317376s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:06:24.142005152 (444h55m58.912646487s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1gzELQ4cJ6iXuHuRJTUE1gSGj2Wz2VYoqLdZpEzey5RQRvGQv8, address:45.91.95.5:4034): protocol: expected piece hash; context deadline exceeded; EOF Jul 11 22:06:24.142454010 (444h55m58.913095375s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: write tcp 188.166.225.170:46732->104.36.82.3:4799: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142530917 (444h55m58.913172282s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: write tcp 188.166.225.170:41510->104.36.82.6:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142582606 (444h55m58.913223991s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: write tcp 188.166.225.170:59368->104.36.82.19:4414: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142659403 (444h55m58.913300739s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: write tcp 188.166.225.170:57218->104.36.82.4:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142696935 (444h55m58.91333832s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:104.36.82.51:4081): protocol: write tcp 188.166.225.170:43764->104.36.82.51:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142743154 (444h55m58.913384489s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:104.36.82.50:4035): protocol: rpc: dial tcp 104.36.82.50:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142774984 (444h55m58.91341635s) [seg_pos={0 0}, upload=355847]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 11 22:06:24.374341223 (444h55m59.144982558s) [upload=355847]: Done uploading segments... Jul 11 22:06:24.374371692 (444h55m59.145013097s) [upload=355847]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.797610296s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [....X.XXX.XXXXX.............................................] duration: 6.149108466s FAIL (2025-07-11 22:40:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.14913132s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [..........XX.X..............................................] duration: 6.091558316s FAIL (2025-07-11 22:40:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.091574286s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 9 out of 60 is failed (threshold=3) [........XXXX.XXXXX..........................................] duration: 5.894748194s FAIL (2025-07-11 22:40:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 5) ======LOGS====== {0 0}, upload=355880]: Done begin upload segment. Jul 11 22:08:00.702599502 (444h57m35.473240837s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702603690 (444h57m35.473245025s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.702956284 (444h57m35.473597619s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703119166 (444h57m35.473760501s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703227583 (444h57m35.473868918s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703520243 (444h57m35.474161578s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703530502 (444h57m35.474171837s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703797383 (444h57m35.474438718s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.703880252 (444h57m35.474521587s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704039647 (444h57m35.474680972s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.704271750 (444h57m35.474913075s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705204535 (444h57m35.47584587s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705557110 (444h57m35.476198445s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705766800 (444h57m35.476408126s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.705974929 (444h57m35.476616254s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:00.706188308 (444h57m35.476829643s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Uploading piece... Jul 11 22:08:02.412760756 (444h57m37.183402091s) [upload=355880]: Next returned nil segment Jul 11 22:08:02.412778691 (444h57m37.183420026s) [upload=355880]: Waiting for error group managing segments... Jul 11 22:08:02.760975870 (444h57m37.531617205s) [noise=true , address=45.91.116.5:4299 , piece_id=FFMYICXNRW3JQEATBIYLA4RQYMHOJNS6K5JYYEQPZ2QPVQBHBK4A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.038510834 (444h57m37.809152169s) [noise=true , address=45.91.116.8:4048 , piece_id=PTOCSETB2T6GOH6PJFPRMA3MSQHFDJZUZ3UNACYWNZHE4ABHOTQQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.058278492 (444h57m37.828919817s) [noise=true , address=45.91.116.4:4939 , piece_id=FJGEG4J6LFZ2U4LNY5TXE3UDBIC6RDVBQXWFLIQIRREISYANC27Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.256226865 (444h57m38.0268682s) [noise=true , address=77.90.31.10:4517 , piece_id=63CMUBZO3H3WLGRJCALU4SEER3ZNUNEIGVSBFNNELEUFZTQ6ICEA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:03.258807431 (444h57m38.029448776s) [noise=true , address=77.90.31.14:4663 , piece_id=5UZDYRVAD376WG7G7SQNK6AUIWXZD2OXGXKBMQONP2DISM5U4RWA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: <nil> Jul 11 22:08:29.815430122 (444h58m4.586071457s) [noise=true , address=104.36.82.8:4969 , piece_id=KKWP7BMHT6UK7I2JWZE3FBT6HMQ7M3TCXSKMNGO4O4VY4H46GUVA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1HxTyEaQTErcZJWMYLsND9Xa8Nwaa5e1f4x2bs7UQzSRiW7buX, address:104.36.82.8:4969): protocol: rpc: dial tcp 104.36.82.8:4969: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815487462 (444h58m4.586128857s) [noise=true , address=104.36.82.13:4185 , piece_id=T3GZFCNWTIW7XP57KNZT7FZNGR3NCYFVDROVUCAPEDSHYDLQUL2A, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1J4E8bxy3XRU8MmG8Jn3g5DiiBAGs6smUfYSgRea3mbCTZVgDN, address:104.36.82.13:4185): protocol: rpc: dial tcp 104.36.82.13:4185: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815517309 (444h58m4.586158644s) [noise=true , address=104.36.82.5:4837 , piece_id=7OB3NDK4P2WWZ7ZQLWCZBDF5GV7ONW4RUI6SIHHK5BPTIGE5ZGJQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12rJPJdZ2EA1Uh9gUa7dHj5utLBtcFQYFPXPVX5HgJbo8ppc6pV, address:104.36.82.5:4837): protocol: rpc: dial tcp 104.36.82.5:4837: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815582673 (444h58m4.586224029s) [noise=true , address=104.36.82.6:4874 , piece_id=WLLMQZF6LUHKIX5HVGZQJS65GM3ZHITKEPZ3OFEZHPS4RGV5QTJA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12ay3ZqUvNcaX19JYT1hEaqydsxP6VoDjPavWXBNB34cestcm71, address:104.36.82.6:4874): protocol: rpc: dial tcp 104.36.82.6:4874: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815631728 (444h58m4.586273063s) [noise=true , address=104.36.82.7:4909 , piece_id=VWKDZYZK7KZA25FNRGBATEWICWUTMSQ2GI6ZQMDPRYOI6YOOI5VA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12DaDrwzfrbz1yNwt4CpyZq7hADh5KQpJZkVmev8ukpF9wcXK2x, address:104.36.82.7:4909): protocol: rpc: dial tcp 104.36.82.7:4909: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815657246 (444h58m4.586298581s) [noise=true , address=104.36.82.11:4114 , piece_id=DMTCSJKZKSDWYNY56FLDCC5D2IFDRUSLDKN4FSXX4ZC3OMKOYZTQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1rbW6vFBsSXTwat2th5XhcKj4Jmnsupc89u7KZ7zNh84JmE4JN, address:104.36.82.11:4114): protocol: rpc: dial tcp 104.36.82.11:4114: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815691662 (444h58m4.586332997s) [noise=true , address=104.36.82.15:4258 , piece_id=3TBOXAOAPHNBVXJ3MBLWWO77JYTXSNVIITVLPHU76O5P6DB4NJ5Q, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF, address:104.36.82.15:4258): protocol: rpc: dial tcp 104.36.82.15:4258: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815727029 (444h58m4.586368364s) [noise=true , address=104.36.82.15:4259 , piece_id=Q2CEYBJJZ7I5GNCKFY4LOTSMTB7O3MDA7VGK2EC4GAVWGRKATDXA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ET8PaAfWq2RcPNjucMqDbmnkMZg8qnkTw9dszwLzz765oBr7y, address:104.36.82.15:4259): protocol: rpc: dial tcp 104.36.82.15:4259: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815755385 (444h58m4.58639672s) [noise=true , address=104.36.82.14:4222 , piece_id=33ICRA7TVVBN4Q3N4F2SFPY5UOTNCZBWUG5C2DT74JDEIJ5ASTCA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:1ZLe9LXXbvrAbsYW3SKoqeihGsYhan3LgDBKjNrSspG6UnX4o1, address:104.36.82.14:4222): protocol: write tcp 188.166.225.170:49458->104.36.82.14:4222: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815777556 (444h58m4.586418891s) [noise=true , address=104.36.82.4:4804 , piece_id=FKPFDFT5UBPVGEQORO34UGGM3F7SIM3CMMSA3V3GRIBXU3CBC2YA, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12M1GKTnn8Uex751kqW5NhedsDiRb7GR7u1Dd9zwDm6XMzcRL2g, address:104.36.82.4:4804): protocol: rpc: dial tcp 104.36.82.4:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815783548 (444h58m4.586424894s) [noise=true , address=104.36.82.14:4223 , piece_id=737YQVUKZCEE2PPAPKKGBRYP6ASHSHOST4XGXEYHOSUZ3MLKCQDQ, seg_pos={0 0}, upload=355880]: Done uploading piece. err: ecclient: upload failed (node:12C59b8knr62ANoUWyaJZDHm2os1tFm3SKL8d34eKsdpZGHYQWE, address:104.36.82.14:4223): protocol: write tcp 188.166.225.170:45820->104.36.82.14:4223: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:08:29.815817934 (444h58m4.586459269s) [seg_pos={0 0}, upload=355880]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil> Jul 11 22:08:30.047483492 (444h58m4.818124817s) [upload=355880]: Done uploading segments... Jul 11 22:08:30.047507088 (444h58m4.818148423s) [upload=355880]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5) Duration: 5.89478303s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.......X..XX................................................] duration: 5.749809629s FAIL (2025-07-11 22:40:12 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 11) ======LOGS====== 47]: Done begin upload segment. Jul 11 22:05:25.250192172 (444h55m0.020833497s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250231017 (444h55m0.020872352s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250569715 (444h55m0.02121105s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250766191 (444h55m0.021407526s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.250847707 (444h55m0.021489042s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251107715 (444h55m0.02174905s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251178610 (444h55m0.021819945s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251489936 (444h55m0.022131341s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251521937 (444h55m0.022163272s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.251908417 (444h55m0.022549742s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.252223779 (444h55m0.022865115s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253148930 (444h55m0.023790265s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253471086 (444h55m0.024112411s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.253751101 (444h55m0.024392436s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254046447 (444h55m0.024687802s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254400644 (444h55m0.025041979s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254676783 (444h55m0.025318108s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:25.254923645 (444h55m0.02556498s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Uploading piece... Jul 11 22:05:26.394518518 (444h55m1.165159853s) [upload=355847]: Next returned nil segment Jul 11 22:05:26.394534878 (444h55m1.165176213s) [upload=355847]: Waiting for error group managing segments... Jul 11 22:05:26.700772093 (444h55m1.471413428s) [noise=true , address=79.127.205.233:4656 , piece_id=4YNKONSSBYFTV4CCGI3JKAWSADBEOBKKE24L7EEO64CWUZSFJSKQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:29.109783784 (444h55m3.880425109s) [noise=true , address=79.127.220.101:4059 , piece_id=5Y2CK5SM54UODEFCGPDTAAAMF3JRC5CV7AGQYCZ6PW47EQD5VV2Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:33.759174840 (444h55m8.529816165s) [noise=true , address=77.90.31.12:4619 , piece_id=V2CFGF4J3CRRMQVBVUTYFOAU6NHNW7ZZNXHLW3B5WC6RTW6MSJZQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:34.089773700 (444h55m8.860415035s) [noise=true , address=77.90.31.13:4640 , piece_id=DUQI7XZUGJFKCW5D73FZGEDSLR3S5PKCPPH6V2XLWSR35BUQZ54A, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:35.743647957 (444h55m10.514289292s) [noise=true , address=45.91.116.11:4149 , piece_id=JJ735AOMNAZ5V2BWJGA2BPLQ375574VANFAFBGXAOVNODKGD4K5Q, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.189380742 (444h55m15.960022077s) [noise=true , address=77.90.31.11:4588 , piece_id=QKDMMYO5KGDLTFB74BSPG7UYP6VWEUQBS52WPLW2VKDQHXM4LNOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.645213384 (444h55m16.415854719s) [noise=true , address=77.90.31.21:4910 , piece_id=R43OAJYZUOW3ZNG2PWF7BMXRO37U44MFEAGPEAPQCZNUP6GUEBIQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:41.866575910 (444h55m16.637217245s) [noise=true , address=45.91.95.2:4021 , piece_id=37GWHZ27ALNE3XJWYMRZ3QDB6HYL6JL5KSSRMR3BQMBMDEMQ6NAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:44.740074006 (444h55m19.510715341s) [noise=true , address=77.90.31.15:4707 , piece_id=IULW4EB4E6R56FTK3ZT527MYU22CQFW7XMWUC7ULUGJPS5VSL2ZA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:46.188108286 (444h55m20.958749621s) [noise=true , address=45.91.95.4:4021 , piece_id=NMZAYDJGGRU27TY7QCKYDGGFWBWMWWKHIROPT57QVUSC4HKAUHMQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:05:55.408676041 (444h55m30.179317376s) [noise=true , address=45.91.95.3:4021 , piece_id=INUXGJNMLAZM6NI5PRUDW37MH42AMIC2V4EESX3NLMNZKZ33ZQWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: <nil> Jul 11 22:06:24.142005152 (444h55m58.912646487s) [noise=true , address=45.91.95.5:4034 , piece_id=CCLUI4ELT3AMG62RKTLXEGM4LBCQFTQQJHKKAD7LMOFE4XVYTWUA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1gzELQ4cJ6iXuHuRJTUE1gSGj2Wz2VYoqLdZpEzey5RQRvGQv8, address:45.91.95.5:4034): protocol: expected piece hash; context deadline exceeded; EOF Jul 11 22:06:24.142454010 (444h55m58.913095375s) [noise=true , address=104.36.82.3:4799 , piece_id=E3PJM326VZOUQQIXYYK2T3IDEDGTHYR6M2GNPZECR4YXJRSJGCTA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12pMB9xsz6ArzVRzSkh59X8Y7v3w18CzWoVzBRhPdKZTne241v9, address:104.36.82.3:4799): protocol: write tcp 188.166.225.170:46732->104.36.82.3:4799: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142530917 (444h55m58.913172282s) [noise=true , address=104.36.82.6:4901 , piece_id=SE4Y3VRZRUWDBBIQFYCRDH3KYSPWFSN4KOCS3KKUMLLTDRX7S3PA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1SRXGomdNGRrsPBzD8YU34Y1EiuiJdnwuB79v8cMSLgTd7jpei, address:104.36.82.6:4901): protocol: write tcp 188.166.225.170:41510->104.36.82.6:4901: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142582606 (444h55m58.913223991s) [noise=true , address=104.36.82.19:4414 , piece_id=4YUT5MJANGYRZUSAVBJ4NKZH5V5XTTMQI4OZX5WBZSMNS7IRJDPA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:1R6GJNS7bXfsDLsp3CE9qcvTbcT44QmgvSFzVbzpukyVYsezRQ, address:104.36.82.19:4414): protocol: write tcp 188.166.225.170:59368->104.36.82.19:4414: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142659403 (444h55m58.913300739s) [noise=true , address=104.36.82.4:4820 , piece_id=7DBP4GL3YMF23V3U27ZS6STMJWS2FLY4HWDKHBQL67A2C3SKUDWA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12TnUNGbwHSf335XW7vNuq1ffwhFkgxomckBQmF189779tRU59k, address:104.36.82.4:4820): protocol: write tcp 188.166.225.170:57218->104.36.82.4:4820: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142696935 (444h55m58.91333832s) [noise=true , address=104.36.82.51:4081 , piece_id=YQKYMQJ676ODM3ZTSHRQANURNQB4WKQS7HW34AB4G35FVYYC5FAA, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:121Gj3trM89mKpTffMYkrV9PrwkPqQU2LauCiG1v3J91Mej9KWF, address:104.36.82.51:4081): protocol: write tcp 188.166.225.170:43764->104.36.82.51:4081: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142743154 (444h55m58.913384489s) [noise=true , address=104.36.82.50:4035 , piece_id=RPDFNBKOYV4HTINO32MZ5K7ESLNDTUPSAHXKLKJ2J7XWWV7RJGOQ, seg_pos={0 0}, upload=355847]: Done uploading piece. err: ecclient: upload failed (node:12nevdZspAt1ce9XA2Emh8QJDxcmEKpYemCMwWidVi8RU6T6vZD, address:104.36.82.50:4035): protocol: rpc: dial tcp 104.36.82.50:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 11 22:06:24.142774984 (444h55m58.91341635s) [seg_pos={0 0}, upload=355847]: Done waiting for segment. successful: 11 optimal: 14 errs: <nil> Jul 11 22:06:24.374341223 (444h55m59.144982558s) [upload=355847]: Done uploading segments... Jul 11 22:06:24.374371692 (444h55m59.145013097s) [upload=355847]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 11) Duration: 5.749839337s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [...........XX.X.............................................] duration: 5.566011663s FAIL (2025-07-11 22:40:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.566036018s core uplink us-select-1 us1-placement-20

1
...
13730
13731
13732
13733
13734
...
14085