Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
799.2102ms
FAIL (2025-07-11 19:22:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 799.24617ms
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.415378107s
FAIL (2025-07-11 19:22:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.415396011s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
3.108287933s
FAIL (2025-07-11 19:21:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 3.108310768s
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
6.251262796s
FAIL (2025-07-11 19:21:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.251305668s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.01261342s
FAIL (2025-07-11 19:21:00 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 1.01264384s
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
15.348288594s
FAIL (2025-07-11 19:20:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 15.348329292s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.038068478s
FAIL (2025-07-11 19:20:34 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 1.038108064s
edge
authservice
http
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000424296s
FAIL (2025-07-11 19:20:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000472798s
edge
gateway
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
760.268682ms
FAIL (2025-07-11 19:19:44 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 760.290774ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
820.382937ms
FAIL (2025-07-11 19:18:49 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 820.409759ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.828569376s
FAIL (2025-07-11 19:18:16 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 1.828585167s
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
863.369367ms
FAIL (2025-07-11 19:17:51 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 863.407079ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
833.976924ms
FAIL (2025-07-11 19:16:39 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 834.004758ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.066590576s
FAIL (2025-07-11 19:16:09 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 1.066619861s
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
795.077245ms
FAIL (2025-07-11 19:15:15 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 795.100871ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.167829467s
FAIL (2025-07-11 19:14:48 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 1.167859865s
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.033135108s
FAIL (2025-07-11 19:14:25 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 1.033239127s
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.064467342s
FAIL (2025-07-11 19:14:05 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 1.064499183s
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
796.858673ms
FAIL (2025-07-11 19:13:41 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 796.907907ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.009709864s
FAIL (2025-07-11 19:12:50 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 1.009740813s
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
759.116517ms
FAIL (2025-07-11 19:11:41 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 759.141767ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.416917043s
FAIL (2025-07-11 19:11:18 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 1.416942092s
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.051602036s
FAIL (2025-07-11 19:10:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 1.051637443s
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
778.031978ms
FAIL (2025-07-11 19:09:36 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 778.063768ms
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.014769948s
FAIL (2025-07-11 19:09:06 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 1.014797842s
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.086089668s
FAIL (2025-07-11 19:08:08 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 2.086128221s
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
4.16479757s
FAIL (2025-07-11 19:06:57 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 4.164823829s
edge
authservice
http
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
3.219034288s
FAIL (2025-07-11 19:06:28 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": read tcp 188.166.225.170:54150->45.38.24.2:443: read: connection reset by peer
Duration: 3.219059327s
edge
authservice
http
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
5.847975355s
FAIL (2025-07-11 18:48:52 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.848006956s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
6.41666312s
FAIL (2025-07-11 18:48:25 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 6.416703087s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.775761419s
FAIL (2025-07-11 18:48:02 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.775823287s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
5.971832092s
FAIL (2025-07-11 18:47:21 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.971855807s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.838087558s
FAIL (2025-07-11 18:46:24 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.838115933s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.896304245s
FAIL (2025-07-11 18:45:41 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.896326777s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
6.164823841s
FAIL (2025-07-11 18:45:17 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 6.164845812s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.841232746s
FAIL (2025-07-11 18:44:09 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.841267302s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
5.475798553s
FAIL (2025-07-11 18:43:34 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.475828562s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.947309516s
FAIL (2025-07-11 18:42:22 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.947336257s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.612445883s
FAIL (2025-07-11 18:41:47 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.612471571s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.747462292s
FAIL (2025-07-11 18:40:54 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.747488321s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
5.969468177s
FAIL (2025-07-11 18:40:00 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.969493695s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
5.987989781s
FAIL (2025-07-11 18:38:51 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.988015701s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
5.860464608s
FAIL (2025-07-11 18:38:20 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.860490158s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
5.895948461s
FAIL (2025-07-11 18:37:42 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.89596884s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
5.866396544s
FAIL (2025-07-11 18:37:04 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.866417955s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
5.821936501s
FAIL (2025-07-11 18:36:48 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.821966948s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
5.97290159s
FAIL (2025-07-11 18:35:55 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.972928361s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
5.827760011s
FAIL (2025-07-11 18:35:01 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.827798234s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
5.957485325s
FAIL (2025-07-11 18:34:46 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 5.957505765s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
6.002723074s
FAIL (2025-07-11 18:33:43 UTC)
orbiter warning:
======ERROR======
uplink: encryption: context deadline exceeded
======LOGS======
b.BatchRequestItem_ObjectBegin
Jul 11 18:02:21.450890313 (440h51m56.221531648s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:02:21.683320279 (440h51m56.453961604s) [seg_pos={0 0}, upload=352621]: Begin upload segment...
Jul 11 18:02:21.683360917 (440h51m56.454002252s) [seg_pos={0 0}, upload=352621]: Done begin upload segment.
Jul 11 18:02:21.683383099 (440h51m56.454024424s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683436241 (440h51m56.454077576s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.683787182 (440h51m56.454428517s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684007103 (440h51m56.454648438s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684044304 (440h51m56.454685639s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684290495 (440h51m56.45493183s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684327306 (440h51m56.454968671s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684555272 (440h51m56.455196607s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684696913 (440h51m56.455338248s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.684857801 (440h51m56.455499136s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685030050 (440h51m56.455671375s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685066640 (440h51m56.455707975s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685322841 (440h51m56.455964176s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685385260 (440h51m56.456026595s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.685662911 (440h51m56.456304246s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:21.686310820 (440h51m56.456952155s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Uploading piece...
Jul 11 18:02:23.289768592 (440h51m58.060409937s) [upload=352621]: Next returned nil segment
Jul 11 18:02:23.289848264 (440h51m58.060489609s) [upload=352621]: Waiting for error group managing segments...
Jul 11 18:02:23.623326431 (440h51m58.393967766s) [noise=true , address=104.36.82.2:4732 , piece_id=DPI5G7RF6SJCZ6TMB3QDPXIZRN6B354SDGSHYNC6765J33HM2E6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.638819181 (440h51m58.409460516s) [noise=true , address=104.36.82.7:4910 , piece_id=T547V567ID3G5MPPK4M25JIYPHQXZ67ILIKTXYGEYC6TL6RGBGFA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.649588975 (440h51m58.42023031s) [noise=true , address=104.36.82.9:4007 , piece_id=WDLVXDIKP5WRNGGWMXSPHVVUJTLVUO5UJSFROQJBGJRYNQLA2P6A, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.655676321 (440h51m58.426317656s) [noise=true , address=104.36.82.4:4804 , piece_id=WLJHLUP4MI64ZXF4BFFWU5DPQPBPZ4PX3GLLNBNN2IEC3RCRIDFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.664981534 (440h51m58.435622859s) [noise=true , address=104.36.82.8:4971 , piece_id=VM5DIDIUA4BMQ2EWRZ5QOOSYV745BFZXU6AD3I66USNEPTVPOEEQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.695816335 (440h51m58.466457721s) [noise=true , address=104.36.82.3:4765 , piece_id=QI26DPMOZNQIA4CT4YDGJNTNIRJCJH574PYQPRIBT237FGQORJZQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.703324399 (440h51m58.473965735s) [noise=true , address=104.36.82.13:4186 , piece_id=SYAHVDN56DF35MFLR5EERNCORB774GHCZYBLWXAWEJZQ5EHLTCUA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.704874795 (440h51m58.475516131s) [noise=true , address=104.36.82.14:4222 , piece_id=WRX2EXCPI37KMKGD4M2DQ67EWMCAL37EYEBVD6EF55TILYC46AXQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.733449694 (440h51m58.504091029s) [noise=true , address=45.91.116.9:4263 , piece_id=LOCCWEVJKZWO6ZDMX2AKPQFFLAR3BLCSY7TI3BEADJXADFCFB3VQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.815977733 (440h51m58.586619068s) [noise=true , address=104.36.82.11:4113 , piece_id=ORWMXFQHUTX2V3CDKFW5JRAW6RPMDTUH3HXY44HP365EWO4WHK6Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:23.852666976 (440h51m58.623308311s) [noise=true , address=104.36.82.15:4259 , piece_id=MDQ2BDQIIQWB544I6JL6GAAEKQQ3VCSXPJ6LHOTIKJMEV5YJWYBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.035247051 (440h51m58.805888386s) [noise=true , address=77.90.31.21:4878 , piece_id=UI3CKFCT4O7NSX2MBRXA5EY2OFM37QDXVC7MFNYLEUPLFGCHSTFQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187617559 (440h51m58.958258894s) [noise=true , address=77.90.31.10:4518 , piece_id=RYJYMRBYZPD7P66XDSR3SFRSEANDACXNDRQAJ3P4S5RWZYQUFN7Q, seg_pos={0 0}, upload=352621]: Done uploading piece. err: <nil>
Jul 11 18:02:24.187674608 (440h51m58.958315943s) [seg_pos={0 0}, upload=352621]: Segment reached optimal threshold of 13 pieces.
Jul 11 18:02:24.187910029 (440h51m58.958551364s) [noise=true , address=45.91.116.9:4261 , piece_id=FHJEFTK3PG5LA37WPFFYW45MLHOJOXECPAAD7VHIR4GHD2ON36YA, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: expected piece hash; context canceled; EOF
Jul 11 18:02:24.187962058 (440h51m58.958603393s) [noise=true , address=104.36.82.5:4838 , piece_id=PDTUY2X6ZP2XYRJCSJUPQGU6XQBJ24JSBYEOF5SEJSV5W7XFAFVQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iSxSmovuEAgNmjE3yCqXKtiRijYbcEcTtUdNxU3iC1ozTxfwL): protocol: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50318->104.36.82.5:4838: use of closed network connection
Jul 11 18:02:24.188014198 (440h51m58.958655533s) [noise=true , address=104.36.82.5:4839 , piece_id=A3BPQQBFPWP6S57T5EQNBGDVC4H7CSAVONZROAVGXVHXOH3D2VBQ, seg_pos={0 0}, upload=352621]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42980->104.36.82.5:4839: use of closed network connection
Jul 11 18:02:24.188045217 (440h51m58.958686552s) [seg_pos={0 0}, upload=352621]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 11 18:02:24.188132725 (440h51m58.95877406s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 11 18:02:24.188138696 (440h51m58.958780031s) [upload=352621]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 11 18:02:24.479427929 (440h51m59.250069264s) [upload=352621]: Done uploading segments...
Jul 11 18:02:24.479451945 (440h51m59.25009328s) [upload=352621]: Upload finished. err: <nil>
Jul 11 18:03:44.619075616 (440h53m19.389716981s) [upload=352636]: Starting upload
Jul 11 18:03:44.619201716 (440h53m19.389843121s) [upload=352636]: Done starting upload
Jul 11 18:03:44.619305746 (440h53m19.389947141s) [upload=352636]: Uploading segments...
Jul 11 18:03:44.619606711 (440h53m19.390248077s) [upload=352636]: Got next segment. Inline: false
Jul 11 18:03:44.619733224 (440h53m19.390374619s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 11 18:03:44.619741179 (440h53m19.390382514s) [upload=352636]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 11 18:03:45.562756994 (440h53m20.333398329s) [upload=352636]: Next segment err: context deadline exceeded
Jul 11 18:03:45.562815175 (440h53m20.33345651s) [upload=352636]: Done uploading segments...
Jul 11 18:03:45.562827869 (440h53m20.333469204s) [upload=352636]: Upload finished. err: context deadline exceeded
Duration: 6.002748494s
core
uplink
us-select-1
|