Ошибка загрузки transfer closed with 81432904 bytes remaining to read код ошибки 1 как исправить

Trying to download version(5:19.03.4~3-0~debian-stretch) of docker-ce using dockerfile:

# apt-cache madison docker-ce
 docker-ce | 5:19.03.4~3-0~debian-stretch | https://download.docker.com/linux/debian stretch/stable amd64 Packages
 docker-ce | 5:19.03.3~3-0~debian-stretch | https://download.docker.com/linux/debian stretch/stable amd64 Packages
 docker-ce | 5:19.03.2~3-0~debian-stretch | https://download.docker.com/linux/debian stretch/stable amd64 Packages
 docker-ce | 5:19.03.1~3-0~debian-stretch | https://download.docker.com/linux/debian stretch/stable amd64 Packages
 docker-ce | 5:19.03.0~3-0~debian-stretch | https://download.docker.com/linux/debian stretch/stable amd64 Packages

Below is the dockerfile:

FROM jenkins/jenkins:2.190.2

ENV DEBIAN_FRONTEND=noninteractive

# Official Jenkins image does not include sudo, change to root user
USER root

# Used to set the docker group ID
# Set to 497 by default, which is the groupID used by AWS Linux ECS instance
ARG DOCKER_GID=497

# Create Docker Group with GID
# Set default value of 497 if DOCKER_GID set to blank string by Docker compose
RUN groupadd -g ${DOCKER_GID:-497} docker

# Install base packages for docker, docker-compose & ansible
# apt-key adv --keyserver keyserver.ubuntu.com --recv-keys AA8E81B4331F7F50 && 
RUN apt-get update -y && 
    apt-get -y install bc 
                    gawk 
                    libffi-dev 
                    musl-dev 
                    apt-transport-https 
                    curl 
                    python3 
                    python3-dev 
                    python3-setuptools 
                    gcc 
                    make 
                    libssl-dev 
                    python3-pip 

# Used at build time but not runtime
ARG DOCKER_VERSION=5:19.03.4~3-0~debian-stretch

# Install the latest Docker CE binaries and add user `jenkins` to the docker group
RUN apt-get update && 
    apt-get -y install apt-transport-https 
    ca-certificates 
    curl 
    gnupg-agent 
    software-properties-common && 
    curl -fsSL https://download.docker.com/linux/$(. /etc/os-release; echo "$ID")/gpg > /tmp/dkey; apt-key add /tmp/dkey && 
    add-apt-repository 
      "deb [arch=amd64] https://download.docker.com/linux/$(. /etc/os-release; echo "$ID") 
      $(lsb_release -cs) 
      stable" && 
    apt-get update && 
    apt-get -y install docker-ce=${DOCKER_VERSION:-5:19.03.4~3-0~debian-stretch}  
        docker-ce-cli=${DOCKER_VERSION:-5:19.03.4~3-0~debian-stretch} 
        containerd.io && 
    usermod -aG docker jenkins && 
    usermod -aG users jenkins

ARG DOCKER_COMPOSE=1.24.1

# Install docker compose
RUN curl -L "https://github.com/docker/compose/releases/download/${DOCKER_COMPOSE:-1.24.1}/docker-compose-$(uname -s)-$(uname -m)" 
    -o /usr/local/bin/docker-compose && 
    chmod +x /usr/local/bin/docker-compose && 
    pip3 install ansible boto3

# Change to jenkins user
USER jenkins

# Add jenkins plugin
COPY plugins.txt /usr/share/jenkins/plugins.txt
RUN /usr/local/bin/install-plugins.sh < /usr/share/jenkins/plugins.txt

that downloads and install 5:19.03.4~3-0~debian-stretch version of docker-ce

Disk quota on docker host:

$ sudo ls /var/lib/docker/165536.165536/
builder  buildkit  containers  image  network  overlay2  plugins  runtimes  swarm  tmp  trust  volumes
$ df /
Filesystem     1K-blocks     Used Available Use% Mounted on
/dev/sda7       67327600 16184040  47700464  26% /

docker-compose file creates volume(jenkins_home) on docker host:

version: '2'

volumes:
  jenkins_home:
    external: true

services:
  jenkins:
    build:
      context: .
      args:
        DOCKER_GID: ${DOCKER_GID}
        DOCKER_VERSION: ${DOCKER_VERSION}
        DOCKER_COMPOSE: ${DOCKER_COMPOSE}
    volumes:
      - jenkins_home:/var/jenkins_home
      - /var/run/docker.sock:/var/run/docker.sock
    ports:
      - "8080:8080"

docker-compose up -d gives below error:

Step 8/14 : ARG DOCKER_VERSION=5:19.03.4~3-0~debian-stretch
 ---> Running in 10f76e84e104
Removing intermediate container 10f76e84e104
 ---> 66b530666094

Step 9/14 : RUN apt-get update &&     apt-get -y install apt-transport-https     ca-certificates     curl     gnupg-agent     software-properties-common &&     curl -fsSL https://download.docker.com/linux/$(. /etc/os-release; echo "$ID")/gpg > /tmp/dkey; apt-key add /tmp/dkey &&     add-apt-repository       "deb [arch=amd64] https://download.docker.com/linux/$(. /etc/os-release; echo "$ID")       $(lsb_release -cs)       stable" &&     apt-get update &&     apt-get -y install docker-ce=${DOCKER_VERSION:-5:19.03.4~3-0~debian-stretch}          docker-ce-cli=${DOCKER_VERSION:-5:19.03.4~3-0~debian-stretch}         containerd.io &&     usermod -aG docker jenkins &&     usermod -aG users jenkins


:
:
:
Get:19 http://security.debian.org/debian-security stretch/updates/main amd64 sudo amd64 1.8.19p1-2.1+deb9u1 [1054 kB]


Get:20 https://download.docker.com/linux/debian stretch/stable amd64 docker-ce-cli amd64 5:19.03.4~3-0~debian-stretch [42.5 MB]
Err:20 https://download.docker.com/linux/debian stretch/stable amd64 docker-ce-cli amd64 5:19.03.4~3-0~debian-stretch
  transfer closed with 30852358 bytes remaining to read
Get:21 https://download.docker.com/linux/debian stretch/stable amd64 docker-ce amd64 5:19.03.4~3-0~debian-stretch [22.8 MB]
Fetched 54.6 MB in 1min 8s (794 kB/s)
E: Failed to fetch https://download.docker.com/linux/debian/dists/stretch/pool/stable/amd64/docker-ce-cli_19.03.4~3-0~debian-stretch_amd64.deb  transfer closed with 30852358 bytes remaining to read
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?
ERROR: Service 'jenkins' failed to build: The command '/bin/sh -c apt-get update &&     apt-get -y install apt-transport-https     ca-certificates     curl     gnupg-agent     software-properties-common &&     curl -fsSL https://download.docker.com/linux/$(. /etc/os-release; echo "$ID")/gpg > /tmp/dkey; apt-key add /tmp/dkey &&     add-apt-repository       "deb [arch=amd64] https://download.docker.com/linux/$(. /etc/os-release; echo "$ID")       $(lsb_release -cs)       stable" &&     apt-get update &&     apt-get -y install docker-ce=${DOCKER_VERSION:-5:19.03.4~3-0~debian-stretch}          docker-ce-cli=${DOCKER_VERSION:-5:19.03.4~3-0~debian-stretch}         containerd.io &&     usermod -aG docker jenkins &&     usermod -aG users jenkins' returned a non-zero code: 100

Analysing space quota in 66b530666094 container id:

$ docker run -it 66b530666094 bash
root@565b3a0ebfc2:/# 
root@565b3a0ebfc2:/# df /
Filesystem     1K-blocks     Used Available Use% Mounted on
overlay         67327600 16335448  47549056  26% /
root@565b3a0ebfc2:/# pwd
/
root@565b3a0ebfc2:/# whoami
root
root@565b3a0ebfc2:/# exit
exit
$

This issue is occurring from today evening… Otherwise this docker file was working fine..

How to resolve this download error? What does this error signify?

1. 
   Home

2. 
   BrowserAutomationStudio

3. 
   Поддержка

4. 
   Ошибка при выполнении get запроса с ресурсом.

 cURL error 18: transfer closed with 3789 bytes remaining to read (see http://curl.haxx.se/libcurl/c/libcurl-errors.html)

function url_exists($url) {
if (!$fp = curl_init($url)) return false;
return true;
}

        $feed_img_url = $feed[$idx]->getImageVersions2()->candidates[0]->getUrl()."n";
if (url_exists($feed_img_url)==true) {
$img = "results/".$feed_id_str."/".$feed_id_str.".jpeg";
file_put_contents($img, file_get_contents($feed_img_url));
}

Решение

function url_exists($url) {
if (!$cURL = curl_init($url)) {
return false;
}

curl_setopt($cURL, CURLOPT_HTTPHEADER, array('Expect:'));
return true;
}

catch (Exception $e) {
echo $e->getMessage();
if (strpos($e->getMessage(), 'cURL error 18: transfer closed') !== false) {
continue;
}

}

Другие решения

Других решений пока нет …

Проблемы при отправки xml пакетов через POST. Если длина пакета <= 1024, то все гуд, если размер больше хотя бы на один, то все получаю ошибку №18 transfer closed with outstanding read data remaining.

Вот функция отправки

function _xmlHttpsReq2($addr, $xml){
echo "n".$addr;
echo "n".$xml;
echo "n".strlen($xml);
//if(strlen($xml)>1000)
//$xml = substr($xml,0,1025);
//$header[] = "Host: mydomain.test";
$header[] = "Content-type: text/xml; charset:utf-8";
$header[] = "Content-length: ".strlen($xml);
    $ch = curl_init($addr);
    curl_setopt($ch, CURLOPT_HEADER, 0);
    curl_setopt($ch, CURLOPT_RETURNTRANSFER,1);
    curl_setopt($ch, CURLOPT_POST,1);
    curl_setopt($ch, CURLOPT_POSTFIELDS,$xml);
    curl_setopt($ch, CURLOPT_SSL_VERIFYPEER,0);
	curl_setopt ($ch, CURLOPT_SSL_VERIFYHOST, 0);
	curl_setopt($ch, CURLOPT_HTTPHEADER, $header );
    $result=curl_exec($ch);
    if( curl_errno($ch) != 0 ) {
     $info = curl_getinfo($ch);
     foreach($info as $name=>$value)
     	echo "n".$name.'='.$value;
     	echo "nres= ".$result;
     	echo  "n".'CURL_error: ' . curl_errno($ch) . ', ' . curl_error($ch);
	return 'CURL_error: ' . curl_errno($ch) . ', ' . curl_error($ch);
    };
    $info = curl_getinfo($ch);
     foreach($info as $name=>$value)
     	echo "n".$name.'='.$value;
     	echo "nres= ".$result;
    curl_close($ch);
    return $result;
}

Вот результат отработки функции без ошибки (пакет менее 1024):

content_type=text/xml;charset=UTF-8

http_code=200

header_size=149

request_size=393

filetime=-1

ssl_verify_result=19

redirect_count=0

total_time=0.267345

namelookup_time=4.5E-5

connect_time=0.026682

pretransfer_time=0.155036

size_upload=258

size_download=17549

speed_download=65641

speed_upload=965

download_content_length=-1

upload_content_length=-1

starttransfer_time=0.267161

redirect_time=0

А вот при ошибке (пакет более 1024):

content_type=text/xml;charset=UTF-8

http_code=200

header_size=257

request_size=158

filetime=-1

ssl_verify_result=19

redirect_count=0

total_time=0.226429

namelookup_time=5.0E-5

connect_time=0.029792

pretransfer_time=0.158446

size_upload=1206

size_download=0

speed_download=0

speed_upload=5326

download_content_length=-1

upload_content_length=1206

starttransfer_time=0.184043

redirect_time=0

CURL_error: 18, transfer closed with outstanding read data remaining