linux – 与Jenkins Docker插件和Jenkins Docker Slaves混淆

linux – 与Jenkins Docker插件和Jenkins Docker Slaves混淆,第1张

概述因此,我在某些方面感到惊喜,看到Jenkins Docker插件将Docker镜像“推送”到我的Docker主机金属,但它也让人感到困惑,因为我的构建发生在Docker Slave Containers中,它运行在Docker主机金属上.甚至我的Jenkins大师都在Docker容器中运行,而不是直接在金属上运行…… 在这个流行的Jenkins master/slave guide之后,我到达了J 因此,我在某些方面感到惊喜,看到Jenkins Docker插件将Docker镜像“推送”到我的Docker主机金属,但它也让人感到困惑,因为我的构建发生在Docker Slave Containers中,它运行在Docker主机金属上.甚至我的Jenkins大师都在Docker容器中运行,而不是直接在金属上运行……

在这个流行的Jenkins master/slave guide之后,我到达了Jenkins构建于ephemeral Docker containers的工作点.

这意味着,当我为Jenkins构建一些源代码软件组件/服务时,构建工作将在Jenkins slave中启动,它恰好是Jenkins Docker Plugin创建的Docker Container.

Jenkins工作空间位于此从属容器中,安装了Docker Plugin的Jenkins主机将在构建完成后处理此从属容器.查看我帮助解释的图表:

消化此图后,一些重要的跟进点:

> Jenkins Master和Jenkins Slave此时正在运行相同的Docker Host Metal,因为我刚刚开始运行这个系统
>我正在使用Docker Plugin和SSH Slaves插件来完成此设置

因此,在这个Docker Slave中创建了我的软件组件/服务构建工件,例如,它可以是.dll或.war.碰巧是我的构建工件将是Docker镜像.为了清楚起见,我正在一个正在运行的Docker容器(Jenkins Slave)中构建一个Docker镜像.

我的困惑始于我的期望,我应该明确地运行cmd将我的软件组件Docker镜像构建工件推送到Docker注册表.否则,当Jenkins构建作业完成后,Docker插件将关闭Docker容器slave,处理(rm)从属容器,而且我将丢失该slave容器内的构建工件.

实际发生的事情,以及为什么我惊喜,至少在短期内,当我开始运行devops时,构建工件Docker图像显示在Docker主机金属,docker image ls上.

我很惊讶Docker插件会达到这个级别的假设/帮助…我知道Docker插件允许你配置一个Docker注册表,你可以添加一个构建步骤来构建/发布到Docker Cloud我假设该云被视为图像的注册表,也可能是运行这些图像的地方:

特别有趣的是我没有使用Docker插件进行任何构建步骤,我只是使用Docker插件为构建Jenkins项配置一个Slave容器:

我唯一的构建步骤是执行Shell脚本,是的,这个脚本最终构建了一个Docker镜像,但Docker插件不会知道这个:

Docker插件旋转了Docker Slave Containers,我配置了Docker插件并告诉它一个Docker主机(在我的情况下我的金属)一个Cloud是Docker插件调用Docker主机以及Docker从属映像在Docker主机上使用/云:


我是否只是误解了Jenkins在Docker从属容器内部构建工作空间时的孤立程度?

Docker插件是否只是默认使用了唯一的Docker Cloud(我的Docker主机金属)我为所有任何docker命令设置了我碰巧在Jenkins Docker从属容器内运行? (通过安装Docker-CE的方式的从属容器)

我的jenkins大师Dockerfile:

#reference#https://engineering.riotgames.com/news/putting-jenkins-docker-containerFROM jenkins:2.60.1MAINTAINER Brian OgdenUSER root#TimezoneENV TZ=America/Los_AngelesRUN ln -snf /usr/share/zoneinfo/$TZ /etc/localtime && echo $TZ > /etc/timezone# Prep Jenkins DirectorIEsRUN mkdir /var/log/jenkinsRUN mkdir /var/cache/jenkinsRUN chown -R jenkins:jenkins /var/log/jenkinsRUN chown -R jenkins:jenkins /var/cache/jenkins# copy in local config filesfilescopY plugins.sh /usr/local/bin/plugins.shRUN chmod +x /usr/local/bin/plugins.sh# Install default plugins# Set List of plugins to download / update in plugins.txt like this# pluginID:version# credentials:1.18# maven-plugin:2.7.1# ...# NOTE : Just set pluginID to download latest version of plugin.# NOTE : All plugins need to be Listed as there is no transitive dependency resolution.copY plugins.txt /tmp/plugins.txtRUN /usr/local/bin/plugins.sh /tmp/plugins.txtUSER jenkins#give Jenkins a nice 8 GB memory pool and room to handle garbage collection#ENV JAVA_OPTS="-Xmx8192m"#give Jenkins a nice base pool of handlers and a cap#ENV JENKINS_OPTS="--handlerCountStartup=100 --handlerCountMax=300"ENV JENKINS_OPTS="--logfile=/var/log/jenkins/jenkins.log --webroot=/var/cache/jenkins/war"

我使用docker-compose和Docker卷与我的Jenkins Master,我的docker-compose.yml:

version: '2'services:  data:    build: data    image: tsl.devops.jenkins.data.image    container_name: tsl.devops.jenkins.data.container  master:    build: master    image: tsl.devops.jenkins.master.image    container_name: tsl.devops.jenkins.master.container    volumes_from:      - data    ports:      - "50000:50000"    #network_mode: "host"  Nginx:    build: Nginx    image: tsl.devops.jenkins.Nginx.image    container_name: tsl.devops.jenkins.Nginx.container    ports:      - "80:80"    links:      - master:jenkins-master  slavebasic:    build:      context: ./slaves      dockerfile: basic/Dockerfile    image: tsl.devops.jenkins.slave.basic.image    container_name: tsl.devops.jenkins.slave.basic.container  slavedotnetcore:    build:      context: ./slaves      dockerfile: dotnetcore/Dockerfile    image: tsl.devops.jenkins.slave.dotnetcore.image    container_name: tsl.devops.jenkins.slave.dotnetcore.container

我的Jenkins Master卷/驱动器Dockerfile:

#reference#https://engineering.riotgames.com/news/docker-jenkins-data-persistsFROM centos:7MAINTAINER Brian Ogden#create the Jenkins user in this containerRUN useradd -d "/var/jenkins_home" -u 1000 -m -s /bin/bash jenkins#NOTE: we set the UID here to the same one the Cloudbees Jenkins image uses #so we can match UIDs across containers,which is essential if you want #to preserve file permissions between the containers. We also use the same home directory and bash settings.#Jenkins log directoryRUN mkdir -p /var/log/jenkinsRUN chown -R jenkins:jenkins /var/log/jenkins#Docker volume magicVolUME ["/var/log/jenkins","/var/jenkins_home"]USER jenkins#just a little output reminder of the container's purposeCMD ["echo","Data container for Jenkins"]

我的奴隶Dockerfile:

FROM centos:7MAINTAINER Brian Ogden#the USER will be root by default just explicitly #expressing it for better documentationUSER root# Install EssentialsRUN yum update -y && \         yum clean all############################################## Jenkins Slave setup#############################################RUN yum install -y \    git \    wget \    openssh-server \    java-1.8.0-openjdk \    sudo \    make && \    yum clean all# gen dummy keys,centos doesn't autogen them like ubuntu doesRUN /usr/bin/ssh-keygen -A# Set SSH Configuration to allow remote logins without /proc write accessRUN sed -ri 's/^session\s+required\s+pam_loginuID.so$/session optional pam_loginuID.so/' /etc/pam.d/sshd# Create Jenkins UserRUN useradd jenkins -m -s /bin/bash# Add public key for Jenkins loginRUN mkdir /home/jenkins/.sshcopY /files/ID_rsa.pub /home/jenkins/.ssh/authorized_keys#setup permissions for the new folders and filesRUN chown -R jenkins /home/jenkinsRUN chgrp -R jenkins /home/jenkinsRUN chmod 600 /home/jenkins/.ssh/authorized_keysRUN chmod 700 /home/jenkins/.ssh# Add the jenkins user to sudoersRUN echo "jenkins  ALL=(ALL)  ALL" >> etc/sudoers########################################################################################### Docker and Docker Compose Install##############################################install required packagesRUN yum install -y \    yum-utils \    device-mapper-persistent-data \    lvm2 \    curl && \    yum clean all#add Docker CE stable repositoryRUN yum-config-manager \    --add-repo \    https://download.docker.com/linux/centos/docker-ce.repo#Update the yum package index.RUN yum makecache fast#install Docker CERUN yum install -y docker-ce-17.06.0.ce-1.el7.centos#install Docker Compose 1.14.0#download Docker Compose binary from github repoRUN curl -L https://github.com/docker/compose/releases/download/1.14.0/docker-compose-`uname -s`-`uname -m` > /usr/local/bin/docker-compose#Apply executable permissions to the binaryRUN chmod +x /usr/local/bin/docker-compose########################################################################################### .NET Core SDK#############################################RUN yum install -y \    @R_898_4035@ \    libicuRUN curl -sSL -o dotnet.tar.gz https://go.microsoft.com/fwlink/?linkID=848821RUN mkdir -p /opt/dotnet && tar zxf dotnet.tar.gz -C /opt/dotnetRUN ln -s /opt/dotnet/dotnet /usr/local/bin#add Trade Service Nuget ServerRUN mkdir -p /home/jenkins/.nuget/NuGetcopY /files/NuGet.Config /home/jenkins/.nuget/NuGet/NuGet.ConfigRUN chown -R jenkins /home/jenkins/.nugetRUN chgrp -R jenkins /home/jenkins/.nugetRUN chmod 600 /home/jenkins/.nuget/NuGet/NuGet.ConfigRUN chmod 700 /home/jenkins/.nuget/NuGet#speed up dotnet core buildsENV NUGET_XMLDOC_MODE skipENV DOTNET_SKIP_FirsT_TIME_EXPERIENCE true############################################## Expose SSH port and run SSHDEXPOSE 22#Technically,the Docker Plugin enforces this call when it starts containers by overrIDing the entry command. #I place this here because I want this build slave to run locally as it would if it was started in the build farm.CMD ["/usr/sbin/sshd","-D"]

一个示例软件/组件Dockerfile,它将在Jenkins Slave Docker容器中创建一个Docker镜像构建工件:

FROM centos:7MAINTAINER Brian Ogden#TimezoneENV TZ=America/Los_AngelesRUN ln -snf /usr/share/zoneinfo/$TZ /etc/localtime && echo $TZ > /etc/timezoneRUN yum update -y && \         yum clean all############################################## .NET Core SDK#############################################RUN yum install -y \    @R_898_4035@ \    libicuRUN curl -sSL -o dotnet.tar.gz https://go.microsoft.com/fwlink/?linkID=848821RUN mkdir -p /opt/dotnet && tar zxf dotnet.tar.gz -C /opt/dotnetRUN ln -s /opt/dotnet/dotnet /usr/local/bin#speed up dotnet core buildsENV NUGET_XMLDOC_MODE skipENV DOTNET_SKIP_FirsT_TIME_EXPERIENCE true########################################################################################### .NET Sevrice setup#############################################ARG ASPNETCORE_ENVIRONMENT# copy our code from the "/src/MyWebAPI/bin/DeBUG/netcoreapp1.1/publish" folder to the "/app" folder in our containerworkdir /appcopY ./src/TSL.Security.Service/bin/DeBUG/netcoreapp1.1/publish .# Expose port 5000 for the Web API trafficENV ASPNETCORE_URLS http://+:5000ENV ASPNETCORE_ENVIRONMENT $ASPNETCORE_ENVIRONMENT EXPOSE 5000# Run the dotnet application against a DLL from within the container# Don't forget to publish your application or this won't workENTRYPOINT ["dotnet","TSL.Security.Service.dll"]#############################################
解决方法 根据您的Docker插件配置,您使用172.17.0.1作为Docker主机.从slave或master容器,这将是在主机上运行的Docker守护程序(Docker中没有Docker发生在这里).当您的Jenkins从站构建映像时(无论从站是作为容器运行还是在主机上运行),它正在使用主机上的Docker,这就是您的映像显示在主机上的原因.

值得注意的是,数据可能首先进入奴隶使用的Docker卷(根据Jenkins Dockefile在https://github.com/jenkinsci/docker/blob/9f29488b77c2005bbbc5c936d47e697689f8ef6e/Dockerfile,默认为/ var / jenkins_home).在您的情况下,这只是来自数据服务的卷(但是,在Compose v2格式中,您只需定义命名卷,您不需要创建数据容器).从这里开始,您的代码和Dockerfile将通过tcp://172.17.0.1:4243上的API发送到主机上的Docker构建上下文.

总结

以上是内存溢出为你收集整理的linux – 与Jenkins Docker插件和Jenkins Docker Slaves混淆全部内容,希望文章能够帮你解决linux – 与Jenkins Docker插件和Jenkins Docker Slaves混淆所遇到的程序开发问题。

如果觉得内存溢出网站内容还不错,欢迎将内存溢出网站推荐给程序员好友。

欢迎分享,转载请注明来源:内存溢出

原文地址: http://outofmemory.cn/yw/1040378.html

(0)
打赏 微信扫一扫 微信扫一扫 支付宝扫一扫 支付宝扫一扫
上一篇 2022-05-24
下一篇 2022-05-24

发表评论

登录后才能评论

评论列表(0条)

保存