Python Requests Library

2019/12/29 | python | Zhiming Zhang | 暂无评论 | 278 views

Requests requests模块是python中帮我们模拟http请求的基本模块，我们通过python代码来完成http 所有的请求我们这篇文章中会从最基本的使用方法开始，逐步介绍如下内容如何使用request模块完成普通的http 请求如何修改HTTP请求的 headers 和 data模块分析HTTP的request及r……

curl 入门

2019/12/28 | 基本知识 | Zhiming Zhang | 暂无评论 | 287 views

curl是一个可以在命令行下来发起http请求的，简单来说，就是命令行下模拟浏览器发起Http请求我们看一下常用的curl例子：获取网页内容：

curl https://503error.com

1	curl https://503error.com

强制解析域名：

curl --resolve www.example.org:80:127.0.0.1 <a href="http://www.example.org/">http://www.example.org/</a>

1	curl --resolve www.example.org:80:127.0.0.1 <a href="http://www.example.org/">http://www.example.org/</a>

访问指定端口： [crayon-5ecf72……

logrotate 入门

2019/12/27 | 运维 | Zhiming Zhang | 暂无评论 | 308 views

Introduction简介 Logrotate 是一个用来管理日志文件的工具，可以帮我们自动压缩日志，清理日志，让我们的磁盘不至于爆满一般情况下linux系统都预装了这个日志管理工具，如果是二般的情况就先手动安装一下吧 Logrotate Configuration 配置文件 Ubuntu下我们可以在如下两个地方找到所有的与logro……

docker 端口绑定到ipv6 导致ipv4请求无法转发

2019/12/14 | Docker | Zhiming Zhang | 暂无评论 | 1130 views

核心的原因， docker 对与ipv6默认是没有打开forwarding 设置的首先官方的介绍：在默认的配置中，流量的端口转发分为两种：内部流量转发(本机)，外部流量转发（跨机器）举个例子：

# docker run -d -p 80:80 nginx

1	# docker run -d -p 80:80 nginx

这个操作会在iptables中增加如下策略（是的，docker所有的端口转……

Helm 文档能好好测测再写么

2019/12/12 | 运维 | Zhiming Zhang | 暂无评论 | 331 views

今天看文档，Helm的文档写的真的是不敢恭维啊 https://helm.sh/docs/intro/quickstart/ https://helm.sh/docs/intro/install/ 首先第一个问题： mac os 安装：

brew install helm

1	brew install helm

需要修改为： [cra……

通过crontab来执行ansible-playbook 自动加载ssh-key的问题

2019/12/09 | Ansible 入门 | Zhiming Zhang | 暂无评论 | 704 views

有时候我们的ansible-playbook我们希望定时执行以确保线上环境的状态，例如，每天定时执行一次，保证nginx的配置文件是最新的这个时候，我们就要面临一个问题，如何让ansible-playbook使用指定的key来执行,例如

*/1 * * * * /home/ansible/ansible-playbook test.yml

1	/1 * * * /home/ansible/ansible-playbook test.yml

ansible是无法自动加载.s……

ansible set_fact loop 仅保留最后一个值的问题

2019/12/03 | Ansible 入门,ansible实战 | Zhiming Zhang | 暂无评论 | 589 views

ansible 中set_fact 支持循环，with_items，但是变量并不是append 例如：第一个set_fact部分用的是with_items，但是，我们打印的结果中只有最后一次循环中的赋值

---
#source your credential first： export AWS_PROFILE=poc
#confirm the origin host have the iam role setting , security group setting
#copy the userdata into the j2 file and make necessary change
#ansible-playbook create_new_instance_from_old_one.yml -e "origin_host_id=i-095ea1e9b5ea236b0" -e "region=us-east-1" -e "new_host_name=jeremy-test-playbook-instance11"
- name: test set fact with
  hosts: localhost
  vars:
    security_group_new_append: []
    security_group_dict:
      - group_id: "groupid_abc_1"
        group_name: "Name_1"
      - group_id: "groupid_abc_2"
        group_name: "Name_2"
      - group_id: "groupid_abc_3"
        group_name: "Name_3"

  tasks:

  - name: this is a test
    debug:
      msg: "this is the test message from localhost"

  - name: set fact
    set_fact:
      security_group_new: "{{ item.group_name }}"
    with_items: "{{ security_group_dict  }}"

  - name : show me the security_group_new
    debug:
      var: security_group_new

  - name: set fact
    set_fact:
      security_group_new_append: "{{ security_group_new_append + [item.group_name] }}"
    with_items: "{{ security_group_dict  }}"

  - name : show me the security_group_new
    debug:
      var: security_group_new_append

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

---

#source your credential first： export AWS_PROFILE=poc

#confirm the origin host have the iam role setting , security group setting

#copy the userdata into the j2 file and make necessary change

#ansible-playbook create_new_instance_from_old_one.yml -e "origin_host_id=i-095ea1e9b5ea236b0" -e "region=us-east-1" -e "new_host_name=jeremy-test-playbook-instance11"

- name: test set fact with

hosts: localhost

vars:

security_group_new_append: []

security_group_dict:

- group_id: "groupid_abc_1"

group_name: "Name_1"

- group_id: "groupid_abc_2"

group_name: "Name_2"

- group_id: "groupid_abc_3"

group_name: "Name_3"

tasks:

- name: this is a test

debug:

msg: "this is the test message from localhost"

- name: set fact

set_fact:

security_group_new: "{{ item.group_name }}"

with_items: "{{ security_group_dict }}"

- name : show me the security_group_new

debug:

var: security_group_new

- name: set fact

set_fact:

security_group_new_append: "{{ security_group_new_append + [item.group_name] }}"

with_items: "{{ security_group_dict }}"

- name : show me the security_group_new

debug:

var: security_group_new_append

但是如果我们使用第二个task ，就可以在输出结果中打印……

ansible filter (编写你自己的ansible filter) 置顶

2019/12/02 | Ansible 入门,ansible实战 | Zhiming Zhang | 暂无评论 | 613 views

有时候我们写自己的playbook的时候变量处理真的是特别让人头大，有些变量的操作在python中就很简单，但是放到ansible playbook中就会很麻烦，所以，我们今天来看一下如何编写自己的ansible filter来帮助我们处理一下变量直接看例子吧：

#!/usr/bin/python
class FilterModule(object):
    def filters(self):
        return {
            'a_filter': self.a_filter,
            'another_filter': self.b_filter
        }

    def a_filter(self, a_variable):
        a_new_variable = a_variable + ' CRAZY NEW FILTER'
        return a_new_variable

1

2

3

4

5

6

7

8

9

10

11

#!/usr/bin/python

class FilterModule(object):

def filters(self):

return {

'a_filter': self.a_filter,

'another_filter': self.b_filter

}

def a_filter(self, a_variable):

a_new_variable = a_variable + ' CRAZY NEW FILTER'

return a_new_variable

我们来分……

molecule 进阶编写完整的测试代码

2019/11/29 | 运维 | Zhiming Zhang | 暂无评论 | 314 views

molecule 需要我们额外编写对应ansible role的测试代码，通过一个例子来说明具体的使用方法创建一个空的role

$ molecule init role -r ansible-apache -d docker
--> Initializing new role ansible-apache...
Initialized role in /Users/jeremyzhang/git/hack/molecule_example/ansible-apache successfully.

$tree ansible-apache
ansible-apache
├── README.md
├── defaults
│   └── main.yml
├── handlers
│   └── main.yml
├── meta
│   └── main.yml
├── molecule
│   └── default
│       ├── Dockerfile.j2
│       ├── INSTALL.rst
│       ├── molecule.yml
│       ├── playbook.yml
│       └── tests
│           ├── test_default.py
│           └── test_default.pyc
├── tasks
│   └── main.yml
└── vars
    └── main.yml

8 directories, 12 files

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

$ molecule init role -r ansible-apache -d docker

--> Initializing new role ansible-apache...

Initialized role in /Users/jeremyzhang/git/hack/molecule_example/ansible-apache successfully.

$tree ansible-apache

ansible-apache

├── README.md

├── defaults

│ └── main.yml

├── handlers

│ └── main.yml

├── meta

│ └── main.yml

├── molecule

│ └── default

│ ├── Dockerfile.j2

│ ├── INSTALL.rst

│ ├── molecule.yml

│ ├── playbook.yml

│ └── tests

│ ├── test_default.py

│ └── test_default.pyc

├── tasks

│ └── main.yml

└── vars

└── main.yml

8 directories, 12 files

我们来编写具体的role的逻辑处理部分

cat tasks/main.yml
---
# tasks file for ansible-apache
- name: "Ensure required packages are present"
  yum:
    name: "{{ pkg_list }}"
    state: present

- name: "Ensure latest index.html is present"
  template:
    src: index.html.j2
    dest: /var/www/html/index.html

- name: "Ensure httpd service is started and enabled"
  service:
    name: "{{ item }}"
    state: started
    enabled: true
  with_items: "{{ svc_list }}"

- name: "Whitelist http in firewalld"
  firewalld:
    service: http
    state: enabled
    permanent: true
    immediate: true

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

cat tasks/main.yml

---

# tasks file for ansible-apache

- name: "Ensure required packages are present"

yum:

name: "{{ pkg_list }}"

state: present

- name: "Ensure latest index.html is present"

template:

src: index.html.j2

dest: /var/www/html/index.html

- name: "Ensure httpd service is started and enabled"

service:

name: "{{ item }}"

state: started

enabled: true

with_items: "{{ svc_list }}"

- name: "Whitelist http in firewalld"

firewalld:

service: http

state: enabled

permanent: true

immediate: true

这个playbook book主要有4……

molecule简介

2019/11/27 | 运维 | Zhiming Zhang | 暂无评论 | 508 views

因为工作中要用到molecule作为ansible role的测试工具，之前没有使用过，正好整理一下相关的资料首先，什么是molecule？ molecule是一个专为ansible role 编写及测试的一个便捷工具，它可以帮我们生成必要的代码，必要的文件安装：以mac为例： [crayon-5ecf72c70b403927470……