Python、Numpy 教程

我们将在本课程的所有作业中使用Python编程语言。Python本身就是一种伟大的通用编程语言,并且它在一些其他流行的Python库(numpy、sciy、matplotlib)的帮助下,它成为了一个强大的科学计算环境。

我们希望你们中大部分人会有一点Python和numpy的使用经验;因为对于大部分人来说,本节将作为关于Python编程语言和使用Python进行科学计算的快速速成课程。

你们中的一些人可能以前学过Matlab接触过相关的知识,如果是这样的话,我推荐你们看一下这篇文章:Numpy对于Matlab用户

你还可以在 这里找到Volodymyr KuleshovIsaac CaswellCS 228 创建的本教程的IPython笔记版本。

目录

Python

Python是一种高级动态类型的多范式编程语言。Python代码通常被称为可运行的伪代码,因为它允许你在非常少的代码行中表达非常强大的想法,同时具有非常可读性。作为示例,这里是Python中经典快速排序算法的实现:

  1. def quicksort(arr):
  2. if len(arr) <= 1:
  3. return arr
  4. pivot = arr[len(arr) // 2]
  5. left = [x for x in arr if x < pivot]
  6. middle = [x for x in arr if x == pivot]
  7. right = [x for x in arr if x > pivot]
  8. return quicksort(left) + middle + quicksort(right)
  9. print(quicksort([3,6,8,10,1,2,1]))
  10. # Prints "[1, 1, 2, 3, 6, 8, 10]"

Python 的版本

目前有两种不同的受支持版本的Python,分别是2.7和3.5。有点令人困惑的是,Python 3.0引入了许多向后兼容的语言更改,因此为2.7编写的代码可能无法在3.5下运行,反之亦然。所以我们下面所有的示例的代码都使用Python 3.5来编程。

你可以通过运行 python -version 在命令行中查看Python的版本。

基本数据类型

与大多数语言一样,Python有许多基本类型,包括整数,浮点数,布尔值和字符串。这些数据类型的行为方式与其他编程语言相似。

Numbers(数字类型):代表的是整数和浮点数,它原理与其他语言相同:

  1. x = 3
  2. print(type(x)) # Prints "<class 'int'>"
  3. print(x) # Prints "3"
  4. print(x + 1) # Addition; prints "4"
  5. print(x - 1) # Subtraction; prints "2"
  6. print(x * 2) # Multiplication; prints "6"
  7. print(x ** 2) # Exponentiation; prints "9"
  8. x += 1
  9. print(x) # Prints "4"
  10. x *= 2
  11. print(x) # Prints "8"
  12. y = 2.5
  13. print(type(y)) # Prints "<class 'float'>"
  14. print(y, y + 1, y * 2, y ** 2) # Prints "2.5 3.5 5.0 6.25"

注意,与许多语言不同,Python没有一元增量(x+)或递减(x-)运算符。

Python还有用于复数的内置类型;你可以在这篇文档中找到所有的详细信息。

Booleans(布尔类型): Python实现了所有常用的布尔逻辑运算符,但它使用的是英文单词而不是符号 (&&, ||, etc.):

  1. t = True
  2. f = False
  3. print(type(t)) # Prints "<class 'bool'>"
  4. print(t and f) # Logical AND; prints "False"
  5. print(t or f) # Logical OR; prints "True"
  6. print(not t) # Logical NOT; prints "False"
  7. print(t != f) # Logical XOR; prints "True"

Strings(字符串类型):Python对字符串有很好的支持:

  1. hello = 'hello' # String literals can use single quotes
  2. world = "world" # or double quotes; it does not matter.
  3. print(hello) # Prints "hello"
  4. print(len(hello)) # String length; prints "5"
  5. hw = hello + ' ' + world # String concatenation
  6. print(hw) # prints "hello world"
  7. hw12 = '%s %s %d' % (hello, world, 12) # sprintf style string formatting
  8. print(hw12) # prints "hello world 12"

String对象有许多有用的方法;例如:

  1. s = "hello"
  2. print(s.capitalize()) # Capitalize a string; prints "Hello"
  3. print(s.upper()) # Convert a string to uppercase; prints "HELLO"
  4. print(s.rjust(7)) # Right-justify a string, padding with spaces; prints " hello"
  5. print(s.center(7)) # Center a string, padding with spaces; prints " hello "
  6. print(s.replace('l', '(ell)')) # Replace all instances of one substring with another;
  7. # prints "he(ell)(ell)o"
  8. print(' world '.strip()) # Strip leading and trailing whitespace; prints "world"

你可以在这篇文档中找到所有String方法的列表。

容器(Containers)

Python包含几种内置的容器类型:列表、字典、集合和元组。

列表(Lists)

列表其实就是Python中的数组,但是可以它可以动态的调整大小并且可以包含不同类型的元素:

  1. xs = [3, 1, 2] # Create a list
  2. print(xs, xs[2]) # Prints "[3, 1, 2] 2"
  3. print(xs[-1]) # Negative indices count from the end of the list; prints "2"
  4. xs[2] = 'foo' # Lists can contain elements of different types
  5. print(xs) # Prints "[3, 1, 'foo']"
  6. xs.append('bar') # Add a new element to the end of the list
  7. print(xs) # Prints "[3, 1, 'foo', 'bar']"
  8. x = xs.pop() # Remove and return the last element of the list
  9. print(x, xs) # Prints "bar [3, 1, 'foo']"

像往常一样,你可以在这篇文档中找到有关列表的所有详细信息。

切片(Slicing): 除了一次访问一个列表元素之外,Python还提供了访问子列表的简明语法; 这被称为切片:

  1. nums = list(range(5)) # range is a built-in function that creates a list of integers
  2. print(nums) # Prints "[0, 1, 2, 3, 4]"
  3. print(nums[2:4]) # Get a slice from index 2 to 4 (exclusive); prints "[2, 3]"
  4. print(nums[2:]) # Get a slice from index 2 to the end; prints "[2, 3, 4]"
  5. print(nums[:2]) # Get a slice from the start to index 2 (exclusive); prints "[0, 1]"
  6. print(nums[:]) # Get a slice of the whole list; prints "[0, 1, 2, 3, 4]"
  7. print(nums[:-1]) # Slice indices can be negative; prints "[0, 1, 2, 3]"
  8. nums[2:4] = [8, 9] # Assign a new sublist to a slice
  9. print(nums) # Prints "[0, 1, 8, 9, 4]"

我们将在numpy数组的上下文中再次看到切片。

(循环)Loops: 你可以循环遍历列表的元素,如下所示:

  1. animals = ['cat', 'dog', 'monkey']
  2. for animal in animals:
  3. print(animal)
  4. # Prints "cat", "dog", "monkey", each on its own line.

如果要访问循环体内每个元素的索引,请使用内置的 enumerate 函数:

  1. animals = ['cat', 'dog', 'monkey']
  2. for idx, animal in enumerate(animals):
  3. print('#%d: %s' % (idx + 1, animal))
  4. # Prints "#1: cat", "#2: dog", "#3: monkey", each on its own line

列表推导式(List comprehensions): 编程时,我们经常想要将一种数据转换为另一种数据。 举个简单的例子,思考以下计算平方数的代码:

  1. nums = [0, 1, 2, 3, 4]
  2. squares = []
  3. for x in nums:
  4. squares.append(x ** 2)
  5. print(squares) # Prints [0, 1, 4, 9, 16]

你可以使用 列表推导式 使这段代码更简单:

  1. nums = [0, 1, 2, 3, 4]
  2. squares = [x ** 2 for x in nums]
  3. print(squares) # Prints [0, 1, 4, 9, 16]

列表推导还可以包含条件:

  1. nums = [0, 1, 2, 3, 4]
  2. even_squares = [x ** 2 for x in nums if x % 2 == 0]
  3. print(even_squares) # Prints "[0, 4, 16]"

字典

字典存储(键,值)对,类似于Java中的Map或Javascript中的对象。你可以像这样使用它:

  1. d = {'cat': 'cute', 'dog': 'furry'} # Create a new dictionary with some data
  2. print(d['cat']) # Get an entry from a dictionary; prints "cute"
  3. print('cat' in d) # Check if a dictionary has a given key; prints "True"
  4. d['fish'] = 'wet' # Set an entry in a dictionary
  5. print(d['fish']) # Prints "wet"
  6. # print(d['monkey']) # KeyError: 'monkey' not a key of d
  7. print(d.get('monkey', 'N/A')) # Get an element with a default; prints "N/A"
  8. print(d.get('fish', 'N/A')) # Get an element with a default; prints "wet"
  9. del d['fish'] # Remove an element from a dictionary
  10. print(d.get('fish', 'N/A')) # "fish" is no longer a key; prints "N/A"

你可以在这篇文档中找到有关字典的所有信息。

(循环)Loops: 迭代词典中的键很容易:

  1. d = {'person': 2, 'cat': 4, 'spider': 8}
  2. for animal in d:
  3. legs = d[animal]
  4. print('A %s has %d legs' % (animal, legs))
  5. # Prints "A person has 2 legs", "A cat has 4 legs", "A spider has 8 legs"

如果要访问键及其对应的值,请使用items方法:

  1. d = {'person': 2, 'cat': 4, 'spider': 8}
  2. for animal, legs in d.items():
  3. print('A %s has %d legs' % (animal, legs))
  4. # Prints "A person has 2 legs", "A cat has 4 legs", "A spider has 8 legs"

字典推导式(Dictionary comprehensions): 类似于列表推导式,可以让你轻松构建词典数据类型。例如:

  1. nums = [0, 1, 2, 3, 4]
  2. even_num_to_square = {x: x ** 2 for x in nums if x % 2 == 0}
  3. print(even_num_to_square) # Prints "{0: 0, 2: 4, 4: 16}"

集合(Sets)

集合是不同元素的无序集合。举个简单的例子,请思考下面的代码:

  1. animals = {'cat', 'dog'}
  2. print('cat' in animals) # Check if an element is in a set; prints "True"
  3. print('fish' in animals) # prints "False"
  4. animals.add('fish') # Add an element to a set
  5. print('fish' in animals) # Prints "True"
  6. print(len(animals)) # Number of elements in a set; prints "3"
  7. animals.add('cat') # Adding an element that is already in the set does nothing
  8. print(len(animals)) # Prints "3"
  9. animals.remove('cat') # Remove an element from a set
  10. print(len(animals)) # Prints "2"

与往常一样,你想知道的关于集合的所有内容都可以在这篇文档中找到。

循环(Loops): 遍历集合的语法与遍历列表的语法相同;但是,由于集合是无序的,因此不能假设访问集合元素的顺序:

  1. animals = {'cat', 'dog', 'fish'}
  2. for idx, animal in enumerate(animals):
  3. print('#%d: %s' % (idx + 1, animal))
  4. # Prints "#1: fish", "#2: dog", "#3: cat"

集合推导式(Set comprehensions): 就像列表和字典一样,我们可以很容易地使用集合理解来构造集合:

  1. from math import sqrt
  2. nums = {int(sqrt(x)) for x in range(30)}
  3. print(nums) # Prints "{0, 1, 2, 3, 4, 5}"

元组(Tuples)

元组是(不可变的)有序值列表。 元组在很多方面类似于列表; 其中一个最重要的区别是元组可以用作字典中的键和集合的元素,而列表则不能。 这是一个简单的例子:

  1. d = {(x, x + 1): x for x in range(10)} # Create a dictionary with tuple keys
  2. t = (5, 6) # Create a tuple
  3. print(type(t)) # Prints "<class 'tuple'>"
  4. print(d[t]) # Prints "5"
  5. print(d[(1, 2)]) # Prints "1"

这篇文档包含有关元组的更多信息。

函数(Functions)

Python函数使用def关键字定义。例如:

  1. def sign(x):
  2. if x > 0:
  3. return 'positive'
  4. elif x < 0:
  5. return 'negative'
  6. else:
  7. return 'zero'
  8. for x in [-1, 0, 1]:
  9. print(sign(x))
  10. # Prints "negative", "zero", "positive"

我们经常定义函数来获取可选的关键字参数,如下所示:

  1. def hello(name, loud=False):
  2. if loud:
  3. print('HELLO, %s!' % name.upper())
  4. else:
  5. print('Hello, %s' % name)
  6. hello('Bob') # Prints "Hello, Bob"
  7. hello('Fred', loud=True) # Prints "HELLO, FRED!"

这篇文档中有更多关于Python函数的信息。

类(Classes)

在Python中定义类的语法很简单:

  1. class Greeter(object):
  2. # Constructor
  3. def __init__(self, name):
  4. self.name = name # Create an instance variable
  5. # Instance method
  6. def greet(self, loud=False):
  7. if loud:
  8. print('HELLO, %s!' % self.name.upper())
  9. else:
  10. print('Hello, %s' % self.name)
  11. g = Greeter('Fred') # Construct an instance of the Greeter class
  12. g.greet() # Call an instance method; prints "Hello, Fred"
  13. g.greet(loud=True) # Call an instance method; prints "HELLO, FRED!"

你可以在这篇文档中阅读更多关于Python类的内容。

Numpy

Numpy是Python中科学计算的核心库。它提供了一个高性能的多维数组对象,以及用于处理这些数组的工具。如果你已经熟悉MATLAB,你可能会发现这篇教程对于你从MATLAB切换到学习Numpy很有帮助。

数组(Arrays)

numpy数组是一个值网格,所有类型都相同,并由非负整数元组索引。 维数是数组的排名; 数组的形状是一个整数元组,给出了每个维度的数组大小。

我们可以从嵌套的Python列表初始化numpy数组,并使用方括号访问元素:

  1. import numpy as np
  2. a = np.array([1, 2, 3]) # Create a rank 1 array
  3. print(type(a)) # Prints "<class 'numpy.ndarray'>"
  4. print(a.shape) # Prints "(3,)"
  5. print(a[0], a[1], a[2]) # Prints "1 2 3"
  6. a[0] = 5 # Change an element of the array
  7. print(a) # Prints "[5, 2, 3]"
  8. b = np.array([[1,2,3],[4,5,6]]) # Create a rank 2 array
  9. print(b.shape) # Prints "(2, 3)"
  10. print(b[0, 0], b[0, 1], b[1, 0]) # Prints "1 2 4"

Numpy还提供了许多创建数组的函数:

  1. import numpy as np
  2. a = np.zeros((2,2)) # Create an array of all zeros
  3. print(a) # Prints "[[ 0. 0.]
  4. # [ 0. 0.]]"
  5. b = np.ones((1,2)) # Create an array of all ones
  6. print(b) # Prints "[[ 1. 1.]]"
  7. c = np.full((2,2), 7) # Create a constant array
  8. print(c) # Prints "[[ 7. 7.]
  9. # [ 7. 7.]]"
  10. d = np.eye(2) # Create a 2x2 identity matrix
  11. print(d) # Prints "[[ 1. 0.]
  12. # [ 0. 1.]]"
  13. e = np.random.random((2,2)) # Create an array filled with random values
  14. print(e) # Might print "[[ 0.91940167 0.08143941]
  15. # [ 0.68744134 0.87236687]]"

你可以在这篇文档中阅读有关其他数组创建方法的信息。

数组索引

Numpy提供了几种索引数组的方法。

切片(Slicing): 与Python列表类似,可以对numpy数组进行切片。由于数组可能是多维的,因此必须为数组的每个维指定一个切片:

  1. import numpy as np
  2. # Create the following rank 2 array with shape (3, 4)
  3. # [[ 1 2 3 4]
  4. # [ 5 6 7 8]
  5. # [ 9 10 11 12]]
  6. a = np.array([[1,2,3,4], [5,6,7,8], [9,10,11,12]])
  7. # Use slicing to pull out the subarray consisting of the first 2 rows
  8. # and columns 1 and 2; b is the following array of shape (2, 2):
  9. # [[2 3]
  10. # [6 7]]
  11. b = a[:2, 1:3]
  12. # A slice of an array is a view into the same data, so modifying it
  13. # will modify the original array.
  14. print(a[0, 1]) # Prints "2"
  15. b[0, 0] = 77 # b[0, 0] is the same piece of data as a[0, 1]
  16. print(a[0, 1]) # Prints "77"

你还可以将整数索引与切片索引混合使用。 但是,这样做会产生比原始数组更低级别的数组。 请注意,这与MATLAB处理数组切片的方式完全不同:

  1. import numpy as np
  2. # Create the following rank 2 array with shape (3, 4)
  3. # [[ 1 2 3 4]
  4. # [ 5 6 7 8]
  5. # [ 9 10 11 12]]
  6. a = np.array([[1,2,3,4], [5,6,7,8], [9,10,11,12]])
  7. # Two ways of accessing the data in the middle row of the array.
  8. # Mixing integer indexing with slices yields an array of lower rank,
  9. # while using only slices yields an array of the same rank as the
  10. # original array:
  11. row_r1 = a[1, :] # Rank 1 view of the second row of a
  12. row_r2 = a[1:2, :] # Rank 2 view of the second row of a
  13. print(row_r1, row_r1.shape) # Prints "[5 6 7 8] (4,)"
  14. print(row_r2, row_r2.shape) # Prints "[[5 6 7 8]] (1, 4)"
  15. # We can make the same distinction when accessing columns of an array:
  16. col_r1 = a[:, 1]
  17. col_r2 = a[:, 1:2]
  18. print(col_r1, col_r1.shape) # Prints "[ 2 6 10] (3,)"
  19. print(col_r2, col_r2.shape) # Prints "[[ 2]
  20. # [ 6]
  21. # [10]] (3, 1)"

整数数组索引: 使用切片索引到numpy数组时,生成的数组视图将始终是原始数组的子数组。 相反,整数数组索引允许你使用另一个数组中的数据构造任意数组。 这是一个例子:

  1. import numpy as np
  2. a = np.array([[1,2], [3, 4], [5, 6]])
  3. # An example of integer array indexing.
  4. # The returned array will have shape (3,) and
  5. print(a[[0, 1, 2], [0, 1, 0]]) # Prints "[1 4 5]"
  6. # The above example of integer array indexing is equivalent to this:
  7. print(np.array([a[0, 0], a[1, 1], a[2, 0]])) # Prints "[1 4 5]"
  8. # When using integer array indexing, you can reuse the same
  9. # element from the source array:
  10. print(a[[0, 0], [1, 1]]) # Prints "[2 2]"
  11. # Equivalent to the previous integer array indexing example
  12. print(np.array([a[0, 1], a[0, 1]])) # Prints "[2 2]"

整数数组索引的一个有用技巧是从矩阵的每一行中选择或改变一个元素:

  1. import numpy as np
  2. # Create a new array from which we will select elements
  3. a = np.array([[1,2,3], [4,5,6], [7,8,9], [10, 11, 12]])
  4. print(a) # prints "array([[ 1, 2, 3],
  5. # [ 4, 5, 6],
  6. # [ 7, 8, 9],
  7. # [10, 11, 12]])"
  8. # Create an array of indices
  9. b = np.array([0, 2, 0, 1])
  10. # Select one element from each row of a using the indices in b
  11. print(a[np.arange(4), b]) # Prints "[ 1 6 7 11]"
  12. # Mutate one element from each row of a using the indices in b
  13. a[np.arange(4), b] += 10
  14. print(a) # prints "array([[11, 2, 3],
  15. # [ 4, 5, 16],
  16. # [17, 8, 9],
  17. # [10, 21, 12]])

布尔数组索引: 布尔数组索引允许你选择数组的任意元素。通常,这种类型的索引用于选择满足某些条件的数组元素。下面是一个例子:

  1. import numpy as np
  2. a = np.array([[1,2], [3, 4], [5, 6]])
  3. bool_idx = (a > 2) # Find the elements of a that are bigger than 2;
  4. # this returns a numpy array of Booleans of the same
  5. # shape as a, where each slot of bool_idx tells
  6. # whether that element of a is > 2.
  7. print(bool_idx) # Prints "[[False False]
  8. # [ True True]
  9. # [ True True]]"
  10. # We use boolean array indexing to construct a rank 1 array
  11. # consisting of the elements of a corresponding to the True values
  12. # of bool_idx
  13. print(a[bool_idx]) # Prints "[3 4 5 6]"
  14. # We can do all of the above in a single concise statement:
  15. print(a[a > 2]) # Prints "[3 4 5 6]"

为简洁起见,我们省略了很多关于numpy数组索引的细节; 如果你想了解更多,你应该阅读这篇文档

数据类型

每个numpy数组都是相同类型元素的网格。Numpy提供了一组可用于构造数组的大量数值数据类型。Numpy在创建数组时尝试猜测数据类型,但构造数组的函数通常还包含一个可选参数来显式指定数据类型。这是一个例子:

  1. import numpy as np
  2. x = np.array([1, 2]) # Let numpy choose the datatype
  3. print(x.dtype) # Prints "int64"
  4. x = np.array([1.0, 2.0]) # Let numpy choose the datatype
  5. print(x.dtype) # Prints "float64"
  6. x = np.array([1, 2], dtype=np.int64) # Force a particular datatype
  7. print(x.dtype) # Prints "int64"

你可以在这篇文档中阅读有关numpy数据类型的所有信息。

数组中的数学

基本数学函数在数组上以元素方式运行,既可以作为运算符重载,也可以作为numpy模块中的函数:

  1. import numpy as np
  2. x = np.array([[1,2],[3,4]], dtype=np.float64)
  3. y = np.array([[5,6],[7,8]], dtype=np.float64)
  4. # Elementwise sum; both produce the array
  5. # [[ 6.0 8.0]
  6. # [10.0 12.0]]
  7. print(x + y)
  8. print(np.add(x, y))
  9. # Elementwise difference; both produce the array
  10. # [[-4.0 -4.0]
  11. # [-4.0 -4.0]]
  12. print(x - y)
  13. print(np.subtract(x, y))
  14. # Elementwise product; both produce the array
  15. # [[ 5.0 12.0]
  16. # [21.0 32.0]]
  17. print(x * y)
  18. print(np.multiply(x, y))
  19. # Elementwise division; both produce the array
  20. # [[ 0.2 0.33333333]
  21. # [ 0.42857143 0.5 ]]
  22. print(x / y)
  23. print(np.divide(x, y))
  24. # Elementwise square root; produces the array
  25. # [[ 1. 1.41421356]
  26. # [ 1.73205081 2. ]]
  27. print(np.sqrt(x))

请注意,与MATLAB不同,*是元素乘法,而不是矩阵乘法。 我们使用dot函数来计算向量的内积,将向量乘以矩阵,并乘以矩阵。 dot既可以作为numpy模块中的函数,也可以作为数组对象的实例方法:

  1. import numpy as np
  2. x = np.array([[1,2],[3,4]])
  3. y = np.array([[5,6],[7,8]])
  4. v = np.array([9,10])
  5. w = np.array([11, 12])
  6. # Inner product of vectors; both produce 219
  7. print(v.dot(w))
  8. print(np.dot(v, w))
  9. # Matrix / vector product; both produce the rank 1 array [29 67]
  10. print(x.dot(v))
  11. print(np.dot(x, v))
  12. # Matrix / matrix product; both produce the rank 2 array
  13. # [[19 22]
  14. # [43 50]]
  15. print(x.dot(y))
  16. print(np.dot(x, y))

Numpy为在数组上执行计算提供了许多有用的函数;其中最有用的函数之一是 SUM

  1. import numpy as np
  2. x = np.array([[1,2],[3,4]])
  3. print(np.sum(x)) # Compute sum of all elements; prints "10"
  4. print(np.sum(x, axis=0)) # Compute sum of each column; prints "[4 6]"
  5. print(np.sum(x, axis=1)) # Compute sum of each row; prints "[3 7]"

你可以在这篇文档中找到numpy提供的数学函数的完整列表。

除了使用数组计算数学函数外,我们经常需要对数组中的数据进行整形或其他操作。这种操作的最简单的例子是转置一个矩阵;要转置一个矩阵,只需使用一个数组对象的T属性:

  1. import numpy as np
  2. x = np.array([[1,2], [3,4]])
  3. print(x) # Prints "[[1 2]
  4. # [3 4]]"
  5. print(x.T) # Prints "[[1 3]
  6. # [2 4]]"
  7. # Note that taking the transpose of a rank 1 array does nothing:
  8. v = np.array([1,2,3])
  9. print(v) # Prints "[1 2 3]"
  10. print(v.T) # Prints "[1 2 3]"

Numpy提供了许多用于操作数组的函数;你可以在这篇文档中看到完整的列表。

广播(Broadcasting)

广播是一种强大的机制,它允许numpy在执行算术运算时使用不同形状的数组。通常,我们有一个较小的数组和一个较大的数组,我们希望多次使用较小的数组来对较大的数组执行一些操作。

例如,假设我们要向矩阵的每一行添加一个常数向量。我们可以这样做:

  1. import numpy as np
  2. # We will add the vector v to each row of the matrix x,
  3. # storing the result in the matrix y
  4. x = np.array([[1,2,3], [4,5,6], [7,8,9], [10, 11, 12]])
  5. v = np.array([1, 0, 1])
  6. y = np.empty_like(x) # Create an empty matrix with the same shape as x
  7. # Add the vector v to each row of the matrix x with an explicit loop
  8. for i in range(4):
  9. y[i, :] = x[i, :] + v
  10. # Now y is the following
  11. # [[ 2 2 4]
  12. # [ 5 5 7]
  13. # [ 8 8 10]
  14. # [11 11 13]]
  15. print(y)

这会凑效; 但是当矩阵 x 非常大时,在Python中计算显式循环可能会很慢。注意,向矩阵 x 的每一行添加向量 v 等同于通过垂直堆叠多个 v 副本来形成矩阵 vv,然后执行元素的求和xvv。 我们可以像如下这样实现这种方法:

  1. import numpy as np
  2. # We will add the vector v to each row of the matrix x,
  3. # storing the result in the matrix y
  4. x = np.array([[1,2,3], [4,5,6], [7,8,9], [10, 11, 12]])
  5. v = np.array([1, 0, 1])
  6. vv = np.tile(v, (4, 1)) # Stack 4 copies of v on top of each other
  7. print(vv) # Prints "[[1 0 1]
  8. # [1 0 1]
  9. # [1 0 1]
  10. # [1 0 1]]"
  11. y = x + vv # Add x and vv elementwise
  12. print(y) # Prints "[[ 2 2 4
  13. # [ 5 5 7]
  14. # [ 8 8 10]
  15. # [11 11 13]]"

Numpy广播允许我们在不实际创建v的多个副本的情况下执行此计算。考虑这个需求,使用广播如下:

  1. import numpy as np
  2. # We will add the vector v to each row of the matrix x,
  3. # storing the result in the matrix y
  4. x = np.array([[1,2,3], [4,5,6], [7,8,9], [10, 11, 12]])
  5. v = np.array([1, 0, 1])
  6. y = x + v # Add v to each row of x using broadcasting
  7. print(y) # Prints "[[ 2 2 4]
  8. # [ 5 5 7]
  9. # [ 8 8 10]
  10. # [11 11 13]]"

y=x+v行即使x具有形状(4,3)v具有形状(3,),但由于广播的关系,该行的工作方式就好像v实际上具有形状(4,3),其中每一行都是v的副本,并且求和是按元素执行的。

将两个数组一起广播遵循以下规则:

  1. 如果数组不具有相同的rank,则将较低等级数组的形状添加1,直到两个形状具有相同的长度。
  2. 如果两个数组在维度上具有相同的大小,或者如果其中一个数组在该维度中的大小为1,则称这两个数组在维度上是兼容的。
  3. 如果数组在所有维度上兼容,则可以一起广播。
  4. 广播之后,每个数组的行为就好像它的形状等于两个输入数组的形状的元素最大值。
  5. 在一个数组的大小为1且另一个数组的大小大于1的任何维度中,第一个数组的行为就像沿着该维度复制一样

如果对于以上的解释依然没有理解,请尝试阅读这篇文档这篇解释中的说明。

支持广播的功能称为通用功能。你可以在这篇文档中找到所有通用功能的列表。

以下是广播的一些应用:

  1. import numpy as np
  2. # Compute outer product of vectors
  3. v = np.array([1,2,3]) # v has shape (3,)
  4. w = np.array([4,5]) # w has shape (2,)
  5. # To compute an outer product, we first reshape v to be a column
  6. # vector of shape (3, 1); we can then broadcast it against w to yield
  7. # an output of shape (3, 2), which is the outer product of v and w:
  8. # [[ 4 5]
  9. # [ 8 10]
  10. # [12 15]]
  11. print(np.reshape(v, (3, 1)) * w)
  12. # Add a vector to each row of a matrix
  13. x = np.array([[1,2,3], [4,5,6]])
  14. # x has shape (2, 3) and v has shape (3,) so they broadcast to (2, 3),
  15. # giving the following matrix:
  16. # [[2 4 6]
  17. # [5 7 9]]
  18. print(x + v)
  19. # Add a vector to each column of a matrix
  20. # x has shape (2, 3) and w has shape (2,).
  21. # If we transpose x then it has shape (3, 2) and can be broadcast
  22. # against w to yield a result of shape (3, 2); transposing this result
  23. # yields the final result of shape (2, 3) which is the matrix x with
  24. # the vector w added to each column. Gives the following matrix:
  25. # [[ 5 6 7]
  26. # [ 9 10 11]]
  27. print((x.T + w).T)
  28. # Another solution is to reshape w to be a column vector of shape (2, 1);
  29. # we can then broadcast it directly against x to produce the same
  30. # output.
  31. print(x + np.reshape(w, (2, 1)))
  32. # Multiply a matrix by a constant:
  33. # x has shape (2, 3). Numpy treats scalars as arrays of shape ();
  34. # these can be broadcast together to shape (2, 3), producing the
  35. # following array:
  36. # [[ 2 4 6]
  37. # [ 8 10 12]]
  38. print(x * 2)

广播通常会使你的代码更简洁,效率更高,因此你应该尽可能地使用它。

Numpy 的文档

这个简短的概述说明了部分numpy相关的重要事项。查看numpy参考手册以了解有关numpy的更多信息。

SciPy

Numpy提供了一个高性能的多维数组和基本工具来计算和操作这些数组。 而SciPy以此为基础,提供了大量在numpy数组上运行的函数,可用于不同类型的科学和工程应用程序。

熟悉SciPy的最佳方法是浏览它的文档。我们将重点介绍SciPy有关的对你有价值的部分内容。

图像操作

SciPy提供了一些处理图像的基本函数。例如,它具有将映像从磁盘读入numpy数组、将numpy数组作为映像写入磁盘以及调整映像大小的功能。下面是一个演示这些函数的简单示例:

  1. from scipy.misc import imread, imsave, imresize
  2. # Read an JPEG image into a numpy array
  3. img = imread('assets/cat.jpg')
  4. print(img.dtype, img.shape) # Prints "uint8 (400, 248, 3)"
  5. # We can tint the image by scaling each of the color channels
  6. # by a different scalar constant. The image has shape (400, 248, 3);
  7. # we multiply it by the array [1, 0.95, 0.9] of shape (3,);
  8. # numpy broadcasting means that this leaves the red channel unchanged,
  9. # and multiplies the green and blue channels by 0.95 and 0.9
  10. # respectively.
  11. img_tinted = img * [1, 0.95, 0.9]
  12. # Resize the tinted image to be 300 by 300 pixels.
  13. img_tinted = imresize(img_tinted, (300, 300))
  14. # Write the tinted image back to disk
  15. imsave('assets/cat_tinted.jpg', img_tinted)

猫咪 猫咪

左:原始图像。右:着色和调整大小的图像。

MATLAB 文件

函数 scipy.io.loadmatscipy.io.savemat 允许你读取和写入MATLAB文件。你可以在这篇文档中学习相关操作。

点之间的距离

SciPy定义了一些用于计算点集之间距离的有用函数。

函数scipy.spatial.distance.pdist计算给定集合中所有点对之间的距离:

  1. import numpy as np
  2. from scipy.spatial.distance import pdist, squareform
  3. # Create the following array where each row is a point in 2D space:
  4. # [[0 1]
  5. # [1 0]
  6. # [2 0]]
  7. x = np.array([[0, 1], [1, 0], [2, 0]])
  8. print(x)
  9. # Compute the Euclidean distance between all rows of x.
  10. # d[i, j] is the Euclidean distance between x[i, :] and x[j, :],
  11. # and d is the following array:
  12. # [[ 0. 1.41421356 2.23606798]
  13. # [ 1.41421356 0. 1. ]
  14. # [ 2.23606798 1. 0. ]]
  15. d = squareform(pdist(x, 'euclidean'))
  16. print(d)

你可以在这篇文档中阅读有关此功能的所有详细信息。

类似的函数(scipy.spatial.distance.cdist)计算两组点之间所有对之间的距离; 你可以在这篇文档中阅读它。

Matplotlib

Matplotlib是一个绘图库。本节简要介绍 matplotlib.pyplot 模块,该模块提供了类似于MATLAB的绘图系统。

绘制

matplotlib中最重要的功能是plot,它允许你绘制2D数据的图像。这是一个简单的例子:

  1. import numpy as np
  2. import matplotlib.pyplot as plt
  3. # Compute the x and y coordinates for points on a sine curve
  4. x = np.arange(0, 3 * np.pi, 0.1)
  5. y = np.sin(x)
  6. # Plot the points using matplotlib
  7. plt.plot(x, y)
  8. plt.show() # You must call plt.show() to make graphics appear.

运行此代码会生成以下图表:

sine

通过一些额外的工作,我们可以轻松地一次绘制多条线,并添加标题,图例和轴标签:

  1. import numpy as np
  2. import matplotlib.pyplot as plt
  3. # Compute the x and y coordinates for points on sine and cosine curves
  4. x = np.arange(0, 3 * np.pi, 0.1)
  5. y_sin = np.sin(x)
  6. y_cos = np.cos(x)
  7. # Plot the points using matplotlib
  8. plt.plot(x, y_sin)
  9. plt.plot(x, y_cos)
  10. plt.xlabel('x axis label')
  11. plt.ylabel('y axis label')
  12. plt.title('Sine and Cosine')
  13. plt.legend(['Sine', 'Cosine'])
  14. plt.show()

sine_cosine

你可以在这篇文档中阅读有关绘图功能的更多信息。

子图

你可以使用subplot函数在同一个图中绘制不同的东西。 这是一个例子:

  1. import numpy as np
  2. import matplotlib.pyplot as plt
  3. # Compute the x and y coordinates for points on sine and cosine curves
  4. x = np.arange(0, 3 * np.pi, 0.1)
  5. y_sin = np.sin(x)
  6. y_cos = np.cos(x)
  7. # Set up a subplot grid that has height 2 and width 1,
  8. # and set the first such subplot as active.
  9. plt.subplot(2, 1, 1)
  10. # Make the first plot
  11. plt.plot(x, y_sin)
  12. plt.title('Sine')
  13. # Set the second subplot as active, and make the second plot.
  14. plt.subplot(2, 1, 2)
  15. plt.plot(x, y_cos)
  16. plt.title('Cosine')
  17. # Show the figure.
  18. plt.show()

sine_cosine_subplot

你可以在这篇文档中阅读有关子图功能的更多信息。

图片

你可以使用 imshow 函数来显示一张图片。 这是一个例子:

  1. import numpy as np
  2. from scipy.misc import imread, imresize
  3. import matplotlib.pyplot as plt
  4. img = imread('assets/cat.jpg')
  5. img_tinted = img * [1, 0.95, 0.9]
  6. # Show the original image
  7. plt.subplot(1, 2, 1)
  8. plt.imshow(img)
  9. # Show the tinted image
  10. plt.subplot(1, 2, 2)
  11. # A slight gotcha with imshow is that it might give strange results
  12. # if presented with data that is not uint8. To work around this, we
  13. # explicitly cast the image to uint8 before displaying it.
  14. plt.imshow(np.uint8(img_tinted))
  15. plt.show()

cat_tinted_imshow

文章出处

由NumPy中文文档翻译,原作者为 Justin Johnson,翻译至:http://cs231n.github.io/python-numpy-tutorial/