Link Search Menu Expand Document

Python Reference

Created by Nishant Kheterpal and Jessica Hu Updated and Maintained by Jonathan Ferrari

Table of Contents

  1. Python Reference
    1. Table Functions and Methods
    2. String Methods
    3. Array Functions and Methods
    4. Table Filtering Predicates
    5. Miscellaneous Functions

Table Functions and Methods

In the examples in the left column, np refers to the NumPy module, as usual. Everything else is a function, a method, an example of an argument to a function or method, or an example of an object we might call the method on. For example, tbl refers to a table, array refers to an array, and num refers to a number. array.item(0) is an example call for the method item, and in that example, array is the name previously given to some array.

NameDescriptionInputOutput
Table()Create an empty table, usually to extend with data (Ch 6)NoneAn empty Table
Table().read_table(filename)Create a table from a data file (Ch 6)string: the name of the fileTable with the contents of the data file
tbl.with_columns(name, values)
tbl.with_columns(n1, v1, n2, v2,...)
A table with an additional or replaced column or columns. name is a string for the name of a column, values is an array (Ch 6)1. string: the name of the new column;
2. array: the values in that column
Table: a copy of the original Table with the new columns added
tbl.column(column_name_or_index)The values of a column (an array) (Ch 6)string or int: the column name or indexarray: the values in that column
tbl.num_rowsCompute the number of rows in a table (Ch 6)Noneint: the number of rows in the table
tbl.num_columnsCompute the number of columns in a table (Ch 6)Noneint: the number of columns in the table
tbl.labelsLists the column labels in a table (Ch 6)Nonearray: the names of each column (as strings) in the table
tbl.select(col1, col2, ...)Create a copy of a table with only some of the columns. Each column is the column name or index. (Ch 6)string or int: column name(s) or index(es)Table with the selected columns
tbl.drop(col1, col2, ...)Create a copy of a table without some of the columns. Each column is the column name or index. (Ch 6)string or int: column name(s) or index(es)Table without the selected columns
tbl.relabeled(old_label, new_label)Creates a new table, changing the column name specified by the old label to the new label, and leaves the original table unchanged. (Ch 6)1. string: the old column name
2. string: the new column name
Table: a new Table
tbl.show(n)Display n rows of a table. If no argument is specified, defaults to displaying the entire table. (Ch 6.1)(Optional) int: number of rows you want to displayNone: displays a table with n rows
tbl.sort(column_name_or_index)Create a copy of a table sorted by the values in a column. Defaults to ascending order unless descending = True is included. (Ch 6.1)1. string or int: column index or name
2. (Optional) descending=True
Table: a copy of the original with the column sorted
tbl.where(column, predicate)Create a copy of a table with only the rows that match some predicate. See Table.where predicates below. (Ch 6.2)1. string or int: column name or index
2. are.(...) predicate
Table: a copy of the original table with only the rows that match the predicate
tbl.take(row_indices)A table with only the rows at the given indices. row_indices is either an array of indices or an integer corresponding to one index. (Ch 6.2)array of ints: the indices of the rows to be included in the Table OR int: the index of the row to be includedTable: a copy of the original table with only the rows at the given indices
tbl.scatter(x_column, y_column)Draws a scatter plot consisting of one point for each row of the table. Note that x_column and y_column must be strings specifying column names. Include optional argument fit_line=True if you want to draw a line of best fit for each set of points. (Ch 7)1. string: name of the column on the x-axis
2. string: name of the column on the y-axis
3. (Optional) fit_line=True
None: draws a scatter plot
tbl.plot(x_column, y_column)
tbl.plot(x_column)
Draw a line graph consisting of one point for each row of the table. If you only specify one column, it will plot the rest of the columns on the y-axis as different colored lines. (Ch 7)1. string: name of the column on the x-axis
2. string: name of the column on the y-axis
None: draws a line graph
tbl.barh(categories)
tbl.barh(categories, values)
Displays a bar chart with bars for each category in a column, with length proportional to the corresponding frequency. values argument unnecessary if table has only a column of categories and a column of values. (Ch 7.1)1. string: name of the column with categories
2. (Optional) string: the name of the column with values for corresponding categories
None: draws a bar chart
tbl.hist(column, unit, bins, group)Generates a histogram of the numerical values in a column. unit and bins are optional arguments, used to label the axes and group the values into intervals (bins), respectively. Bins have the form [a, b), where a is included in the bin and b is not. (Ch 7.2)1. string: name of the column with categories
2. (Optional) string: units of x-axis
3. (Optional) array of ints/floats denoting bin boundaries
4. (Optional) string: name of categorical column to draw separate overlaid histograms for
None: draws a histogram
tbl.bin(column_name_or_index)
tbl.bin(column_name_or_index, bins)
Groups values into intervals, known as bins. Results in a two-column table that contains the number of rows in each bin. The first column lists the left endpoints of the bins, except in the last row. If the bins argument isn’t used, default is to produce 10 equally wide bins between the min and max values of the data. (Ch 7.2)1. string or int: column name(s) or index(es)
2. (Optional) array of ints/floats denoting bin boundaries or an int of the number of bins you want
Table: a new tables
tbl.apply(function)
tbl.apply(function, col1, col2, ...)
Returns an array of values resulting from applying a function to each item in a column. (Ch 8.1)1. function: function to apply to column
2. (Optional) string: name of the column to apply function to (if you have multiple columns, the respective column’s values will be passed as the corresponding argument to the function), and if there is no argument, your function will be applied to every row object in tbl
array: contains an element for each value in the original column after applying the function to it
tbl.group(column_or_columns, collect)Group rows by unique values or combinations of values in a column(s). Multiple columns must be entered in array or list form. Other values aggregated by count (default) or optional argument collect. (Ch 8.2)1. string or array of strings: column(s) on which to group
2. (Optional) function: function to aggregate values in cells (defaults to count)
Table: a new Table
tbl.pivot(col1, col2, values, collect)
tbl.pivot(col1, col2)
A pivot table where each unique value in col1 has its own column and each unique value in col2 has its own row. Count or aggregate values from a third column, collect with some function. Default values and collect return counts in cells. (Ch 8.3)1. string: name of column whose unique values will make up columns of pivot table
2. string: name of column whose unique values will make up rows of pivot table
3. (Optional) string: name of column that describes the values of cell
4. (Optional) function: how the values are collected, e.g. sum or np.mean
Table: a new Table
tblA.join(colA, tblB, colB)
tblA.join(colA, tblB)
Generate a table with the columns of tblA and tblB, containing rows for all values of a column that appear in both tables. Default colB is colA. colA and colB must be strings specifying column names. (Ch 8.4)1. string: name of a column in tblA with values to join on
2. Table: other Table
3. (Optional) string: if column names are different between Tables, the name of the shared column in tblB
Table: a new Table
tbl.sample(n)
tbl.sample(n, with_replacement)
A new table where n rows are randomly sampled from the original table; by default, n=tbl.num_rows. Default is with replacement. For sampling without replacement, use argument with_replacement=False. For a non-uniform sample, provide a third argument weights=distribution where distribution is an array or list containing the probability of each row. (Ch 10)1. int: sample size
2. (Optional) with_replacement=False
Table: a new Table with n rows
tbl.row(row_index)Accesses the row of a table by taking the index of the row as its argument. Note that rows are in general not arrays, as their elements can be of different types. However, you can use .item to access a particular element of a row using row.item(label). (Ch 17.3)int: row indexRow object with the values of the row and labels of the corresponding columns
tbl.rowsCan use to access all of the rows of a table.NoneRows object made up of all rows as individual row objects

String Methods

NameDescription
str.split(separator)Splits the string (str) into a list based on the separator that is passed in
str.join(array)Combines each element of array into one string, with str being in-between each element
str.replace(old_string, new_string)Replaces each occurrence of old_string in str with the value of new_string (Ch 4.2.1)

Array Functions and Methods

NameChapterDescription
max(array)3.3Returns the maximum value of an array
min(array)3.3Returns the minimum value of an array
sum(array)3.3Returns the sum of the values in an array
abs(num), np.abs(array)3.3Takes the absolute value of a number or each number in an array
round(num), np.round(array)
round(num, decimals), np.round(array, decimals)
3.3Rounds a number or an array of numbers to the nearest integer. If decimals (integer) is included, rounds to that many digits. If decimals is negative, remove that many digits of precision.
len(array), len(string)3.3Returns the length (number of elements) of an array. If a string (str) is passed in instead, returns the number of characters in the string.
make_array(val1, val2, ...)5Makes a numpy array with the values passed in
np.average(array)
np.mean(array)
5.1Returns the mean value of an array
np.std(array)14.2Returns the standard deviation of an array
np.diff(array)5.1Returns a new array of size len(arr)-1 with elements equal to the difference between adjacent elements; val_2 - val_1, val_3 - val_2, etc.
np.sqrt(array)5.1Returns an array with the square root of each element
np.arange(start, stop, step)
np.arange(start, stop)
np.arange(stop)
5.2An array of numbers starting with start, going up in increments of step, and going up to but excluding stop. When start and/or step are left out, default values are used in their place. Default step is 1; default start is 0.
array.item(index)5.3Returns the i-th item in an array (remember Python indices start at 0!)
np.random.choice(array, n)
np.random.choice(array)
9Picks one (by default) or some number (n) of items from array at random with replacement.
np.count_nonzero(array)9Returns the number of non-zero (or True) elements in an array.
np.append(array, item)9.2Returns a copy of the input array with item appended to the end.
percentile(percentile, array)13.1Returns the corresponding percentile of an array.

Table Filtering Predicates

Any of these predicates can be negated by adding not_ in front of them, e.g. are.not_equal_to(Z) or are.not_containing(S).

PredicateDescription
are.equal_to(Z)Equal to Z
are.not_equal_to(Z)Not equal to Z
are.above(x)Greater than x
are.above_or_equal_to(x)Greater than or equal to x
are.below(x)Less than x
are.below_or_equal_to(x)Less than or equal to x
are.between(x, y)Greater than or equal to x and less than y
are.between_or_equal_to(x, y)Greater than or equal to x, and less than or equal to y
are.strictly_between(x, y)Greater than x and less than y
are.contained_in(A)Is a substring of A (if A is a string) or an element of A (if A is a list/array)
are.containing(S)Contains the string S

Miscellaneous Functions

These are functions in the datascience library that are used in the course that don’t fall into any of the categories above. You can also read more about all functions in the datascience library on the datascience documentation.

NameDescriptionIntputOutput
sample_proportions(sample_size, model_proportions)sample_size should be an integer, model_proportions an array of probabilities that sum up to 1. The function samples sample_size objects from the distribution specified by model_proportions. It returns an array with the same size as model_proportions. Each item in the array corresponds to the proportion of times it was sampled out of the sample_size times. (Ch 11.1)1. int: sample size
2. array: an array of proportions that should sum to 1
array: each item corresponds to the proportion of times that corresponding item was sampled from model_proportions in sample_size draws, should sum to 1
minimize(function)Returns an array of values such that if each value in the array was passed into function as arguments, it would minimize the output value of function. (Ch 15.4)function: name of a function that will be minimizedarray: An array in which each element corresponds to an argument that minimizes the output of the function. Values in the array are listed based on the order they are passed into the function; the first element in the array is also going to be the first value passed into the function.