Code

mldata 1.0#2

Code

Open

ASalvail wants to merge 65 commits intoSMART-Lab:masterSMART-Lab/mldata:masterfrom ASalvail:masterCopy head branch name to clipboard

+833-109

Commits

Commits on Mar 10, 2014

• Skeleton of the Dataset abstract class.

  ASalvail

  committed
  a25762b

• First draft of the metadata class.

  ASalvail

  committed
  a6e925c

• First draft of an in-memory implementation of a dataset.

  ASalvail

  committed
  f21cca6

Commits on Mar 11, 2014

• Added a version number to datasets metadata

  ASalvail

  committed
  225ddc7

• Added the Dictionary class stub.

  ASalvail

  committed
  5197fad

• Updated datasets definition to correctly handle targets datasets.

  ASalvail

  committed
  27ef780

• Updated the datasets general methods concerning splits and applying preprocessing.

  ASalvail

  committed
  5ad4ee8

Commits on Mar 12, 2014

• Added a check to make sure splits are defined via a tuple.

  ASalvail

  committed
  1c605d1

• Deleted InMemoryDataset and transfered methods to Dataset

  Show description for 2fb5d6b
  ASalvail

  committed
  2fb5d6b

• Added definitions of iterator and get item supporting supervised and unsupervised learning.

  ASalvail

  committed
  6d8ee8b

Commits on Mar 18, 2014

• utils to save and load the config file which contains the path to the datasets folders.

  ASalvail

  committed
  35f112f

Commits on Mar 26, 2014

• Changed the config file logic to support by dataset path.

  ASalvail

  committed
  aaffb2f

• Added a check to see if a specific dataset path exists.

  ASalvail

  committed
  7ef811c

• Added an hash function for easy versioning.

  ASalvail

  committed
  625bfea

Commits on Apr 1, 2014

• New version of dataset_store with versioning and metadata supported.

  ASalvail

  committed
  79fc344

Commits on Apr 3, 2014

• Added an importer for CSV files based on numpy.loadtxt()

  ASalvail

  committed
  f11ba43

• Added comments and new parameters

  ASalvail

  committed
  ab262ff

• Efficient buffered iteration added.

  ASalvail

  committed
  00730de

• Removed uses of utils/utils

  ASalvail

  committed
  b21420e

• Test suite for Datasets

  ASalvail

  committed
  fc9e766

Commits on Apr 8, 2014

• Test suite for Config

  ASalvail

  committed
  ef46db9

• Test suite for Dataset_store

  ASalvail

  committed
  c923699

Commits on Apr 9, 2014

• Corrected saving of default config file

  ASalvail

  committed
  4c8b313

• Corrected loading of config file

  ASalvail

  committed
  d8b4cfa

• Corrected joining of parts in CONFIGFILE

  ASalvail

  committed
  f3ea2a6

• Updated to python 3.4

  ASalvail

  committed
  0ff610e

• Small correction to skip a line

  ASalvail

  committed
  347d24b

• assert syntax correction

  ASalvail

  committed
  d5adda5

• Added __init__ files for tests

  ASalvail

  committed
  2d9b70f

Commits on Apr 10, 2014

• Changed the whole logic of __iter__ and __getitem__

  Show description for 52bb43f
  ASalvail

  committed
  52bb43f

• Changed test to remove errors when run.

  ASalvail

  committed
  ab0b52b

Commits on Apr 15, 2014

• Create the default dataset directory. Insure the dataset folders wouldn't be created if it already existed.

  ASalvail

  committed
  1b4b158

• Changed preprocess logic to follow python's capacities.

  ASalvail

  committed
  93425f7

• Changed preprocess logic to follow python's capacities.

  ASalvail

  committed
  571fbf7

• Corrected a small mistake in the splits of the test case.

  ASalvail

  committed
  e652374

• Removed a nonsensical test.

  ASalvail

  committed
  8bde933

• Corrected split argument in a test

  ASalvail

  committed
  ef37e3a

• Corrected how h5py is called to store a ndarray.

  ASalvail

  committed
  62ff2a7

• Small corrections in tests

  ASalvail

  committed
  035ba7d

• Changed preprocess functions to named function as lambdas can't be pickled.

  ASalvail

  committed
  85bae50

• Corrected tests to reflect read-only datasets

  ASalvail

  committed
  75bc15c

• Corrected errors in dataset loading

  ASalvail

  committed
  b9d5ef4

• Added a method to remove a dataset.

  ASalvail

  committed
  8010e60

• Insured datasets were cleaned after tests.

  ASalvail

  committed
  594b4f5

• Corrected hashing of function to account for the difference between h5py and numpy arrays.

  ASalvail

  committed
  145ecb6

• Module docstring

  ASalvail

  committed
  aa79e28

• edited todos comments

  ASalvail

  committed
  bb7086b

Commits on Apr 16, 2014

• Rollback to python 3.3 for CI.

  ASalvail

  committed
  a3010fa

• Added a check for config file existence

  ASalvail

  committed
  e39be55

• Rename test_Dataset.py to test_dataset.py

  ASalvail

  committed
  ff6c658

• Corrected typo in config.py

  ASalvail

  committed
  2db5970

• Added a LookupError to handle missing datasets.

  ASalvail

  committed
  6af517a

• Added a LookupError to handle missing datasets_versions.

  ASalvail

  committed
  9e0b80c

• Added test to make sure missing datasets are handled properly.

  ASalvail

  committed
  2411f40

• Changed splits logic.

  Show description for e623803
  ASalvail

  committed
  e623803

• Added a split iterator.

  Show description for 29c723e
  ASalvail

  committed
  29c723e

• Added a lazy read test.

  ASalvail

  committed
  503be66

Commits on Apr 25, 2014

• Corrected an assert statement

  ASalvail

  committed
  8e99c21

• Close h5py File handle and correct noTarget dset

  ASalvail

  committed
  a59492d

Commits on May 13, 2014

• Added support for minibatches

  ASalvail

  committed
  0f35b10

Commits on May 31, 2014

• Changed iterators to cycle infinitely and corrected an assert statement.

  ASalvail

  committed
  5425285

• Removed infinite cycle in iterator.

  Show description for 6a16d43
  ASalvail

  committed
  6a16d43

• Changed import names to reflect name change. Some other minor corrections.

  ASalvail

  committed
  ed98c62

Commits on Jul 7, 2014

• Added a convenient method the whole dataset in memory.

  ASalvail

  committed
  6ccca01

• Targets reshaped to fit adequate data structure.

  ASalvail

  committed
  ada9521