626_privacy/tensorflow_privacy
2
0
Fork 1
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions
684 commits 2 branches 0 tags 3.1 MiB
Commit graph

378 commits

Author SHA1 Message Date
Liwei Song
a41d6aace7 add threshold-entropy attack 2020-10-21 16:41:20 -04:00
David Marn
1981ebe2f2 Adds the TF Privacy Report codelab. 
PiperOrigin-RevId: 338222024
 2020-10-21 01:52:53 -07:00
Vadym Doroshenko
4143957701 Fixed train/test_size calculation. 
PiperOrigin-RevId: 337886488
 2020-10-19 10:38:11 -07:00
Yurii Sushko
19ae5c9669 Fix broken codelab link 
PiperOrigin-RevId: 337095513
 2020-10-14 08:28:17 -07:00
David Marn
d1a8a6cfda Multiple small changes to the TF Privacy Report: 
- Fix the legend to the bottom right
     - Manually set the size of the plot figure.
     - Fix a typo in the subplot title.

PiperOrigin-RevId: 337064528
 2020-10-14 04:41:35 -07:00
David Marn
1281d0c63e Adds an option to balance train and test AttackInputData and stratifies the train-test split. 
PiperOrigin-RevId: 336609893
 2020-10-12 00:43:16 -07:00
Steve Chien
d703168de2 Add TF1-compatible version of DP canned estimators, and some small cleanup.. 
PiperOrigin-RevId: 335954269
 2020-10-07 14:31:53 -07:00
David Marn
703cd413c6 Introduces an AttackResultsCollection class for the ML Privacy report. 
PiperOrigin-RevId: 335858822
 2020-10-07 06:59:26 -07:00
Peter Kairouz
e19c53a78c Add a function to compute RDP under heterogeneous applications of the subsampled Gaussian mechanism. 
PiperOrigin-RevId: 335706732
 2020-10-06 13:20:34 -07:00
David Marn
ab1090717c Internal change. 
PiperOrigin-RevId: 335385162
 2020-10-05 03:54:20 -07:00
Vadym Doroshenko
9a56402c0d Removing leftovers from the old API. 
PiperOrigin-RevId: 334792006
 2020-10-01 05:13:33 -07:00
A. Unique TensorFlower
a579cc4afc BUILD cleanups 
PiperOrigin-RevId: 334666492
 2020-09-30 13:27:37 -07:00
Shuang Song
20d0b884ba Move to new API. 
PiperOrigin-RevId: 334434385
 2020-09-29 12:16:06 -07:00
Shuang Song
bca2baae8d Remove old API. 
PiperOrigin-RevId: 334406920
 2020-09-29 10:19:37 -07:00
David Marn
78d30a0424 Refactors the pd_dataframe calculation to avoid hard-coded strings. 
PiperOrigin-RevId: 334334080
 2020-09-29 02:15:34 -07:00
David Marn
c30c3fcb7a Adds plots for multiple model labels to the ML Privacy Report. 
PiperOrigin-RevId: 334179759
 2020-09-28 09:59:37 -07:00
Steve Chien
837e014107 For DP Keras optimizers, add assertion that one of the DP-modified gradients methods has been called before apply_gradients(). In particular, this helps catch cases where the user has not yet upgraded to TF 2.4. 
PiperOrigin-RevId: 333620379
 2020-09-24 16:14:49 -07:00
Shuang Song
7c53757250 Option for plotting attack results in the same figure. 
PiperOrigin-RevId: 333225502
 2020-09-22 22:12:00 -07:00
Yurii Sushko
677b3d9e9a Quick docs fix. 
PiperOrigin-RevId: 332061086
 2020-09-16 12:21:44 -07:00
Yurii Sushko
78f76fac31 Add a note about API update to the docs. 
PiperOrigin-RevId: 332057406
 2020-09-16 12:04:27 -07:00
David Marn
942ad89da7 Adds the feedback from to the readme. 
PiperOrigin-RevId: 331956759
 2020-09-16 01:42:25 -07:00
David Marn
70f9585a24 Adds Privacy vs Utility charts to the Privacy Report for a single model. 
PiperOrigin-RevId: 331720083
 2020-09-15 01:30:21 -07:00
David Marn
fc38e3f733 Modifies Privacy Report metadata and adds an epoch chart. 
PiperOrigin-RevId: 331326000
 2020-09-12 09:11:45 -07:00
Vadym Doroshenko
f44b63eb78 Add probabilities to AttackInputData. 
PiperOrigin-RevId: 330723370
 2020-09-09 08:05:52 -07:00
A. Unique TensorFlower
6312a853d8 Merge pull request #119 from lwsong:master 
PiperOrigin-RevId: 330658958
 2020-09-08 22:44:06 -07:00
Vadym Doroshenko
8f3a61b50d Fixing calculating loss on logits. 
PiperOrigin-RevId: 329966058
 2020-09-03 12:06:29 -07:00
Vadym Doroshenko
f4fc9b2623 Updating comments to run_attack() and making non-API functions to be private. 
PiperOrigin-RevId: 329951618
 2020-09-03 10:56:31 -07:00
A. Unique TensorFlower
2f0a078dd9 Adds Privacy Report metadata to AttackResults. 
PiperOrigin-RevId: 329871255
 2020-09-03 01:05:12 -07:00
Steve Chien
8d89ef0a4b Update version to 0.5.1, and add dependence on tensorflow-estimator. 
PiperOrigin-RevId: 329822203
 2020-09-02 17:31:32 -07:00
Liwei Song
0e1c1eeef3 add entropy tests 2020-09-02 11:37:12 -04:00
Liwei Song
9b2e6a55b6 add entropy feature 2020-08-31 16:17:19 -04:00
Liwei Song
e547a10eec fix softmax issue 2020-08-31 15:24:46 -04:00
A. Unique TensorFlower
f677c9c440 Adding contribution guidelines to TF Privacy 
PiperOrigin-RevId: 328740117
 2020-08-27 08:21:03 -07:00
Shuang Song
f90c78bd54 Update tf_estimator_evaluation and keras_evaluation to new API. 
PiperOrigin-RevId: 328195220
 2020-08-24 13:03:28 -07:00
A. Unique TensorFlower
7a77d5d92c Modify Colab to use the new membership inference API. 
PiperOrigin-RevId: 327805944
 2020-08-21 07:21:38 -07:00
Shuang Song
d23772e163 Returns attack results as a Pandas data frame. 
PiperOrigin-RevId: 327675978
 2020-08-20 12:27:43 -07:00
A. Unique TensorFlower
52c1f8fdfe Overrides default __str__ methods. 
PiperOrigin-RevId: 327423772
 2020-08-19 06:49:14 -07:00
Steve Chien
6dccd9b537 Fix bug in keras optimizers where tape was not being used with tensor (as opposed to callable) losses. 
PiperOrigin-RevId: 327276721
 2020-08-18 12:00:20 -07:00
A. Unique TensorFlower
193ac3b1c8 Adds more validation checks for AttackInputData. 
PiperOrigin-RevId: 327191245
 2020-08-18 02:34:58 -07:00
Steve Chien
a69b013390 Add head for multi-label estimators in TF estimator framework. 
PiperOrigin-RevId: 327048185
 2020-08-17 10:28:45 -07:00
Galen Andrew
d939b22463 Bump version number. 
PiperOrigin-RevId: 326927560
 2020-08-16 15:12:13 -07:00
Steve Chien
d72e3400b7 Add DP-enabled version of DNNClassifier. 
PiperOrigin-RevId: 326482309
 2020-08-13 11:03:46 -07:00
A. Unique TensorFlower
f8515dfd71 Replaces predict with predict_proba. 
PiperOrigin-RevId: 326227257
 2020-08-12 07:24:29 -07:00
A. Unique TensorFlower
59192e6f5c Make validation that labels are integers. 
PiperOrigin-RevId: 326216555
 2020-08-12 06:00:31 -07:00
A. Unique TensorFlower
0fd06493cc Make sklearn classifiers in parallel. 
It's done only for those classifiers that run a significant amount of time.

PiperOrigin-RevId: 326215987
 2020-08-12 05:53:46 -07:00
Galen Andrew
37ff5d502e Add derive_metrics function to DPQuery. 
derive_metrics is a new function in the public API so customers can query aspects of the global state that change, such as the clip when using adaptive clipping.

PiperOrigin-RevId: 326174158
 2020-08-11 22:58:59 -07:00
A. Unique TensorFlower
06bb047525 Consistent string formatting. 
PiperOrigin-RevId: 326007570
 2020-08-11 06:17:36 -07:00
A. Unique TensorFlower
680aaa4499 Simple ROC curve plotting for membership inference attack results. 
PiperOrigin-RevId: 325982344
 2020-08-11 02:29:15 -07:00
Steve Chien
99afaed68e Refactor of common functions in binary and multiclass heads. 
PiperOrigin-RevId: 325957037
 2020-08-10 22:30:24 -07:00
Steve Chien
3a641e077e Add DP-enabled binary-class head and multi-class heads for Estimator. 
PiperOrigin-RevId: 325921076
 2020-08-10 17:19:54 -07:00
A. Unique TensorFlower
43a0e4be8a The new API for the membership inference attack. 
1. Colab and Keras/TF estimator integration still use the old API and will be updated in the subsequent CLs.
2. After dropping the old API in membership_inference_attack.py, membership_inference_attack_new.py will be renamed in membership_inference_attack.py.

PiperOrigin-RevId: 325823046
 2020-08-10 09:44:21 -07:00
A. Unique TensorFlower
68651eeddc Internal change. 
PiperOrigin-RevId: 325768017
 2020-08-10 02:51:11 -07:00
A. Unique TensorFlower
40419b56a3 Internal change. 
PiperOrigin-RevId: 325423652
 2020-08-07 06:12:18 -07:00
Steve Chien
5ad8676d38 Automated rollback of commit 5433436b86 
PiperOrigin-RevId: 325308999
 2020-08-06 14:19:46 -07:00
Steve Chien
5433436b86 Change GaussianSumQuery to not convert hyperparameters from Python numbers to Tensors. 
PiperOrigin-RevId: 325251302
 2020-08-06 09:56:40 -07:00
A. Unique TensorFlower
efca03b593 Internal change. 
PiperOrigin-RevId: 325249654
 2020-08-06 09:48:25 -07:00
A. Unique TensorFlower
08f960a1af Internal change. 
PiperOrigin-RevId: 325210305
 2020-08-06 05:25:58 -07:00
Steve Chien
e91c820b2a Adds a Keras optimizer version of DP-SGD. New optimizers are subclasses of tf.keras.optimizers.Optimizer and override both _compute_gradients and get_gradients. 
PiperOrigin-RevId: 325124698
 2020-08-05 21:20:59 -07:00
A. Unique TensorFlower
29651216cd Internal change. 
PiperOrigin-RevId: 324591262
 2020-08-03 12:08:41 -07:00
A. Unique TensorFlower
0a1cbb5b7b Internal change. 
PiperOrigin-RevId: 324574332
 2020-08-03 12:08:33 -07:00
Thomas O'Malley
d5e34b77c8 Allow loss to be passed as a Tensor to Optimizer.minimize 
PiperOrigin-RevId: 323895500
 2020-07-29 22:24:02 -07:00
Shuang Song
cea9e01670 A callback and a function to be called in the end of training for keras to perform membership inference attack. 
PiperOrigin-RevId: 323805663
 2020-07-29 22:23:53 -07:00
A. Unique TensorFlower
dcbfaa3f5e Internal change. 
PiperOrigin-RevId: 323529635
 2020-07-29 22:23:38 -07:00
A. Unique TensorFlower
f318fbb140 Internal change. 
PiperOrigin-RevId: 322996754
 2020-07-24 08:03:51 -07:00
Shuang Song
267ea7f90d A separate tensorboard function. 
PiperOrigin-RevId: 322820408
 2020-07-23 10:55:49 -07:00
A. Unique TensorFlower
2ec0f36d1e Added support for Keras optimizers and serialization. 
PiperOrigin-RevId: 322603030
 2020-07-22 10:29:03 -07:00
Steve Chien
87c01eb2f5 Enable optimizers to handle variables whose gradients are None. 
PiperOrigin-RevId: 322193798
 2020-07-20 11:59:20 -07:00
A. Unique TensorFlower
8ec709e3d7 Internal change. 
PiperOrigin-RevId: 321768596
 2020-07-17 06:37:46 -07:00
A. Unique TensorFlower
3549d23da3 Internal change. 
PiperOrigin-RevId: 321765113
 2020-07-17 06:07:53 -07:00
A. Unique TensorFlower
510dd207d5 Internal change. 
PiperOrigin-RevId: 321742857
 2020-07-17 02:43:53 -07:00
Shuang Song
a0e1b72838 A training hook and a function to be called in the end of training for tf estimator to perform membership inference attack. 
PiperOrigin-RevId: 321648371
 2020-07-16 14:39:09 -07:00
Galen Andrew
51eb7c3712 Add SumAggregationDPQuery to top-level symbols. 
PiperOrigin-RevId: 321185486
 2020-07-14 10:31:25 -07:00
Galen Andrew
78f29a8990 Add a version number to TF Privacy package. 
PiperOrigin-RevId: 321023649
 2020-07-13 13:37:28 -07:00
A. Unique TensorFlower
cad41f8f52 Automated rollback of commit 9408e0fca5 
PiperOrigin-RevId: 320726123
 2020-07-10 21:42:08 -07:00
Galen Andrew
9408e0fca5 Add a version number to TF Privacy package. 
PiperOrigin-RevId: 320713287
 2020-07-10 18:40:11 -07:00
Galen Andrew
4e5b2ae3e5 Add NoPrivacyQuantileEstimatorQuery to top level symbols. 
PiperOrigin-RevId: 320675305
 2020-07-10 14:21:59 -07:00
Galen Andrew
2f51adac89 Allow exact denominator for below estimate fraction used by quantile estimator. 
Also:
1) Check that records for quantile estimator query are scalars.
2) Add tests of quantile estimator with noise.
3) Add privacy ledger to no-privacy queries.
PiperOrigin-RevId: 320633937
 2020-07-10 10:56:06 -07:00
Galen Andrew
d1e2cc1930 Add NestedSumQuery for nested queries with sum aggregation. 
PiperOrigin-RevId: 320303703
 2020-07-08 18:05:04 -07:00
Timon Van Overveldt
c948e2fe7c Automated rollback of commit 3c2fbb2f63 
PiperOrigin-RevId: 318110878
 2020-06-24 12:00:46 -07:00
Galen Andrew
3c2fbb2f63 Add a version number to TF Privacy package. 
PiperOrigin-RevId: 318096109
 2020-06-24 10:50:48 -07:00
A. Unique TensorFlower
4b6a60dfdb Mention codelab in the README file. 
PiperOrigin-RevId: 318069426
 2020-06-24 08:35:01 -07:00
A. Unique TensorFlower
e38c351e8d Small fix in output of run_all_attack_summary 
PiperOrigin-RevId: 318064829
 2020-06-24 08:05:28 -07:00
A. Unique TensorFlower
06765f69f0 Minor documentation improvements. 
PiperOrigin-RevId: 318063707
 2020-06-24 07:57:52 -07:00
A. Unique TensorFlower
3658ef5dbc Updates to the membership inference codelab. 
PiperOrigin-RevId: 318061869
 2020-06-24 07:44:45 -07:00
A. Unique TensorFlower
18fe9eb3aa Updates to the codelab. 
PiperOrigin-RevId: 318054616
 2020-06-24 06:40:49 -07:00
A. Unique TensorFlower
74bd89d754 Updates to the codelab. 
PiperOrigin-RevId: 318051333
 2020-06-24 06:13:20 -07:00
A. Unique TensorFlower
c01e7b71ab Drop an old example of usage of membership infererence attack. 
PiperOrigin-RevId: 318051280
 2020-06-24 06:12:49 -07:00
A. Unique TensorFlower
e40a35f9c0 Updates to the membership inference codelab. 
PiperOrigin-RevId: 318049409
 2020-06-24 05:57:39 -07:00
A. Unique TensorFlower
c07e87d0b5 Adds an end-to-end codelab that trains a model and evaluates it for privacy risks. 
PiperOrigin-RevId: 318032025
 2020-06-24 03:00:24 -07:00
A. Unique TensorFlower
88dd8771bf Open sourcing membership inference attack. 
PiperOrigin-RevId: 317958055
 2020-06-23 16:12:08 -07:00
A. Unique TensorFlower
1fb9b80d90 Internal refactor 
PiperOrigin-RevId: 317955791
 2020-06-23 16:07:05 -07:00
Galen Andrew
8efc44b395 Remove initial_sample_state from GaussianSumQuery. It is the same in the base class. 
PiperOrigin-RevId: 315303883
 2020-06-08 10:34:09 -07:00
Galen Andrew
cec011e2a7 Refactor quantile estimation logic from QuantileAdaptiveClipSumQuery so it can be used for other purposes. 
PiperOrigin-RevId: 315297665
 2020-06-08 10:07:01 -07:00
Steve Chien
261ab4f28e Change another copyright year for internal test. 
PiperOrigin-RevId: 315032489
 2020-06-05 18:38:26 -07:00
Steve Chien
35c4b4678e Update copyright year as part of internal test. 
PiperOrigin-RevId: 315027483
 2020-06-05 18:36:03 -07:00
A. Unique TensorFlower
da9fb28b37 Expose differentially private RMSPropOptimizer. 
PiperOrigin-RevId: 311072544
 2020-05-12 00:09:29 -07:00
Steve Chien
10335f6177 Refactor MNIST tutorials and create new TPU tutorial: 
1. Move common code to new file mnist_dpsgd_tutorial_common.py.
2. Move epsilon computation function out of binary into its own library.
3. Create new TPU tutorial.

PiperOrigin-RevId: 310409308
 2020-05-07 12:05:50 -07:00
A. Unique TensorFlower
319bf81bb1 Setting correct argument in super() call in DPOptimizerClass. 
PiperOrigin-RevId: 308776729
 2020-04-28 00:37:59 -07:00
A. Unique TensorFlower
9259ccb3d8 Do not record gradient_tape on gradient calculation. 
PiperOrigin-RevId: 308772699
 2020-04-27 23:57:23 -07:00
Keith Rush
463868e796 Relaxes dtype assumption in Gaussian DP sum query. 
PiperOrigin-RevId: 307846823
 2020-04-22 10:37:01 -07:00
A. Unique TensorFlower
c5c807807f Add assert that the training is private. 
In Keras training in TF 2.0+, compute_gradients() is not called but apply_gradients() is called. W/o calling compute_gradients() dp gradient is not computed, and a normal gradient is used.

PiperOrigin-RevId: 307822742
 2020-04-22 08:35:41 -07:00
A. Unique TensorFlower
f7b4a30120 Merge pull request #89 from woodyx218:GDPrivacy 
PiperOrigin-RevId: 307695867
 2020-04-21 15:48:54 -07:00
Steve Chien
264820cb3f Automated rollback of changelist 306513264 
PiperOrigin-RevId: 307694393
 2020-04-21 15:38:12 -07:00
A. Unique TensorFlower
9627cc0ed8 COPYBARA_INTEGRATE_REVIEW=https://github.com/tensorflow/privacy/pull/89 from woodyx218:GDPrivacy d06340e1cf 
PiperOrigin-RevId: 306534693
 2020-04-15 08:31:10 -07:00
Shuang Song
0c2747462f Internal change. 
PiperOrigin-RevId: 302557220
 2020-03-23 17:41:25 -07:00
A. Unique TensorFlower
2301931725 Fix issue with importing tensorflow.compat.v1. 
PiperOrigin-RevId: 300175680
 2020-03-10 14:16:46 -07:00
A. Unique TensorFlower
6541960e79 Automated refactoring to make code Python 3 compatible. 
PiperOrigin-RevId: 299961805
 2020-03-09 16:19:53 -07:00
A. Unique TensorFlower
e002cc9a23 Automated refactoring to make code Python 3 compatible. 
PiperOrigin-RevId: 299951850
 2020-03-09 15:35:52 -07:00
A. Unique TensorFlower
fa9ed85f37 Automated refactoring to make code Python 3 compatible. 
PiperOrigin-RevId: 299935369
 2020-03-09 14:26:58 -07:00
A. Unique TensorFlower
f3672adf80 Explicitly disable Tensorflow v2 behaviors for all TF1.x binaries and tests 
PiperOrigin-RevId: 299397784
 2020-03-06 11:29:06 -08:00
Yanhua Sun
b0df24ef25 Explicitly replace "import tensorflow" with "tensorflow.compat.v1" for TF2.x migration 
PiperOrigin-RevId: 297199727
 2020-02-25 14:11:47 -08:00
woodyx218
b9b2e8670f
Move doc str below functions 2020-02-21 09:30:30 -05:00
Galen Andrew
945075a136 Fix num_records in quantile_adaptive_clip_sum_query_test. 
PiperOrigin-RevId: 292995170
 2020-02-07 10:19:08 -08:00
Galen Andrew
9bb3c1e6d8 A few new features for QuantileAdaptiveClipSumQuery. 
1. Remove redundant global_state.l2_norm_clip from QuantileAdaptiveClipSumQuery.
2. Simplify accumulation code by deriving from SumAggregationDPQuery.
3. Add geometric update option to QuantileAdaptiveClipAverageQuery.

PiperOrigin-RevId: 292442733
 2020-02-07 10:18:57 -08:00
Yanhua Sun
856eda3aa1 Explicitly replace "import tensorflow" with "tensorflow.compat.v1" 
PiperOrigin-RevId: 290355582
 2020-02-07 10:18:46 -08:00
woodyx218
7b72e8a11b
Add files via upload 2020-01-22 10:29:25 +08:00
woodyx218
2ef5c6e332
Add files via upload 2020-01-19 20:29:37 +08:00
woodyx218
0b01471497
Delete GDprivacy_accountants.py 2020-01-19 20:28:05 +08:00
Keith Rush
a8a2d91795 Move TF privacy off contrib. 
PiperOrigin-RevId: 289953826
 2020-01-15 15:47:21 -08:00
Galen Andrew
c80a862ae2 Remove tf.contrib.framework. 
PiperOrigin-RevId: 289487098
 2020-01-13 11:48:35 -08:00
woodyx218
cbce4540d3
Initial commit 2020-01-02 16:36:31 +08:00
Galen Andrew
8d98c3433b Add geometric updating for quantile-based adaptive clipping. 
PiperOrigin-RevId: 285799976
 2019-12-16 10:29:50 -08:00
Steve Chien
d69879d360 Changes to make Tensorflow Privacy compatible with TF 2.0. 
PiperOrigin-RevId: 277561553
 2019-10-30 12:33:02 -07:00
Steve Chien
2007aac912 Allow compute_dp_sgd_privacy to be called as library function. 
PiperOrigin-RevId: 275966906
 2019-10-21 18:10:05 -07:00
Steve Chien
1ce8cd4032 Restructure TF Privacy to be more in line with other repos in the TF ecosystem. 
PiperOrigin-RevId: 274674077
 2019-10-14 15:29:52 -07:00
Steve Chien
6c03ce49fd Add tensorflow_privacy/ to list of git_files. 
PiperOrigin-RevId: 274022715
 2019-10-10 13:09:04 -07:00
Steve Chien
b125e3a686 Add new top-level directory to GitHub repo, and add __init__.py file at top level. This makes the structure more consistent with other repos in the Google Tensorflow ecosystem. 
PiperOrigin-RevId: 273803458
 2019-10-09 13:15:10 -07:00
Steve Chien
313edfc80c Update setup.py to new release. 
PiperOrigin-RevId: 273569076
 2019-10-09 13:14:59 -07:00