Commit graph

803 commits

Author SHA1 Message Date
Michael Reneer
8a6827b27c Update to use TF 2.0 API in TensorFlow Privacy:
tf.logging -> Removed for absl
tf.assert_type -> tf.debugging.assert_type
tf.assert_less_equal -> tf.debugging.assert_less_equal
tf.global_norm -> tf.linalg.global_norm

PiperOrigin-RevId: 425730344
2022-02-01 15:29:09 -08:00
Shuang Song
438da5a09b For secret sharer exposures, allow more dictionary key types, and break ties for the same perplexities. Fix a bug in the test.
PiperOrigin-RevId: 425446829
2022-01-31 13:27:55 -08:00
Michael Reneer
fd242e76b9 Internal
PiperOrigin-RevId: 425430059
2022-01-31 12:17:02 -08:00
Michael Reneer
36b8ea34ef Internal
PiperOrigin-RevId: 424965569
2022-01-28 15:01:34 -08:00
Michael Reneer
25571aaf87 Fix up remaining lint and format in TensorFlow Privacy.
PiperOrigin-RevId: 424948247
2022-01-28 13:44:12 -08:00
Michael Reneer
dd31737cb7 Update the setup.py for TensorFlow Privacy.
* Removed stale documentation.
* Updated to read version from the `version.py` module.
* Remove test only dependency.

PiperOrigin-RevId: 424932559
2022-01-28 12:34:01 -08:00
Michael Reneer
b37aef1751 Fixed some lint errors in TensorFlow Privacy.
* Fixed `g-backslash-continuation`
* Fixed `g-generic-assert`
* Fixed `g-generic-assert`
* Fixed `raise-missing-from`
* Fixed `unused-argument`

PiperOrigin-RevId: 424931881
2022-01-28 12:31:00 -08:00
Michael Reneer
e6536597c5 Fixed some lint errors in TensorFlow Privacy.
* Fixed `g-importing-member`
* Fixed `g-bad-import-order`

PiperOrigin-RevId: 424926847
2022-01-28 12:10:05 -08:00
Michael Reneer
943ef91ee9 Format TensorFlow Privacy files.
PiperOrigin-RevId: 424923635
2022-01-28 11:57:24 -08:00
Michael Reneer
07230a161a Internal
PiperOrigin-RevId: 424922009
2022-01-28 11:50:35 -08:00
Michael Reneer
7396ad62da Update TensorFlow Privacy to use Python 3 super().
PiperOrigin-RevId: 424916118
2022-01-28 11:26:34 -08:00
Michael Reneer
9050f18b59 Update TensorFlow Privacy to use Python 3 metaclass.
PiperOrigin-RevId: 424773127
2022-01-27 20:32:04 -08:00
Michael Reneer
b0803999ad Add license and missing build targets to __init__.py files in TensorFlow Privacy.
* Added license.
* Removed `.../membership_inference_attack/codelabs/__init__.py`, this code does not look like it needs to be part of the Python package.
* Removed `.../research/pate_2017/__init__.py`, this code does not look like it needs to be part of the Python package.

PiperOrigin-RevId: 424682641
2022-01-27 12:40:23 -08:00
Michael Reneer
c36ce6d799 Normalize mpmath imports in TensorFlow Privacy to be more friendly with strict dependencies and lint.
PiperOrigin-RevId: 424681602
2022-01-27 12:35:43 -08:00
Michael Reneer
81a11eb824 Remove the mock dependency from TensorFlow Privacy, this is now part of the Python standard library.
PiperOrigin-RevId: 424681527
2022-01-27 12:34:59 -08:00
Michael Reneer
a749ce4e30 Remove TensorFlow Privacy __future__ imports.
Note: Exclude changes to the research directory.
PiperOrigin-RevId: 424650953
2022-01-27 10:37:22 -08:00
Michael Reneer
cfb1b881d8 Normalize scipy imports in TensorFlow Privacy to be more friendly with strict dependencies and lint.
PiperOrigin-RevId: 424649853
2022-01-27 10:33:23 -08:00
Michael Reneer
47b439e376 Remove TensorFlow Privacy dependency on six.
Python 2 is not supported, please use Python 3.

PiperOrigin-RevId: 424435761
2022-01-26 13:56:30 -08:00
Michael Reneer
1424cb2418 Rename TensorFlow Privacy Python tests to have the name foo_test.
* Renamed Python test.
* Fixed usage of deprecated `assertRaisesRegexp`.

Python tooling pattern matches on file name, so it is important for tests to end with the suffix "_test" in order to interact with such tooling well.

In this case, these test are getting lint errors they should not and not getting lint errors they should.

PiperOrigin-RevId: 424433864
2022-01-26 13:48:31 -08:00
Michael Reneer
75f88f8120 Sort TensorFlow Privacy requirements and required dependencies.
Sorting alphabetically this can help keep these lists maintained, in sync, and current.

PiperOrigin-RevId: 424433354
2022-01-26 13:46:23 -08:00
Michael Reneer
28dbbbb9e5 Remove TensorFlow Privacy Python lint as directive.
This is now the default behavior.

PiperOrigin-RevId: 424403961
2022-01-26 11:47:14 -08:00
Michael Reneer
b309916927 Fix TensorFlow Privacy g-importing-member lint error.
PiperOrigin-RevId: 424356142
2022-01-26 08:40:57 -08:00
Michael Reneer
4b76e882bc Fix lint errors in dp_optimizer_test.
PiperOrigin-RevId: 424183036
2022-01-25 14:36:57 -08:00
Shuang Song
3a4c4400a6 For MIA in seq2seq model, add support for graph mode, add data information and fix small typo in seq2seq_membership_inference_codelab.ipynb.
PiperOrigin-RevId: 422909904
2022-01-19 14:50:48 -08:00
David Marn
f47200f60d Updates the path for seq2seq codelab colab button.
PiperOrigin-RevId: 421607919
2022-01-13 10:53:33 -08:00
Shuang Song
f301595ba5 Fix a bug in keras_evaluation and its example.
PiperOrigin-RevId: 420787967
2022-01-10 09:58:39 -08:00
Galen Andrew
867f3d4c55 Minor bug in tree aggregation accountant test.
PiperOrigin-RevId: 420145652
2022-01-06 14:32:52 -08:00
Galen Andrew
dd1e6f2d0c Automated rollback of commit 668afa892e
PiperOrigin-RevId: 419910568
2022-01-05 14:13:54 -08:00
Galen Andrew
668afa892e Migrate references to dp_event to Google DP libraries.
PiperOrigin-RevId: 419663382
2022-01-04 13:11:10 -08:00
Shuang Song
8d147bc9d7 For MIA plotting, allow customized plotting function and set equal x and y aspects.
PiperOrigin-RevId: 417852309
2021-12-22 11:08:54 -08:00
Steve Chien
c6576f60c4 Ensure that apply_gradients in dp_optimizer.py is using intended arguments for calls to superclass.
PiperOrigin-RevId: 417654563
2021-12-21 11:06:10 -08:00
Steve Chien
347b99d412 Apply fix to apply_gradients method in vectorized DP Keras optimizer that affected gradient aggregation in multi-replica training.
PiperOrigin-RevId: 417506496
2021-12-20 17:10:39 -08:00
A. Unique TensorFlower
31f110698d Fix of the apply_gradients in Keras DP optimizer.
PiperOrigin-RevId: 417503887
2021-12-20 16:52:50 -08:00
David Marn
03014d0e99 Adds an init file to secret sharer.
PiperOrigin-RevId: 416819054
2021-12-16 08:38:46 -08:00
Nicholas Carlini
f8d516c1c7
Merge branch 'tensorflow:master' into neuracrypt 2021-12-14 13:14:29 -08:00
Nicholas Carlini
42a4d1af8a
Merge branch 'tensorflow:master' into instahide 2021-12-14 13:00:43 -08:00
Nicholas Carlini
afe6ea7699
Merge branch 'tensorflow:master' into better-mi 2021-12-14 12:59:50 -08:00
Zheng Xu
38eface1fd zCDP for tree aggregation.
PiperOrigin-RevId: 416338656
2021-12-14 10:33:04 -08:00
Nicholas Carlini
bf9a58d26b Add citation 2021-12-14 00:59:37 +00:00
Nicholas Carlini
d2fda3ce1d Merge branch 'instahide' of github.com:carlini/privacy into instahide 2021-12-14 00:58:12 +00:00
Nicholas Carlini
a41549d103 Prettier README 2021-12-14 00:54:29 +00:00
Nicholas Carlini
7e40ad9704 Add code to reproduce Membership Inference Attacks From First Principles 2021-12-14 00:50:49 +00:00
Zheng Xu
8850c23f67 Move tree_aggregation accountant to their own module.
PiperOrigin-RevId: 414770173
2021-12-07 10:48:55 -08:00
Zheng Xu
245fd069ca RDP accounting for tree aggregation without restart. This implements the dynamic programming algorithm detailed in the updated version of "Practical and Private (Deep) Learning without Sampling or Shuffling"
https://arxiv.org/abs/2103.00039.

PiperOrigin-RevId: 414583453
2021-12-06 17:38:48 -08:00
A. Unique TensorFlower
49db04e356 Overwrite the get_config method for dp_optimizer to reflect the actual parameters required(noise_multiplier, l2_norm_clip)
PiperOrigin-RevId: 413520270
2021-12-01 15:06:31 -08:00
Wennan Zhu
290ecf7797 Create a hierarchical histogram IterativeProcess that is compatible with tff.backends.mapreduce.MapReduceForm.
PiperOrigin-RevId: 411845363
2021-11-23 10:38:16 -08:00
David Marn
7c4f5bab09 Allows one to run a test on probabilities alone.
PiperOrigin-RevId: 409095932
2021-11-11 02:17:00 -08:00
Zheng Xu
9757e1bc87 Update the tree aggregation RDP accounting for restarts. This prevents the potential inaccurate usage of the previous implementation for no-restarts.
PiperOrigin-RevId: 406878834
2021-11-01 11:39:49 -07:00
A. Unique TensorFlower
c5cb687507 Allow using gradient tape for gradient calculation in graph mode.
PiperOrigin-RevId: 406217961
2021-10-28 14:26:33 -07:00
Matthew Jagielski
62c51db99c fix variable names 2021-10-19 15:55:46 -07:00