| fa3fb289ba6a1718f9c76b2277a58f95f5e878ab |
|
08-Feb-2018 |
Anna R <annarev@google.com> |
Adding tf_export decorators/calls to TensorFlow functions and constants.
PiperOrigin-RevId: 185044705
/external/tensorflow/tensorflow/python/estimator/training.py
|
| fd63d4e30a01cf860baf60b990b223cd54bc895c |
|
29-Jan-2018 |
Yifei Feng <yifeif@google.com> |
Add C0326 bad-whitespace error to pylint sanity check.
PiperOrigin-RevId: 183689499
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 71896cc7e5bd3d1b8b5bb615eac7bebf86fa998c |
|
04-Jan-2018 |
Raghuraman Krishnamoorthi <raghuramank@google.com> |
Merge changes from github.
PiperOrigin-RevId: 180746153
/external/tensorflow/tensorflow/python/estimator/training.py
|
| c25694086e185e844e684ec196aa13667a7c2406 |
|
03-Jan-2018 |
Jianwei Xie <xiejw@google.com> |
Adds _TrainingExecutor.run method to automatically invoke correct procedure.
PiperOrigin-RevId: 180598558
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 3694595b93a282b2eda2b82bb25cc88dc637bc31 |
|
23-Dec-2017 |
Jianwei Xie <xiejw@google.com> |
Adds train_hooks into _TrainingExecutor.
PiperOrigin-RevId: 179978502
/external/tensorflow/tensorflow/python/estimator/training.py
|
| c11e07925a2c40ee220b9a3d76f82dc6ef17b87a |
|
17-Dec-2017 |
Jianwei Xie <xiejw@google.com> |
Introduce the ContinuousEvalListener
PiperOrigin-RevId: 179319836
/external/tensorflow/tensorflow/python/estimator/training.py
|
| b6ed812dbc87833a2f3076184cfe7d6fdbdba2fe |
|
06-Dec-2017 |
Jianwei Xie <xiejw@google.com> |
Sets the master to '' for single node cluster.
PiperOrigin-RevId: 178021454
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 355e25ebcab64e833dfc987638c3e6c79d838266 |
|
25-Oct-2017 |
Benoit Steiner <bsteiner@google.com> |
Merge changes from github.
END_PUBLIC
---
Commit 9f8523640 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update ops-related pbtxt files.
PiperOrigin-RevId: 173145770
---
Commit 01b6b0638 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Cut tracing memory cost
PiperOrigin-RevId: 173144626
---
Commit 5e23e0e67 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Erase cloned instructions on the fly when merging fusion nodes.
This avoids the awkward situation where an RNG which is clearly eligible for fusion becomes ineligible mid-fusion because it suddenly has an extra (dead) user.
PiperOrigin-RevId: 173141716
---
Commit 1038927c0 authored by Saurabh Saxena<srbs@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add SerializeIterator op that serializes an IteratorResource into a variant tensor.
Add DeserializeIterator op that builds IteratorResource from a variant tensor.
Move BundleReaderWrapper and BundleWriterWrapper from dataset.h to iterator_ops.cc.
Add generic key-value store interfaces IteratorStateReader and IteratorStateWriter for reading/writing state of iterators.
Get rid of IteratorBundleReader and IteratorBundleWriter.
PiperOrigin-RevId: 173140858
---
Commit 57f3e529d authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Internal change
PiperOrigin-RevId: 173136642
---
Commit 0e56ffb7b authored by Shanqing Cai<cais@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix breakages in OSS builds
See example breakages logs at:
http://ci.tensorflow.org/job/tensorflow-cl-cpu-python3-pip/10847/console
http://ci.tensorflow.org/job/tensorflow-cl-gpu/11008/console
1. CL/172477381 added the no_oss tag to tests with oss_serial tags, which broke the logic of OSS_SERIAL tests in pip.sh and run_pip_test.sh. This CL fixes that.
2. The nccl_kernels BUILD target in contrib/nccl/BUILD was missing some dependencies. This CL adds the missing ones.
Fixes: #13918
PiperOrigin-RevId: 173133914
---
Commit 3ed049b67 authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Allows calling keras layers in eager mode.
PiperOrigin-RevId: 173129805
---
Commit 4ec6f2b07 authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Switching contrib.summaries API to be context-manager-centric
PiperOrigin-RevId: 173129793
---
Commit 03b02ffc9 authored by Justine Tunney<jart@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Put Bazel mirror URLs first
PiperOrigin-RevId: 173127955
---
Commit 46ab25e4d authored by David Majnemer<majnemer@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[XLA] Add support for convolutions with no spatial dimensions
PiperOrigin-RevId: 173126950
---
Commit fc56349b7 authored by Derek Murray<mrry@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
[tf.data] Convert dataset arguments to tensors as early as possible.
This change raises a `TypeError` earlier if (for example) the `batch_size`
argument to `Dataset.batch()` has the incorrect type.
PiperOrigin-RevId: 173126678
---
Commit 4f7503a87 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
K-FAC: Support for registering multiple minibatches with register_fully_connected()
PiperOrigin-RevId: 173121735
---
Commit 2845bfcd6 authored by Tim Harley<tharley@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Avoid listing all modified Enter/RefEnter nodes on INFO, use VLOG(1) instead.
Leave a single, simple, message on INFO.
PiperOrigin-RevId: 173121726
---
Commit 434695921 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
K-FAC: _check_registration() supports multiple towers.
PiperOrigin-RevId: 173115870
---
Commit 670dddf4a authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Multi-minibatch support for
tf.contrib.kfac.fisher_blocks.FullyConnectedKFACBasicFB.
PiperOrigin-RevId: 173109677
---
Commit dc13a8e2f authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Fix import of meta graphs with partitioned variables into a scope.
Saver inspects SliceInfo to decide the variable name when creating a
checkpoint. Before this fix even if a partitioned variable ("weights")
was imported into a scope "a" it would still be checkpointed as ("weights")
instead of ("a/weights") since import_scoped_meta_graph was not adjusting
the SliceInfo.
WARNING: if you use import_meta_graph on graphs with partitioned_variables WITH an import_scope argument AND then create a Saver to write/read checkpoints this change
may break your checkpoint loading.
PiperOrigin-RevId: 173105796
---
Commit eea089bdb authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
K-FAC: Multi-tower support for ConvDiagonalFB.
PiperOrigin-RevId: 173105412
---
Commit 9b9cbbe2a authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Add int64 Tperm type support for `Transpose` (#13909)
* Add int64 Tperm type support for `Transpose`
This fix adds int64 Tperm support for `Transpose`. In
`array_ops.cc`, `Transpose` and `ConjugateTranspose`
have been specified as accepting int32 and int64 perm
types. However, only int32 kernels has been registered.
This fix adds the int64 perm support by removing
the constraint on Tperm, resolve the type at runtime,
and copying the data type accordingly to correctly handle
the int64/int32 types.
Additional tests have been added as well.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add test cases for int64 of perm in Transpose.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add namespace to hide PermutationHelper
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Enable use_gpu=True for perm type test.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* extra // namespace annotation
* Adding a comment about int32 casting that should be safe.
Permutations only contain values that refer to dimensions, and the maximum number of dimensions we have is 254, so an int32 is always safe here.
---
Commit ac0004e71 authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Add int64 shape support on GPU for stateless random ops. (#13908)
* Add int64 shape support on GPU for stateless random ops.
This fix adds int64 shape support on GPU for stateless random ops
`StatelessRandomUniform`, `StatelessRandomNormal`, `StatelessTruncatedNormal`.
The int64 shape for stateless random ops is already supported on CPU
with int32/int64 processed properly through `MakeShape`.
However, on GPU a type constraint `.TypeConstraint<int32>("T")`
has been improperly added. Such a type constraint actually prevents
an int64 shape type to run on GPU. (As a comparision, no type constraint
on CPU).
This fix removes the type constraint and allows int64 shape to be run on GPU.
This fix also adds test cases for int64 shape support on stateless random ops.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add test cases for int64 shape support for stateless random ops.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add int32 to shape types tested.
---
Commit 0d437c3be authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Add int64 padding support for MirrorPad (#13907)
* Add int64 padding support for MirrorPad
This fix adds int64 padding support for `MirrorPad`.
In the `array_ops.cc` the `MirrorPad`/`MirrorPadGrad`
has been specified as supporting int64 padding. The related
kernels does not have the int64 padding registered though.
This fix adds the int64 padding support. This fix also adds
additional test cases for coverage.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Update template for CPU and GPU support of int64 paddings.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add int64 padding support for MirrorPad
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Put eigen header first like before, just in case.
---
Commit 690003cc0 authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Add `int64` type `multiples` support for `tf.tile` (#13884)
* Add `int64` type `multiples` support for `tf.tile`
In the doc of `tf.tile` (tf.tile.__doc__) both `int32`
and `int64` are supported for `multiples`. However, the kernel
for `int64` is not registered yet.
This fix adds the support of `int64` `multiples` so that the
behavior matches the description of the docs.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Update functors for int64 multiples support in `tf.tile`
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Update test cases for int64 of multiples in `tf.tile`
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add GPU and non GPU tests
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* format with clang-format -i
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Move Tmultiples after T (as it is auxilliary)
And use `use_gpu=True`
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
---
Commit fd8d517b9 authored by Yunxing Dai<yunxing@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add tests for convolution 1D
RELNOTES: n/a
PiperOrigin-RevId: 173060283
---
Commit 40c475b48 authored by formath<jinpengliu@163.com>
Committed by Vijay Vasudevan<vrv@google.com>:
add segment_reduction_ops to tf_op_files (#13901)
---
Commit bfa4ec194 authored by Tayo Oguntebi<10927929+tayo@users.noreply.github.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Update node_def.proto comments (#13874)
The device field had outdated comments.
Note: We could consider adding tpu as an example here, e.g. "gpu" | "cpu" | "tpu". Thoughts?
---
Commit c9cb5a58d authored by formath<jinpengliu@163.com>
Committed by Vijay Vasudevan<vrv@google.com>:
protobuf lib path bug fix for benckmark on osx (#13878)
---
Commit 1c1dad105 authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Add int64 axis support for reduction ops. (#13891)
* Add int64 axis support for reduction ops.
This fix is a follow up to PR 13863. In PR 13863 the
program crash is fixed if int64 axis is passed to reduction ops,
e.g. reduce_sum, reduce_max, etc. However, 13863 does not
process the case of int64 support, it merely fixes the crash.
This fix adds the support for int64 axis of reduction ops.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add int64 axis support for mean, prod, sum
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add int64 axis support for min and max.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add int64 axis support for reduce_all and reduce_any
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add test cases for int64 axis support of reduce_any and reduce_all
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
---
Commit 17096081e authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Improve resize_bicubic performance by reorganizing loops (#13840)
* Improve resize_bicubic performance by reorganizing loops
This fix tries to address the issue raised in 13693 where
performance of `resize_bicubic` is not on par with opencv.
This fix rearranges the loops so that it is the same for
num_channel=40 and num_channel=3:
Pre-fix:
```
CHANNEL=40
opencv: 145.08ms
tf: 314.26ms
CHANNEL=3
opencv: 11.95ms
tf: 8.95ms
```
Post-fix:
```
CHANNEL=40
opencv: 144.25ms
tf: 214.55ms
CHANNEL=3
opencv: 11.78ms
tf: 14.07ms
```
This fix fixes 13693.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Keep special handling of `num_channels=3` for `resize_bicubic`
This commit keeps special handling of `num_channels=3` for
`resize_bicubic`:
Without special handling:
```
opencv: 11.78ms
tf: 14.07ms
```
With special handling:
```
opencv: 11.74ms
tf: 9.46ms
```
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Expand Benchmark test for resize_bicubic
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Update from review feedback.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
---
Commit b927df57f authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Update protobuf.cmake to b04e5cba356212e4e8c66c61bbe0c3a20537c5b9 (#13893)
This fix tries to address the issue raised in 8187 where
protobuf.cmake used different version as bazel.
The reason for discrepancy was due to the fact that a customerized
protobuf was needed with Windows patch. Since the patch has been
merged in (https://github.com/google/protobuf/pull/2203),
it makes sense to update protobuf.cmake so that the same version
of cmake is used.
This fix fixes 8187.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
---
Commit d1183ca6a authored by Vijay Vasudevan<vrv@google.com>
Committed by GitHub<noreply@github.com>:
Give each variable a unique name in accumulate_n_v2_eager_test. (#13886)
---
Commit a69945810 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Update pin for bazel-toolchains to latest version
PiperOrigin-RevId: 173002530
---
Commit 9d55c249c authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Fix doc in TF_CALL_ when invoked in mobile platform (#13881)
* Fix doc in TF_CALL_ when defined(IS_MOBILE_PLATFORM) && !defined(__ANDROID_TYPES_FULL__)
This is a small doc fix that includes bool as part of the types
that is supported in mobile (IS_MOBILE_PLATFORM && !__ANDROID_TYPES_FULL__),
as bool is clearly invoked in the following define.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Also add bool to android full version.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
---
Commit ba49d8583 authored by Bjarke Hammersholt Roune<broune@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Slight change to reduce_test to avoid generating inf, which was triggering an inf detector unnecessarily.
PiperOrigin-RevId: 172965466
---
Commit 93e8f3c67 authored by Anna R<annarev@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adding Python ApiDef overrides.
PiperOrigin-RevId: 172960496
---
Commit 0d6a2e353 authored by Anna R<annarev@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Internal change.
PiperOrigin-RevId: 172960439
---
Commit 62df65c72 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add dtype argument to Mean and Accuracy object-oriented metrics.
PiperOrigin-RevId: 172957714
---
Commit d7409d32b authored by Simone Cirillo<my.accounts@gmx.se>
Committed by Vijay Vasudevan<vrv@google.com>:
Fix import of spatial_softmax from tensorflow.contrib.layers (#13833)
---
Commit df8bce63d authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Fix crash when `int64` axis is passed to `tf.reduce_sum` (#13863)
* Fix crash when `int64` axis is passed to `tf.reduce_sum`
This fix tries to fix the crash triggered by `int64` axis passed
to `tf.reduce_sum`:
```
ubuntu@ubuntu:~/tensorflow2$ (cd && python)
Python 2.7.12 (default, Nov 19 2016, 06:48:10)
[GCC 5.4.0 20160609] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import tensorflow as tf
>>> v = tf.reduce_sum([1,2,3], tf.constant(0, tf.int64))
2017-10-20 15:55:06.993430: F tensorflow/core/framework/tensor.cc:601] Check failed: dtype() == expected_dtype (9 vs. 3)
ubuntu@ubuntu:~/tensorflow2$
```
The issue is caused by the fact that shape inference in `common_shape_fns.cc`
only assumes int32 without proper handling of diffent types. In `math_ops.cc`
both int32 and int64 are mentioned.
NOTE that this fix does not address the issue that int64 is not supported.
To allow int64 axis it is more than adding a template in `ReductionOp` as the type
of the axis seems to be decided by some other ways in Eigen.
This fix merely fixed the crash so that an error message will return without
exit from the python program "No OpKernel was registered to support Op 'Sum' with these attrs".
Still, I think its worth to at least allow the program to continue in case of unsupported kernel.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Update implementation with a template helper function.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
---
Commit 29c7b4658 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Adding the Stanford Tensorflow class to community resources.
PiperOrigin-RevId: 172956049
---
Commit f758b24a8 authored by Alexandre Passos<apassos@google.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Variable name for the eager test (#13873)
---
Commit a5fe66b15 authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Removed some unnecessary broadcasts in binary ops where only one input needs
broadcasting (which is a fairly common case, even in the fallback path).
PiperOrigin-RevId: 172950493
---
Commit c77090a0a authored by Yong Tang<yong.tang.github@outlook.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Fix issues where int64 crops could not be passed to batch_to_space. (#13862)
* Fix issues where int64 crops could not be passed to batch_to_space.
This fix tries to address the issue where int64 `crops` could
not be passed to `batch_to_space` even though both int32 and
int64 are specified as supported in the docs (tf.batch_to_space.__doc__)
The reason is that BatchToSpace kernel puts a constraint of int32 to crops
data types.
This fix removed the constraint so that int64 `crops` could be supported.
NOTE: Just removing the constraint should work and it is not necessary
to add specification to the kernel class template, as `SubtleMustCopyFlat`
called in the class already correctly handled both int32 and int64 cases.
Besides, other data types (e.g., float or double) will not be passed to the
kernel as they are guarded by the specification in `array_ops.cc`.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Also remove int64/int32 type constraints for SpaceToBatch kernels
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Add test cases for int64 crops of batch_to_space and space_to_batch
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
* Fix test failures.
Signed-off-by: Yong Tang <yong.tang.github@outlook.com>
---
Commit 494837936 authored by Joshua V. Dillon<jvdillon@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make `tf.contrib.distributions` quadrature family accept a `Tensor` for
`quadrature_grid_and_probs` argument.
PiperOrigin-RevId: 172950094
---
Commit 9c825d32c authored by Jinze Bai<baijinze1994@163.com>
Committed by Vijay Vasudevan<vrv@google.com>:
Merge two GPU kernel launching to one in DiagOp. (#13859)
---
Commit c0ca50a47 authored by Yan Facai (???)<facai.yan@gmail.com>
Committed by Vijay Vasudevan<vrv@google.com>:
ENH: add Relu6GradGrad (#13268)
* ENH: add Relu6GradGrad
* TST: add test case
* CLN: import nn_grad
* TST: add init value
---
Commit 8ff33271e authored by Justin Lebar<jlebar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Dump the computation's SessionModule as part of the tf_compile rule.
PiperOrigin-RevId: 172946149
---
Commit ebcae4a5e authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add streaming_precision_recall_at_equal_thresholds
This helper method computes streaming tp, fp, tn, fp, precision, and recall for the user in a way that exhibits O(T + N) time and space complexity (instead of O(T * N)), where T is the number of thresholds and N is the size of the predictions tensor.
Thanks to Frank Chu for the efficient algorithm!
PiperOrigin-RevId: 172946073
---
Commit ccfd9c1e5 authored by Sanjoy Das<sanjoy@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Log Hlo IR during AOT compilation
PiperOrigin-RevId: 172944165
---
Commit 985031a10 authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Allows tfe.enable_eager_execution(device_policy=tfe.DEVICE_POLICY_WARN).
PiperOrigin-RevId: 172943398
---
Commit 703182d85 authored by Mingxing Tan<tanmingxing@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Add performance guide for fused decode_and_crop_jpeg optimization.
PiperOrigin-RevId: 172943116
---
Commit 66b1f4383 authored by Francois Chollet<fchollet@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Make Network compatible with eager mode. Currently it only allows to instantiate a Network in eager mode using the regular Keras API, and call it on eager tensors.
PiperOrigin-RevId: 172942569
---
Commit 41df2cec2 authored by ashankar<ashankar@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Testing pending CL: 172939383
---
Commit 37fd95179 authored by Alexandre Passos<apassos@google.com>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
Simplifies capturing code in graph_callable to use recent function improvements.
PiperOrigin-RevId: 172937003
---
Commit d1e7382af authored by A. Unique TensorFlower<gardener@tensorflow.org>
Committed by TensorFlower Gardener<gardener@tensorflow.org>:
BEGIN_PUBLIC
Automated g4 rollback of changelist 172924803
PiperOrigin-RevId: 173347587
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 631d3434ff33debfd0bf46d9d8602172f549c82d |
|
05-Oct-2017 |
Jianwei Xie <xiejw@google.com> |
Adds throlle_secs into run_master
PiperOrigin-RevId: 171194766
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 6c875f0da3c61610063f705111b9bfa2e26ca52f |
|
05-Oct-2017 |
Igor Saprykin <isaprykin@google.com> |
Add the 'is_the_final_export' signal to Exporters.
Instead of adding the option to respect `is_the_final_export` into the `Exporter` that also does garbage collection, such exporter is split into two: `LatestExporter` and `FinalExporter`. There is a concern that options `exports_to_keep` and `only_the_final_export` overlap significantly and are somewhat in conflict. What does it mean to keep last 5 exports but only export the final one?
After splitting in two classes there is a lot of code duplication. The common implementation is gathered in a private base class.
When the training ends, the final export is performed via `Exporter.export()` call. That final export is going to have is_the_final_export parameter being set to true.
If `TrainSpec.max_steps` is `None`, then "when training ends" is undefined. We are going to train forever. In that case, `is_the_final_export` is going to be always False. I added a note about it.
PiperOrigin-RevId: 171185881
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 2f0787e1c8a7090fd231dac217e26824d8bc09c3 |
|
05-Oct-2017 |
Jianwei Xie <xiejw@google.com> |
Change all quotes for TF_CONFIG from ' to " as JSON requires that.
PiperOrigin-RevId: 171099341
/external/tensorflow/tensorflow/python/estimator/training.py
|
| fa86731b3dd081cf437fbeecbfcae30596c2873b |
|
05-Oct-2017 |
Igor Saprykin <isaprykin@google.com> |
Automated g4 rollback of changelist 171070760
PiperOrigin-RevId: 171089134
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 89df2e336218f7f3ecf2c70f8478c64985345ded |
|
05-Oct-2017 |
Igor Saprykin <isaprykin@google.com> |
Add the 'is_the_final_export' signal to Exporters. Use them in training.
When the training ends, the final export is performed via `Exporter.export()` call. That final export is going to have is_the_final_export parameter being set to true.
If `TrainSpec.max_steps` is `None`, then "when training ends" is undefined. We are going to train forever. In that case, `is_the_final_export` is going to be always False. I added a note about it.
PiperOrigin-RevId: 171070760
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 39565c0cbcd89a96a678e3453d3ab608d1293db1 |
|
04-Oct-2017 |
Martin Wicke <wicke@google.com> |
Publish train_and_evaluate and associated classes.
PiperOrigin-RevId: 171066379
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 943c6d7af7a8ccd4f824a2c0f90b251587c63fea |
|
04-Oct-2017 |
Jianwei Xie <xiejw@google.com> |
errors out if the evaluator has task id > 0.
PiperOrigin-RevId: 171047652
/external/tensorflow/tensorflow/python/estimator/training.py
|
| af14ed3f37d52220394fb9ff902ae62fd915dbe8 |
|
04-Oct-2017 |
Jianwei Xie <xiejw@google.com> |
Some docstring twists and argument validations.
PiperOrigin-RevId: 171037949
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 6a1b867ff939211673abe6ebe2d3989c74084403 |
|
04-Oct-2017 |
Jianwei Xie <xiejw@google.com> |
Adds the docstring with details for tf.estimator.train_and_evaluate
PiperOrigin-RevId: 171027527
/external/tensorflow/tensorflow/python/estimator/training.py
|
| de14fcbb67b1bfdfd595185fe91d395d932f9e0a |
|
04-Oct-2017 |
Igor Saprykin <isaprykin@google.com> |
Support evaluation in `_TrainingExecutor.run_master()`.
This CL aims to address the following TODO:
# TODO(b/66720832): Once listener API is added into Estimator.train, the
# eval and export process should be wrapped as a listener and passed to
# _start_distributed_training. The expected behavior should be
# 1. The export is invoked after each intermediate evaluation.
# 2. The evaluation and export should be invoked correctly at the end of
# training. This should be fine if the listener works as intended (it will
# send the `after_save` signal for the final ckpt saving).
1. is achieved as follows:
a. saving_evaluators are added to the CheckpointSaverHook's listeners inside the Estimator.
b. MonitoredSession calls after_run() of CheckpointSaverHook, which in turn calls after_save on the listeners.
2. is achieved in a similar way, but when MonitoredSession calls .end() on CheckpointSaverHook.
PiperOrigin-RevId: 170945961
/external/tensorflow/tensorflow/python/estimator/training.py
|
| ad37fa81fde6ab767cc6f2ec0b687f16d905705b |
|
04-Oct-2017 |
Igor Saprykin <isaprykin@google.com> |
Refactor ExportStrategies into Exporters.
This design eliminates some indirection. Instead of combining an `export_fn` with `make_export_strategy` call to arrive at an ExportStrategy that is going to call the supplied `export_fn` inside its `export` call with Exporters one just defines the `export` call in an Exporter.
PiperOrigin-RevId: 170936640
/external/tensorflow/tensorflow/python/estimator/training.py
|
| d0c76cd188401c3db251b89654ef085b08c28039 |
|
04-Oct-2017 |
Igor Saprykin <isaprykin@google.com> |
Handle the absence of a fresh eval checkpoint in `run_local`.
It is ~unexpected condition for an eval checkpoint to not be available after a train call to the estimator. There is a corner case when it is possible, but that's going to be resolved soon.
This case is handled for continuous (distributed) evaluation differently. Instead of erroring out, we skip evaluation runs. That behavior is captured in the `test_skip_evaluation_due_to_ckpt` test.
PiperOrigin-RevId: 170919925
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 435b31b9fcbb9aeeebf80ee7ca0a154a0e99b826 |
|
03-Oct-2017 |
Gunhan Gulsoy <gunan@google.com> |
Automated g4 rollback of changelist 170892257
PiperOrigin-RevId: 170919783
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 66df43d09c99207a06f4f697b9baa6a77857e565 |
|
04-Oct-2017 |
Igor Saprykin <isaprykin@google.com> |
Handle the absence of a fresh eval checkpoint in `run_local`.
It is ~unexpected condition for an eval checkpoint to not be available after a train call to the estimator. There is a corner case when it is possible, but that's going to be resolved soon.
This case is handled for continuous (distributed) evaluation differently. Instead of erroring out, we skip evaluation runs. That behavior is captured in the `test_skip_evaluation_due_to_ckpt` test.
PiperOrigin-RevId: 170919925
/external/tensorflow/tensorflow/python/estimator/training.py
|
| b3d6b40f7efa41d0c41c7156d21c3dda3feae2f0 |
|
03-Oct-2017 |
Jianwei Xie <xiejw@google.com> |
Adds strong validation on eval metrics returnes by `Estimator.evaluate`
PiperOrigin-RevId: 170804185
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 90dd85eed63fa7087ed99fb46ea771158ac523c2 |
|
30-Sep-2017 |
Jianwei Xie <xiejw@google.com> |
Internal change.
PiperOrigin-RevId: 170595295
/external/tensorflow/tensorflow/python/estimator/training.py
|
| f88bcfc6bd02b7065c4bfc3b401dd5b0a682922f |
|
30-Sep-2017 |
Igor Saprykin <isaprykin@google.com> |
Invoke export strategies when train_and_evaluate runs locally.
Previous changes export the model in accordance with the known export strategies when train_and_evaluate runs in the distributed mode. This change adds a similar support for the local mode.
PiperOrigin-RevId: 170546015
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 83b25cc924169a32a6abbbe01b0d737d67cb21bd |
|
28-Sep-2017 |
Igor Saprykin <isaprykin@google.com> |
Verify that TrainingExecutor's export strategies have unique names.
A name of an export strategy eventually gets used to come up with a directory name under the same root. If two export strategies write to the same directory, the files can theoretically collide.
PiperOrigin-RevId: 170394704
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 20370104cd8adf4c3f9068dfe95bde54cccadfa5 |
|
27-Sep-2017 |
Igor Saprykin <isaprykin@google.com> |
Support export strategies in _TrainingExecutor.
One could set export strategies to the EvalSpec. An exception is raised if the type isn't export_strategy.ExportStrategy. During continuous evaluation, export strategies are going to be triggered. They in turn call Estimator's export_savedmodel.
PiperOrigin-RevId: 170237073
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 8b9256106334c2c1a78765992b4f6e94e8074f4d |
|
27-Sep-2017 |
Jianwei Xie <xiejw@google.com> |
Adds implementation for tf.estimator.train_and_evaluate
PiperOrigin-RevId: 170207452
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 15361b88cefa72758baf0b8ac6cb797a24e64144 |
|
26-Sep-2017 |
Mustafa Ispir <ispir@google.com> |
Add latest_checkpoint to the estimator. Users of estimators do not need to know saver concept to query model_dir.
PiperOrigin-RevId: 169986086
/external/tensorflow/tensorflow/python/estimator/training.py
|
| dbaf176e1f09192612975378fbe86c59ef063051 |
|
25-Sep-2017 |
Jianwei Xie <xiejw@google.com> |
Adds a TODO for export strategy in run_locally.
PiperOrigin-RevId: 169921632
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 2957cd89481c0a6b07872335857af8baffd492e8 |
|
23-Sep-2017 |
Mustafa Ispir <ispir@google.com> |
Local run option of estimator training.
PiperOrigin-RevId: 169756384
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 847aa2fec14e7cdde140a3e5fdb0c3229caf9426 |
|
21-Sep-2017 |
Jianwei Xie <xiejw@google.com> |
Add run_ps in _TrainingExecutor.
PiperOrigin-RevId: 169597953
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 563c2a468fd3b82c38f8219f7019232e139e878e |
|
20-Sep-2017 |
Jianwei Xie <xiejw@google.com> |
Adds continuous evaluation (for distributed train and eval) into _TrainingExecutor.
PiperOrigin-RevId: 169329117
/external/tensorflow/tensorflow/python/estimator/training.py
|
| c28534e9a6a8fe59f21bb34722d933d15290c731 |
|
15-Sep-2017 |
Jianwei Xie <xiejw@google.com> |
Small fixes.
PiperOrigin-RevId: 168763346
/external/tensorflow/tensorflow/python/estimator/training.py
|
| c51ee957d80a9790d2121830112ea43d0758ca89 |
|
14-Sep-2017 |
Jianwei Xie <xiejw@google.com> |
Adds distributed training into TrainingExecutor.
PiperOrigin-RevId: 168725906
/external/tensorflow/tensorflow/python/estimator/training.py
|
| a4042cd2a46007a2a381e60562e6251f89854d3c |
|
11-Sep-2017 |
Jianwei Xie <xiejw@google.com> |
Introduces the placeholder for _TrainingExecutor, which serves the implementation of tf.estimator.train_and_evaluate.
PiperOrigin-RevId: 168240151
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 67a7cbc283024fa430c7fe2c2304128510fae462 |
|
10-Sep-2017 |
Jianwei Xie <xiejw@google.com> |
Changed the default eval throttle secs from 2 min to 10 mins.
PiperOrigin-RevId: 168120323
/external/tensorflow/tensorflow/python/estimator/training.py
|
| 86f1713e518c0d7973426b8b3e4d16b6158f5575 |
|
08-Sep-2017 |
Jianwei Xie <xiejw@google.com> |
Introduces TrainSpec and EvalSpec.
PiperOrigin-RevId: 168040435
/external/tensorflow/tensorflow/python/estimator/training.py
|