This repository was archived by the owner on Jan 11, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 9
Expand file tree
/
Copy pathArxivArchitecture.txt
More file actions
executable file
·2007 lines (2006 loc) · 249 KB
/
Copy pathArxivArchitecture.txt
File metadata and controls
executable file
·2007 lines (2006 loc) · 249 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
If there are any errors
please Abort, and run `arxiv_required` for required package installation, and start again
Please wait while we phrase the requested information from global arxiv[arxiv.org] servers
------------>
---------------------------->
------------------------------------------------------>
Listening for Sirens: Locating and Classifying Acoustic Alarms in City Scenes (Letizia Marchegiani - 11 October, 2018)
Lastly, we use the denoised signals to localise the acoustic source on the horizon plane, by regressing the direction of arrival of the sound through a CNN architecture. Our experimental evaluation shows an average classification rate of 94%, and a median absolute error on the localisation of 7.5° when operating on audio frames of 0.5s, and of 2.5° when operating on frames of 2.5s
Link: https://arxiv.org/abs/1810.04989
====================================================
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (Jacob Devlin - 10 October, 2018)
As a result, the pre-trained BERT representations can be fine-tuned with just one additional output layer to create state-of-the-art models for a wide range of tasks, such as question answering and language inference, without substantial task-specific architecture modifications.
Link: https://arxiv.org/abs/1810.04805
====================================================
Deep Inertial Poser: Learning to Reconstruct Human Pose from Sparse Inertial Measurements in Real Time (Yinghao Huang - 10 October, 2018)
A bi-directional RNN architecture leverages past and future information that is available at training time. To evaluate our method, we recorded DIP-IMU, a dataset consisting of $10$ subjects wearing 17 IMUs for validation in $64$ sequences with $330\,000$ time instants; this constitutes the largest IMU dataset publicly available
Link: https://arxiv.org/abs/1810.04703
====================================================
Multimodal Speech Emotion Recognition Using Audio and Text (Seunghyun Yoon - 10 October, 2018)
This architecture analyzes speech data from the signal level to the language level, and it thus utilizes the information within the data more comprehensively than models that focus on audio features. Our proposed model outperforms previous state-of-the-art methods in assigning data to one of four emotion categories (i.e., angry, happy, sad and neutral) when the model is applied to the IEMOCAP dataset, as reflected by accuracies ranging from 68.8% to 71.8%.
Link: https://arxiv.org/abs/1810.04635
====================================================
Adding 32-bit Mode to the ACL2 Model of the x86 ISA (Alessandro Coglio - 9 October, 2018)
The ACL2 model of the x86 Instruction Set Architecture was built for the 64-bit mode of operation of the processor
Link: https://arxiv.org/abs/1810.04313
====================================================
Inter-Scanner Harmonization of High Angular Resolution DW-MRI using Null Space Deep Learning (Vishwesh Nath - 9 October, 2018)
To use these data, we propose a new network architecture, the null space deep network (NSDN), to simultaneously learn on traditional observed/truth pairs (e.g., MRI-histology voxels) along with repeated observations without a known truth (e.g., scan-rescan MRI). NSDN significantly improved absolute performance relative to histology by 3.87% over CSD and 1.42% over a recently proposed deep neural network approach. More-over, it improved reproducibility on the paired data by 21.19% over CSD and 10.09% over a recently proposed deep approach. Finally, NSDN improved gen-eralizability of the model to a third in vivo human scanner (which was not used in training) by 16.08% over CSD and 10.41% over a recently proposed deep learn-ing approach
Link: https://arxiv.org/abs/1810.04260
====================================================
Geometry meets semantics for semi-supervised monocular depth estimation (Pierluigi Zama Ramirez - 9 October, 2018)
For inference, state-of-the-art encoder-decoder architectures for monocular depth estimation rely on effective feature representations learned at training time
Link: https://arxiv.org/abs/1810.04093
====================================================
A Distributed Reinforcement Learning Solution With Knowledge Transfer Capability for A Bike Rebalancing Problem (Ian Xiao - 9 October, 2018)
Motivated by such problem and the lack of smart autonomous solutions in this area, this project explored a new RL architecture called Distributed RL (DiRL) with Transfer Learning (TL) capability. DiRL achieved a 350% improvement in bike rebalancing autonomously and TL offered a 62.4% performance boost in managing an entire bike network
Link: https://arxiv.org/abs/1810.04058
====================================================
Deep Geodesic Learning for Segmentation and Anatomical Landmarking (Neslisah Torosdagli - 6 October, 2018)
In step 1, we propose a deep neu- ral network architecture with carefully designed regularization, and network hyper-parameters to perform image segmentation without the need for data augmentation and complex post- processing refinement. In step 2, we formulate the landmark localization problem directly on the geodesic space for sparsely- spaced anatomical landmarks. In step 3, we propose to use a long short-term memory (LSTM) network to identify closely- spaced landmarks, which is rather difficult to obtain using other standard detection networks. We used a very challenging CBCT dataset of 50 patients with a high-degree of craniomaxillofacial (CMF) variability that is realistic in clinical practice. Complementary to the quantitative analysis, the qualitative visual inspection was conducted for distinct CBCT scans from 250 patients with high anatomical variability
Link: https://arxiv.org/abs/1810.04021
====================================================
Comparison of U-net-based Convolutional Neural Networks for Liver Segmentation in CT (Hans Meine - 9 October, 2018)
Using a set of 219 liver CT datasets with reference segmentations from liver surgery planning, we evaluate the performance of several neural network classifiers based on 2D and 3D U-net architectures. An interesting observation is that slice-wise approaches perform surprisingly well, with mean and median Dice coefficients above 0.97, and may be preferable over 3D approaches given current hardware and software limitations.
Link: https://arxiv.org/abs/1810.04017
====================================================
Glioma Segmentation with Cascaded Unet (Dmitry Lachinov - 9 October, 2018)
Similar to recent methods for object detection, our implementation is based on neural networks; we propose modifications to the 3D UNet architecture and augmentation strategy to efficiently handle multimodal MRI input, besides this we introduce approach to enhance segmentation quality with context obtained from models of the same topology operating on downscaled data. We evaluate presented approach on BraTS 2018 dataset and discuss results.
Link: https://arxiv.org/abs/1810.04008
====================================================
Towards Two-Dimensional Sequence to Sequence Model in Neural Machine Translation (Parnia Bahar - 9 October, 2018)
This work investigates an alternative model for neural machine translation (NMT) and proposes a novel architecture, where we employ a multi-dimensional long short-term memory (MDLSTM) for translation modeling. Our proposed topology shows consistent improvements over attention-based sequence to sequence model on two WMT 2017 tasks, German$\leftrightarrow$English.
Link: https://arxiv.org/abs/1810.03975
====================================================
Rate-Accuracy Trade-Off In Video Classification With Deep Convolutional Neural Networks (Mohammad Jubran - 27 September, 2018)
Based on three CNN architectures and two action recognition datasets, we achieve 11%-94% saving in bitrate with marginal effect on classification accuracy. A model-based selection between multiple CNNs increases these savings further, to the point where, if up to 7% loss of accuracy can be tolerated, video classification can take place with as little as 3 kbps for the transport of the required compressed video information to the system implementing the CNN models.
Link: https://arxiv.org/abs/1810.03964
====================================================
Conditional Generative Refinement Adversarial Networks for Unbalanced Medical Image Semantic Segmentation (Mina Rezaei - 9 October, 2018)
The proposed architecture shows state-of-the-art results on LiTS-2017 for liver lesion segmentation, and two microscopic cell segmentation datasets MDA231, PhC-HeLa
Link: https://arxiv.org/abs/1810.03871
====================================================
Bootstrapped CNNs for Building Segmentation on RGB-D Aerial Imagery (Clint Sebastian - 8 October, 2018)
We train a detection algorithm from RGB-D images to obtain a segmented mask by using the CNN architecture DenseNet.First, we improve the performance of the model by applying a statistical re-sampling technique called Bootstrapping and demonstrate that more informative examples are retained. Second, the proposed method outperforms the non-bootstrapped version by utilizing only one-sixth of the original training data and it obtains a precision-recall break-even of 95.10% on our aerial imagery dataset.
Link: https://arxiv.org/abs/1810.03570
====================================================
NSGA-NET: A Multi-Objective Genetic Algorithm for Neural Architecture Search (Zhichao Lu - 8 October, 2018)
Experimental results suggest that combining the objectives of minimizing both an error metric and computational complexity, as measured by FLOPS, allows NSGA-Net to find competitive neural architectures near the Pareto front of both objectives on two different tasks, object classification and object alignment. NSGA-Net obtains networks that achieve 3.72% (at 4.5 million FLOP) error on CIFAR-10 classification and 8.64% (at 26.6 million FLOP) error on the CMU-Car alignment task
Link: https://arxiv.org/abs/1810.03522
====================================================
A Vertical PRF Architecture for Microblog Search (Flávio Martins - 8 October, 2018)
Thus, the proposed query expansion method uses a distributed search architecture and resource selection algorithms to provide an efficient query expansion process. Experiments on the TREC Microblog datasets show that the proposed approach can match or outperform standard PRF in MAP and NDCG@30, with a computational cost that is three orders of magnitude lower.
Link: https://arxiv.org/abs/1810.03519
====================================================
Multilingual sequence-to-sequence speech recognition: architecture, transfer learning, and language modeling (Jaejin Cho - 4 October, 2018)
We also explore different architectures for improving the prior multilingual seq2seq model. Experimental results show that the transfer learning approach from the multilingual model shows substantial gains over monolingual models across all 4 BABEL languages
Link: https://arxiv.org/abs/1810.03459
====================================================
Local Explanation Methods for Deep Neural Networks Lack Sensitivity to Parameter Values (Julius Adebayo - 8 October, 2018)
Our conjecture is that this phenomenon occurs because these explanations are dominated by the lower level features of a DNN, and that a DNN's architecture provides a strong prior which significantly affects the representations learned at these lower layers. NOTE: This work is now subsumed by our recent manuscript, Sanity Checks for Saliency Maps (to appear NIPS 2018), where we expand on findings and address concerns raised in Sundararajan et al.
Link: https://arxiv.org/abs/1810.03307
====================================================
Light-Weight RefineNet for Real-Time Semantic Segmentation (Vladimir Nekrasov - 8 October, 2018)
In particular, we adapt a powerful semantic segmentation architecture, called RefineNet, into the more compact one, suitable even for tasks requiring real-time performance on high-resolution inputs. Our fastest model undergoes a significant speed-up boost from 20 FPS to 55 FPS on a generic GPU card on 512x512 inputs with solid 81.1% mean iou performance on the test set of PASCAL VOC, while our slowest model with 32 FPS (from original 17 FPS) shows 82.7% mean iou on the same dataset. Alternatively, we showcase that our approach is easily mixable with light-weight classification networks: we attain 79.2% mean iou on PASCAL VOC using a model that contains only 3.3M parameters and performs only 9.3B floating point operations.
Link: https://arxiv.org/abs/1810.03272
====================================================
Triple Attention Mixed Link Network for Single Image Super Resolution (Xi Cheng - 7 October, 2018)
However, existing architectures have limitations due to the less sophisticated structure along with less strong representational power. In this work, to significantly enhance the feature representation, we proposed Triple Attention mixed link Network (TAN) which consists of 1) three different aspects (i.e., kernel, spatial and channel) of attention mechanisms and 2) fu-sion of both powerful residual and dense connections (i.e., mixed link)
Link: https://arxiv.org/abs/1810.03254
====================================================
DeepGeo: Photo Localization with Deep Neural Network (Sudharshan Suresh - 6 October, 2018)
A deep neural network based on the ResNet architecture is trained, and four different strategies of incorporating low-level cardinality information are presented. This model achieves an accuracy 20 times better than chance on a test dataset, which rises to 71.87% when taking the best of top-5 guesses. The network also beats human subjects in 4 out of 5 rounds of GeoGuessr.
Link: https://arxiv.org/abs/1810.03077
====================================================
Deep convolutional Gaussian processes (Kenneth Blomqvist - 6 October, 2018)
We propose deep convolutional Gaussian processes, a deep Gaussian process architecture with convolutional structure. In particular, we improve CIFAR-10 accuracy by over 10 percentage points.
Link: https://arxiv.org/abs/1810.03052
====================================================
Understanding Recurrent Neural Architectures by Analyzing and Synthesizing Long Distance Dependencies in Benchmark Sequential Datasets (Abhijit Mahalunkar - 6 October, 2018)
At present, the state-of-the-art computational models across a range of sequential data processing tasks, including language modeling, are based on recurrent neural network architectures. Finally, we demonstrate how understanding the characteristics of the LDDs in a dataset can inform better hyper-parameter selection for current state-of-the-art recurrent neural architectures and also aid in understanding them...
Link: https://arxiv.org/abs/1810.02966
====================================================
Towards Self-Tuning Parameter Servers (Chris Liu - 6 October, 2018)
Parameter Server (PS) is a popular system architecture for large-scale machine learning systems; and by self-tuning we mean while a long-running ML job is iteratively training the expert-suggested model, the system is also iteratively learning which system setting is more efficient for that job and applies it online. Experiments show that our techniques can reduce the completion times of a variety of long-running TensorFlow jobs from 1.4x to 18x.
Link: https://arxiv.org/abs/1810.02935
====================================================
RCCNet: An Efficient Convolutional Neural Network for Histological Routine Colon Cancer Nuclei Classification (Shabbeer Basha S H - 30 September, 2018)
This paper proposes an efficient Convolutional Neural Network (CNN) based architecture for classification of histological routine colon cancer nuclei named as RCCNet. The proposed method has achieved a classification accuracy of 80.61% and 0.7887 weighted average F1 score
Link: https://arxiv.org/abs/1810.02797
====================================================
Robotics CTF (RCTF), a playground for robot hacking (Gorka Olalde Mendia - 1 October, 2018)
We describe the architecture of the RCTF and provide 9 scenarios where hackers can challenge the security of different robotic setups
Link: https://arxiv.org/abs/1810.02690
====================================================
A Comparative Survey of Optical Wireless Technologies: Architectures and Applications (Mostafa Zaman Chowdhury - 5 October, 2018)
We survey the key technologies for understanding OWC and present state-of-the-art criteria in aspects, such as classification, spectrum use, architecture, and applications
Link: https://arxiv.org/abs/1810.02594
====================================================
Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networks (Christopher Morris - 4 October, 2018)
In recent years, graph neural networks (GNNs) have emerged as a powerful neural architecture to learn vector representations of nodes and graphs in a supervised, end-to-end fashion. The following work investigates GNNs from a theoretical point of view and relates them to the $1$-dimensional Weisfeiler-Leman graph isomorphism heuristic ($1$-WL). We show that GNNs have the same expressiveness as the $1$-WL in terms of distinguishing non-isomorphic (sub-)graphs
Link: https://arxiv.org/abs/1810.02244
====================================================
Learning Finer-class Networks for Universal Representations (Julien Girard - 4 October, 2018)
We show that our method learns more universal representations than state-of-the-art, leading to significantly better results on 10 target-tasks from multiple domains, using several network architectures, either alone or combined with networks learned at a coarser semantic level.
Link: https://arxiv.org/abs/1810.02126
====================================================
Improving the Segmentation of Anatomical Structures in Chest Radiographs using U-Net with an ImageNet Pre-trained Encoder (Maayan Frid-Adar - 4 October, 2018)
In this paper we investigate the latest fully-convolutional architectures for the task of multi-class segmentation of the lungs field, heart and clavicles in a chest radiograph. We evaluate all models on a common benchmark of 247 X-ray images from the JSRT database and ground-truth segmentation masks from the SCR dataset. This model outperformed the current state-of-the-art methods tested on the same benchmark, with Jaccard overlap scores of 96.1% for lung fields, 90.6% for heart and 85.5% for clavicles.
Link: https://arxiv.org/abs/1810.02113
====================================================
Towards Fast and Energy-Efficient Binarized Neural Network Inference on FPGA (Cheng Fu - 4 October, 2018)
By analyzing local properties of images and the learned BNN kernel weights, we observe an average of $\sim$78% input similarity and $\sim$59% weight similarity among weight kernels, measured by our proposed metric in common network architectures
Link: https://arxiv.org/abs/1810.02068
====================================================
Domain Specific Approximation for Object Detection (Ting-Wu Chin - 3 October, 2018)
category-aware image size scaling and proposals scaling, for two state-of-the-art deep learning-based object detection meta-architectures. up to 7.5x speedup for dynamic domain-specific approximation
Link: https://arxiv.org/abs/1810.02010
====================================================
Understanding Weight Normalized Deep Neural Networks with Rectified Linear Units (Yixi Xu - 3 October, 2018)
In particular, for an $L_{1,\infty}$ weight normalized network, the approximation error can be controlled by the $L_1$ norm of the output layer, and the corresponding generalization error only depends on the architecture by the square root of the depth.
Link: https://arxiv.org/abs/1810.01877
====================================================
A Deep Learning Architecture for De-identification of Patient Notes: Implementation and Evaluation (Kaung Khin - 2 October, 2018)
We test this architecture on two gold standard datasets and show that the architecture achieves state-of-the-art performance on both data sets while also converging faster than other systems without the use of dictionaries or other knowledge sources.
Link: https://arxiv.org/abs/1810.01570
====================================================
On Self Modulation for Generative Adversarial Networks (Ting Chen - 2 October, 2018)
We propose and study an architectural modification, self-modulation, which improves GAN performance across different data sets, architectures, losses, regularizers, and hyperparameter settings. In a large-scale empirical study we observe a relative decrease of $5\%-35\%$ in FID. Furthermore, all else being equal, adding this modification to the generator leads to improved performance in $124/144$ ($86\%$) of the studied settings
Link: https://arxiv.org/abs/1810.01365
====================================================
FutureGAN: Anticipating the Future Frames of Video Sequences using Spatio-Temporal 3d Convolutions in Progressively Growing Autoencoder GANs (Sandra Aigner - 2 October, 2018)
Our approach extends the recently introduced progressive growing of GANs (PGGAN) architecture by Karras et al. [18]. We already achieve promising results for frame resolutions of 128 x 128 px over a variety of datasets ranging from synthetic to natural frame sequences, while theoretically not being limited to a specific frame resolution
Link: https://arxiv.org/abs/1810.01325
====================================================
Findings of the E2E NLG Challenge (OndÅej DuÅ¡ek - 2 October, 2018)
We compare 62 systems submitted by 17 institutions, covering a wide range of approaches, including machine learning architectures -- with the majority implementing sequence-to-sequence models (seq2seq) -- as well as systems based on grammatical rules and templates.
Link: https://arxiv.org/abs/1810.01170
====================================================
Training compact deep learning models for video classification using circulant matrices (Alexandre Araujo - 8 October, 2018)
We propose very compact models for video classification based on state-of-the-art network architectures such as Deep Bag-of-Frames, NetVLAD and NetFisherVectors
Link: https://arxiv.org/abs/1810.01140
====================================================
Performance Comparison of some Synchronous Adders (P Balasubramanian - 2 October, 2018)
The adder architectures mentioned were implemented by targeting a typical case PVT specification (high threshold voltage, supply voltage of 1.05V and operating temperature of 25 degrees Celsius) of the Synopsys 32/28nm CMOS technology
Link: https://arxiv.org/abs/1810.01115
====================================================
NU-LiteNet: Mobile Landmark Recognition using Convolutional Neural Networks (Chakkrit Termritthikun - 2 October, 2018)
This paper describes the development of the architecture of a new convolutional neural network model, NU-LiteNet. The model size of NU-LiteNet is therefore 2.6 times smaller than that of SqueezeNet
Link: https://arxiv.org/abs/1810.01074
====================================================
The Profiling Machine: Active Generalization over Knowledge (Filip Ilievski - 1 October, 2018)
We describe two generic state-of-the-art neural architectures that can be easily instantiated as profiling machines to generate expectations and applied to any kind of knowledge to fill gaps
Link: https://arxiv.org/abs/1810.00782
====================================================
Procedural Noise Adversarial Examples for Black-Box Attacks on Deep Neural Networks (Kenneth T. Co - 30 September, 2018)
We show that it is possible to construct practical black-box attacks with low computational cost against robust neural network architectures such as Inception v3 and Inception ResNet v2 on the ImageNet dataset. Perlin noise attacks achieve at least 90% top 1 error across all classifiers. More worryingly, we show that most Perlin noise perturbations are "universal" in that they generalize, as adversarial examples, across large portions of the dataset, with up to 73% of images misclassified using a single perturbation
Link: https://arxiv.org/abs/1810.00470
====================================================
Pseudo-Random Number Generation using Generative Adversarial Networks (Marcello De Bernardi - 30 September, 2018)
Furthermore, we showcase a number of interesting modifications to the standard GAN architecture. At best, subjected to the NIST test suite, the trained generator passed around 99% of test instances and 98% of overall tests, outperforming a number of standard non-cryptographic PRNGs.
Link: https://arxiv.org/abs/1810.00378
====================================================
Neural Entity Reasoner for Global Consistency in NER (Xiaoxiao Yin - 30 September, 2018)
2) the specific interaction-pooling mechanism, allowing it to connect each local word to multiple global entities, and 3) the deep architecture, allowing it to bootstrap the recognized entity set from coarse to fine
Link: https://arxiv.org/abs/1810.00347
====================================================
Resource Management in Fog/Edge Computing: A Survey (Cheol-Ho Hong - 29 September, 2018)
This article reviews publications as early as 1991, with 85% of the publications between 2013-2018, to identify and classify the architectures, infrastructure, and underlying algorithms for managing resources in fog/edge computing.
Link: https://arxiv.org/abs/1810.00305
====================================================
NICE: Noise Injection and Clamping Estimation for Neural Network Quantization (Chaim Baskin - 2 October, 2018)
This leads to state-of-the-art results on various regression and classification tasks, e.g., ImageNet classification with architectures such as ResNet-18/34/50 with low as 3-bit weights and activations
Link: https://arxiv.org/abs/1810.00162
====================================================
Optimization of Circuits for IBM's five-qubit Quantum Computers (Gerhard W. Dueck - 28 September, 2018)
Two architectures with five qubits, one with 16, and one with 20 qubits are available to run experiments. In this paper, we show how Clifford+T circuits can efficiently be mapped into the two IBM quantum computers with 5 qubits
Link: https://arxiv.org/abs/1810.00129
====================================================
Audio-Visual Speech Recognition With A Hybrid CTC/Attention Architecture (Stavros Petridis - 28 September, 2018)
To the best of our knowledge, this is the first time that such a hybrid architecture architecture is used for audio-visual recognition of speech. We use the LRS2 database and show that the proposed audio-visual model leads to an 1.3% absolute decrease in word error rate over the audio-only model and achieves the new state-of-the-art performance on LRS2 database (7% word error rate). We also observe that the audio-visual model significantly outperforms the audio-based model (up to 32.9% absolute improvement in word error rate) for several different types of noise as the signal-to-noise ratio decreases.
Link: https://arxiv.org/abs/1810.00108
====================================================
Celer Network: Bring Internet Scale to Every Blockchain (Mo Dong - 28 September, 2018)
Celer Network embraces a layered architecture with clean abstractions that enable rapid evolution of each individual component, including a generalized state channel and sidechain suite that supports fast and generic off-chain state transitions; a provably optimal value transfer routing mechanism that achieves an order of magnitude higher throughput compared to state-of-the-art solutions; a powerful development framework and runtime for off-chain applications; and a new cryptoeconomic model that provides network effect, stable liquidity, and high availability for the off-chain ecosystem.
Link: https://arxiv.org/abs/1810.00037
====================================================
Universal and Dynamic Locally Repairable Codes with Maximal Recoverability via Sum-Rank Codes (Umberto MartÃnez-Peñas - 28 September, 2018)
Furthermore, the local linear codes (thus the localities, local distances and local fields) can be efficiently and dynamically modified without global recoding or changes in architecture or outer code, while preserving MR, easily adapting to new hot and cold data. Reed-Solomon codes with local replication and Cartesian products are recovered from the given construction when $ r=1 $ and $ h = 0 $, respectively
Link: https://arxiv.org/abs/1809.11158
====================================================
Semantic Segmentation for Urban Planning Maps based on U-Net (Zhiling Guo - 30 September, 2018)
In this study, we select urban planning maps as a representative sample and investigate the feasibility of utilizing U-shape fully convolutional based architecture to perform end-to-end map semantic segmentation. The experimental results obtained from the test area in Shibuya district, Tokyo, demonstrate that our proposed method could achieve a very high Jaccard similarity coefficient of 93.63% and an overall accuracy of 99.36%
Link: https://arxiv.org/abs/1809.10862
====================================================
Adaptive Input Representations for Neural Language Modeling (Alexei Baevski - 30 September, 2018)
We perform a systematic comparison of popular choices for a self-attentional architecture. We achieve a new state of the art on the WikiText-103 benchmark of 20.51 perplexity, improving the next best known result by 8.7 perplexity. On the Billion word benchmark, we achieve a state of the art of 24.14 perplexity.
Link: https://arxiv.org/abs/1809.10853
====================================================
Using Multi-task and Transfer Learning to Solve Working Memory Tasks (T. S. Jayram - 28 September, 2018)
We propose a new architecture called Memory-Augmented Encoder-Solver (MAES) that enables transfer learning to solve complex working memory tasks adapted from cognitive psychology. We show by extensive experimentation that the trained MAES models achieve task-size generalization, i.e., they are capable of handling sequential inputs 50 times longer than seen during training, with appropriately large memory modules
Link: https://arxiv.org/abs/1809.10847
====================================================
Patient Risk Assessment and Warning Symptom Detection Using Deep Attention-Based Neural Networks (Ivan Girardi - 27 September, 2018)
We use an attention-based convolutional neural network architecture trained on 600,000 doctor notes in German. These approaches achieve 79% and 66% precision, respectively, but on a confidence threshold of 0.6, precision increases to 85% and 75%, respectively
Link: https://arxiv.org/abs/1809.10804
====================================================
nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation (Fabian Isensee - 27 September, 2018)
The adaptation of the U-Net to novel problems, however, comprises several degrees of freedom regarding the exact architecture, preprocessing, training and inference. At the time of manuscript submission, nnU-Net achieves the highest mean dice scores across all classes and seven phase 1 tasks (except class 1 in BrainTumour) in the online leaderboard of the challenge.
Link: https://arxiv.org/abs/1809.10486
====================================================
Image Reconstruction Using Deep Learning (Po-Yu Liu - 27 September, 2018)
The architecture incorporates a hybrid of convolutional and deconvolutional layers along with symmetric connections. The denoising network achieved statistically significant 0.38dB, 0.68dB, and 1.04dB average PSNR gains over benchmark traditional algorithms in experiments with image peak values 4, 2, and 1
Link: https://arxiv.org/abs/1809.10410
====================================================
Semantically Invariant Text-to-Image Generation (Shagan Sah - 26 September, 2018)
Our work ties these concepts together by creating an architecture that can enable bidirectional generation of images and text. Qualitative and quantitative evaluations demonstrate that MMVR improves upon existing text conditioned image generation results by over 20%, while integrating visual and text modalities.
Link: https://arxiv.org/abs/1809.10274
====================================================
Deeply Informed Neural Sampling for Robot Motion Planning (Ahmed H. Qureshi - 26 September, 2018)
DeepSMP's neural architecture comprises of a Contractive AutoEncoder which encodes given workspaces directly from a raw point cloud data, and a Dropout-based stochastic deep feedforward neural network which takes the workspace encoding, start and goal configuration, and iteratively generates feasible samples for SMPs to compute end-to-end collision-free optimal paths. The results show that on average our method is at least 7 times faster in point-mass and rigid-body case and about 28 times faster in 6-link robot case than the existing state-of-the-art.
Link: https://arxiv.org/abs/1809.10252
====================================================
High Performance Zero-Memory Overhead Direct Convolutions (Jiyuan Zhang - 19 September, 2018)
In this paper, we demonstrate that direct convolution, when implemented correctly, eliminates all memory overhead, and yields performance that is between 10% to 400% times better than existing high performance implementations of convolution layers on conventional and embedded CPU architectures
Link: https://arxiv.org/abs/1809.10170
====================================================
Developmental Bayesian Optimization of Black-Box with Visual Similarity-Based Transfer Learning (Amaury Depierre - 3 October, 2018)
This architecture allows a robot to optimize autonomously hyper-parameters that need to be tuned from any action and/or vision module, treated as a black-box. As example, the system has been used to optimized 9 continuous hyper-parameters of a professional software (Kamido) both in simulation and with a real robot (industrial robotic arm Fanuc) with a total of 13 different objects. The robot is able to find a good object-specific optimization in 68 (simulation) or 40 (real) trials. Moreover, with the real robot, we show that the method consistently outperforms the manual optimization from an expert with less than 2 hours of training time to achieve more than 88% of success.
Link: https://arxiv.org/abs/1809.10141
====================================================
Learning Navigation Behaviors End to End (Hao-Tien Lewis Chiang - 26 September, 2018)
We train these policies in small, static environments with Shaped-DDPG, an adaptation of the Deep Deterministic Policy Gradient (DDPG) reinforcement learning method which optimizes reward and network architecture. Over 500 meters of on-robot experiments show , these policies generalize to new environments and moving obstacles, are robust to sensor, actuator, and localization noise, and can serve as robust building blocks for larger navigation tasks. The path following and point and point policies are 83% and 56% more successful than the baseline, respectively.
Link: https://arxiv.org/abs/1809.10124
====================================================
Satellite Imagery Multiscale Rapid Detection with Windowed Networks (Adam Van Etten - 24 September, 2018)
airplanes versus airports) we find that using two different detectors at different scales is very effective with negligible runtime cost.We evaluate large test images at native resolution and find mAP scores of 0.2 to 0.8 for vehicle localization, with the YOLT architecture achieving both the highest mAP and fastest inference speed.
Link: https://arxiv.org/abs/1809.09978
====================================================
Public-Safety LTE: Communication Services, Standardization Status, and Disaster-Resilient Architecture (Zeeshan Kaleem - 26 September, 2018)
Simulation results verified that with DR-PSLTE architecture, delay is reduced by 20% as compared with the conventional centralized computing architecture.
Link: https://arxiv.org/abs/1809.09617
====================================================
Low Complexity Full Duplex MIMO: Novel Analog Cancellation Architectures and Transceiver Design (George C. Alexandropoulos - 22 September, 2018)
In this paper, we present two novel architectures for the analog canceller comprising of reduced number of cancellation elements, compared to the state of the art, and simple multiplexers for efficient signal routing among the transmit and receive radio frequency chains
Link: https://arxiv.org/abs/1809.09474
====================================================
An Efficient Framework for Implementing Persist Data Structures on Remote NVM (Teng Ma - 25 September, 2018)
In this architecture, the NVM devices can be shared by multiple servers and provide recoverable persistent data structures. Specifically, thanks to operation batching, local memory caching and efficient concurrency control, the throughput of operations on eight widely used data structures is improved by 6$\sim$22 $\times$ without lowering the consistency promising.
Link: https://arxiv.org/abs/1809.09395
====================================================
Adaptive Resonant Beam Charging for Intelligent Wireless Power Transfer (Qingqing Zhang - 25 September, 2018)
Due to its open-loop architecture, RBC faces the challenge of providing dynamic current and voltage to optimize battery charging performance. Numerical evaluation demonstrates that ARBC can save 61% battery charging energy and 53%-60% supplied energy compared with RBC
Link: https://arxiv.org/abs/1809.09364
====================================================
Software for Sparse Tensor Decomposition on Emerging Computing Architectures (Eric Phipps - 24 September, 2018)
We show that we are competitive with state-of-the-art approaches available in the literature while having the advantage of being able to run on a wider of variety of architectures with a single code.
Link: https://arxiv.org/abs/1809.09175
====================================================
On Reinforcement Learning for Full-length Game of StarCraft (Zhen-Jia Pang - 23 September, 2018)
The reinforcement training algorithm for this architecture is also investigated. On a 64x64 map and using restrictive units, we achieve a winning rate of more than 99\% against the difficulty level-1 built-in AI. Through the curriculum transfer learning algorithm and a mixture of combat model, we can achieve over 93\% winning rate of Protoss against the most difficult non-cheating built-in AI (level-7) of Terran, training within two days using a single machine with only 48 CPU cores and 8 K40 GPUs
Link: https://arxiv.org/abs/1809.09095
====================================================
Deep Confidence: A Computationally Efficient Framework for Calculating Reliable Errors for Deep Neural Networks (Isidro Cortes-Ciriano - 24 September, 2018)
Deep learning architectures have proved versatile in a number of drug discovery applications, including the modelling of in vitro compound activity. Using a set of 24 diverse IC50 data sets from ChEMBL 23, we show that Snapshot Ensembles perform on par with Random Forest (RF) and ensembles of independently trained deep neural networks
Link: https://arxiv.org/abs/1809.09060
====================================================
Internet of NanoThings: Concepts and Applications (Ebtesam Almazrouei - 20 September, 2018)
Section 2 describes Internet of NanoThing(IoNT), its network architecture, and the challenges of nanoscale communication which is essential for enabling IoNT. Section 3 gives some practical applications of IoNT
Link: https://arxiv.org/abs/1809.08914
====================================================
Person Identification using Seismic Signals generated from Footfalls (Bodhibrata Mukhopadhyay - 24 September, 2018)
This paper presents a Fog computing architecture for implementing footfall based biometric system using widespread geographically distributed geophones (vibration sensor). We have tested our biometric system on an indigenous database (created by us) containing 46000 footfall events from 8 individuals and achieved an accuracy of 73%, 90% and 95% in case of 1, 5 and 10 footsteps per sample. DS8BP compresses the original footfall events (sampled at 8 kHz) by a factor of 108 and also acts as a smoothing filter
Link: https://arxiv.org/abs/1809.08783
====================================================
Image Denoising and Super-Resolution using Residual Learning of Deep Convolutional Network (Rohit Pardasani - 21 September, 2018)
Our model nearly replicates the architecture of existing state-of-the-art deep learning models for super-resolution and denoising
Link: https://arxiv.org/abs/1809.08229
====================================================
SLIDER: Fast and Efficient Computation of Banded Sequence Alignment (Mohammed Alser - 18 September, 2018)
The second key idea is to design a hardware accelerator design that adopts modern FPGA (field-programmable gate array) architectures to fur-ther boost the performance of our algorithm. The addition of SLIDER as a pre-alignment step reduces the execution time of five state-of-the-art sequence align-ers by up to 18.8x
Link: https://arxiv.org/abs/1809.07858
====================================================
Design and Implementation of High-throughput PCIe with DMA Architecture between FPGA and PowerPC (Kun Cheng - 17 September, 2018)
The DMA architecture based on FPGA is compatible with the Xilinx PCIe core while the DMA architecture based on POWERPC is compatible with VxBus of VxWorks. The design is compatible with Xilinx FPGA Kintex Ultrascale Family, and operates with the Xilinx PCIe endpoint Generation 1 with lane configurations x8. A data throughput of more than 666 MBytes/s(memory write with data from FPGA to PowerPC) has been achieved with the single PCIe Gen1 x8 lanes endpoint of this design, PowerPC and FPGA can send memory write request to each other.
Link: https://arxiv.org/abs/1809.07702
====================================================
A Microbenchmark Characterization of the Emu Chick (Jeffrey Young - 7 September, 2018)
Our results demonstrate that for many basic operations the Emu Chick can use available memory bandwidth more efficiently than a more traditional, cache-based architecture although bandwidth usage suffers for computationally intensive workloads like SpMV. Moreover, the Emu Chick provides stable, predictable performance with up to 65% of the peak bandwidth utilization on a random-access pointer chasing benchmark with weak locality.
Link: https://arxiv.org/abs/1809.07696
====================================================
OxIOD: The Dataset for Deep Inertial Odometry (Changhao Chen - 20 September, 2018)
However, the lack of sufficient labelled data for training and testing various architectures limits the proliferation of adopting DNNs in IMU-based tasks. Our dataset contains 158 sequences totalling more than 42 km in total distance, much larger than previous inertial datasets
Link: https://arxiv.org/abs/1809.07491
====================================================
Faster Training of Mask R-CNN by Focusing on Instance Boundaries (Roland S. Zimmermann - 3 October, 2018)
While the computational costs are increased slightly, the increment is negligible considering the high computational cost of the Mask R-CNN architecture. In a default Mask R-CNN setup, we achieve a training speed up of 29% and an overall improvement of 8.1% on the MS COCO metrics compared to the baseline.
Link: https://arxiv.org/abs/1809.07069
====================================================
Exploring Visual Relationship for Image Captioning (Ting Yao - 19 September, 2018)
Specifically, we present Graph Convolutional Networks plus Long Short-Term Memory (dubbed as GCN-LSTM) architecture that novelly integrates both semantic and spatial object relationships into image encoder. More remarkably, GCN-LSTM increases CIDEr-D performance from 120.1% to 128.7% on COCO testing set.
Link: https://arxiv.org/abs/1809.07041
====================================================
Security and Protocol Exploit Analysis of the 5G Specifications (Roger Piqueras Jover - 20 September, 2018)
Moreover, the entire 5G security architecture relies on the assumption of impractical carrier and roaming agreements and the management of public keys from all global operators. The comparison with 4G LTE protocol exploits reveals that the 5G security specifications, as of Release 15, do not fully address the user privacy and network availability concerns, where one edge case can compromise the privacy, security and availability of 5G users and services.
Link: https://arxiv.org/abs/1809.06925
====================================================
3D segmentation of mandible from multisectional CT scans by convolutional neural networks (Bingjiang Qiu - 18 September, 2018)
The proposed convolutional neural network adopts the architecture of the U-Net and then combines the resulting 2D segmentations from three different planes into a 3D segmentation. We implement such a segmentation approach on 11 neck CT scans and then evaluate the performance. We achieve an average dice coefficient of $ 0.89 $ on two testing mandible segmentation
Link: https://arxiv.org/abs/1809.06752
====================================================
SECS: Efficient Deep Stream Processing via Class Skew Dichotomy (Boyuan Feng - 7 September, 2018)
Finally, we design a systematic framework, SECS, to dynamically detect class skew, processing interpretation and compilation, as well as select the most accurate architectures under the runtime resource budget. Extensive evaluations show that SECS can realize end-to-end classification speedups by a factor of 3x to 11x relative to state-of-the-art convolutional neural networks, at a higher accuracy.
Link: https://arxiv.org/abs/1809.06691
====================================================
GritNet 2: Real-Time Student Performance Prediction with Domain Adaptation (Byung-Hak Kim - 7 September, 2018)
In particular, we first review recently-developed GritNet architecture which is the current state of the art for student performance prediction problem, and introduce a new unsupervised domain adaptation method to transfer a GritNet trained on a past course to a new course without any (students' outcome) label
Link: https://arxiv.org/abs/1809.06686
====================================================
MBS: Macroblock Scaling for CNN Model Reduction (Yu-Hsun Lin - 18 September, 2018)
Our proposed macroblock scaling (MBS) algorithm can be applied to various CNN architectures to reduce their model size. These applicable models range from compact CNN models such as MobileNet (25.53% reduction, ImageNet) and ShuffleNet (20.74% reduction, ImageNet) to ultra-deep ones such as ResNet-101 (51.67% reduction, ImageNet) and ResNet-1202 (72.71% reduction, CIFAR-10) with negligible accuracy degradation
Link: https://arxiv.org/abs/1809.06569
====================================================
Scattering Networks for Hybrid Representation Learning (Edouard Oyallon - 17 September, 2018)
Indeed, using hybrid architectures, we achieve the best results with predefined representations to-date, while being competitive with end-to-end learned CNNs. Specifically, even applying a shallow cascade of small-windowed scattering coefficients followed by 1$\times$1-convolutions results in AlexNet accuracy on the ILSVRC2012 classification task. Moreover, by combining scattering networks with deep residual networks, we achieve a single-crop top-5 error of 11.4% on ILSVRC2012
Link: https://arxiv.org/abs/1809.06367
====================================================
Binary Classification of Alzheimer Disease using sMRI Imaging modality and Deep Learning (Ahsan Bin Tufail - 8 September, 2018)
In this study, by utilizing the concept of transfer learning in deep learning, we propose a classification framework to differentiate subjects with Clinical Dementia Rating (CDR) of zero from subjects with CDR greater than zero by using deep learning architectures such as Xception and Inception version 3 in the Keras deep learning library. The attained validation set accuracies are as high as 99.12% for the Inception version 3 network and 97.97% for the Xception network
Link: https://arxiv.org/abs/1809.06209
====================================================
DASNet: Reducing Pixel-level Annotations for Instance and Semantic Segmentation (Chuang Niu - 17 September, 2018)
Our architecture, named DASNet, consists of three modules: detection, attention, and segmentation. Our method demonstrates substantially improved performance compared to existing semi-supervised approaches on PASCAL VOC 2012 dataset.
Link: https://arxiv.org/abs/1809.06013
====================================================
FermiNets: Learning generative machines to generate efficient neural networks via generative synthesis (Alexander Wong - 16 September, 2018)
To tackle this challenge, we explore the following idea: Can we learn generative machines to automatically generate deep neural networks with efficient network architectures? In this study, we introduce the idea of generative synthesis, which is premised on the intricate interplay between a generator-inquisitor pair that work in tandem to garner insights and learn to generate highly efficient deep neural networks that best satisfies operational requirements. Experimental results for image classification, semantic segmentation, and object detection tasks illustrate the efficacy of generative synthesis in producing generators that automatically generate highly efficient deep neural networks (which we nickname FermiNets) with higher model efficiency and lower computational costs (reaching >10x more efficient and fewer multiply-accumulate operations than several tested state-of-the-art networks), as well as higher energy efficiency (reaching >4x improvements in image inferences per joule consumed on a Nvidia Tegra X2 mobile processor)
Link: https://arxiv.org/abs/1809.05989
====================================================
A Distributed Learning Architecture for Scientific Imaging Problems (A. Panousopoulou - 27 September, 2018)
We apply the resulting, Spark-compliant, architecture on two emerging use cases from the scientific imaging domain, namely: (a) the space variant deconvolution of galaxy imaging surveys (astrophysics), (b) the super-resolution based on coupled dictionary training (remote sensing). We conduct evaluation studies considering relevant datasets, and the results report at least 60\% improvement in time response against the conventional computing solutions
Link: https://arxiv.org/abs/1809.05956
====================================================
Comparison of Deep Learning and the Classical Machine Learning Algorithm for the Malware Detection (Mohit Sewak - 16 September, 2018)
We studied the performance of the classical RF and DNN with 2, 4 & 7 layers architectures with the four different feature sets, and found that irrespective of the features inputs, the classical RF accuracy outperforms the DNN.
Link: https://arxiv.org/abs/1809.05889
====================================================
An investigation of a deep learning based malware detection system (Mohit Sewak - 16 September, 2018)
In the investigation, we experiment with different combination of Deep Learning architectures including Auto-Encoders, and Deep Neural Networks with varying layers over Malicia malware dataset on which earlier studies have obtained an accuracy of (98%) with an acceptable False Positive Rates (1.07%). In our proposed approach, besides improving the previous best results (99.21% accuracy and a False Positive Rate of 0.19%) indicates that Deep Learning based systems could deliver an effective defense against malware
Link: https://arxiv.org/abs/1809.05888
====================================================
Accident Forecasting in CCTV Traffic Camera Videos (Ankit Shah - 15 September, 2018)
Finally, we demonstrate the performance of accident forecasting in our dataset using Faster R-CNN and an Accident LSTM architecture. We achieved an average of 1.359 seconds in terms of Time-To-Accident measure with an Average Precision of 47.36 %
Link: https://arxiv.org/abs/1809.05782
====================================================
OffsetNet: Deep Learning for Localization in the Lung using Rendered Images (Jake Sganga - 15 September, 2018)
In this paper, we introduce a deep learning architecture, called OffsetNet, to accurately localize a bronchoscope in the lung in real-time. After training on only 30 minutes of recorded camera images in conserved regions of a lung phantom, OffsetNet tracks the bronchoscope's motion on a held-out recording through these same regions at an update rate of 47 Hz and an average position error of 1.4 mm. After training on simulated images, OffsetNet tracks the bronchoscope's motion in less conserved regions at an average position error of 2.4 mm, which meets conservative thresholds required for successful tracking.
Link: https://arxiv.org/abs/1809.05645
====================================================
Ground Truth for training OCR engines on historical documents in German Fraktur and Early Modern Latin (Uwe Springmann - 14 September, 2018)
The special form of GT as line image/transcription pairs makes it directly usable to train state-of-the-art recognition models for OCR software employing recurring neural networks in LSTM architecture such as Tesseract 4 or OCRopus. We also provide some pretrained OCRopus models for subcorpora of our dataset yielding between 95\% (early printings) and 98\% (19th century Fraktur printings) character accuracy rates on unseen test cases, a Perl script to harmonize GT produced by different transcription rules, and give hints on how to construct GT for OCR purposes which has requirements that may differ from linguistically motivated transcriptions.
Link: https://arxiv.org/abs/1809.05501
====================================================
Multi-Kernel Diffusion CNNs for Graph-Based Learning on Point Clouds (Lasse Hansen - 14 September, 2018)
They are predestined to overcome certain limitations of conventional grid-based architectures and will enable efficient handling of point clouds or related graphical data representations, e.g. We validated our approach for learning point descriptors as well as semantic classification on real 3D point clouds of human poses and demonstrate an improvement from 85% to 95% in Dice overlap with our multi-kernel approach.
Link: https://arxiv.org/abs/1809.05370
====================================================
Deep CNN Frame Interpolation with Lessons Learned from Natural Language Processing (Kian Ghodoussi - 16 September, 2018)
From there, we demonstrate the effectiveness of our approach by presenting novel deep CNN frame interpolation architecture that is comparable to the state of the art interpolation models with a fraction of the complexity.
Link: https://arxiv.org/abs/1809.05286
====================================================
Full Workspace Generation of Serial-link Manipulators by Deep Learning based Jacobian Estimation (Peiyuan Liao - 13 September, 2018)
The architecture consists of two neural networks: an estimation net that approximates the manipulator Jacobian, and a confidence net that measures the confidence of the approximation. We also introduce M3 (Manipulability Maps of Manipulators), a MATLAB robotics library based on [2](RTB), the datasets generated by which are used by this work. Implementations of the algorithm (based on Keras[3]), including benchmark evaluation script, are available at https://github.com/liaopeiyuan/Jacobian-Estimation
Link: https://arxiv.org/abs/1809.05020
====================================================
Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapy (Stanislav Nikolov - 12 September, 2018)
Adopting a deep learning approach, we demonstrate a 3D U-Net architecture that achieves performance similar to experts in delineating a wide range of head and neck OARs. The model was trained on a dataset of 663 deidentified computed tomography (CT) scans acquired in routine clinical practice and segmented according to consensus OAR definitions. We demonstrate its generalisability through application to an independent test set of 24 CT scans available from The Cancer Imaging Archive collected at multiple international sites previously unseen to the model, each segmented by two independent experts and consisting of 21 OARs commonly segmented in clinical practice
Link: https://arxiv.org/abs/1809.04430
====================================================
Deep learning for time series classification: a review (Hassan Ismail Fawaz - 12 September, 2018)
In this article, we study the current state of the art performance of deep learning algorithms for TSC by presenting an empirical study of the most recent DNN architectures for TSC. We also provide an open source deep learning framework to the TSC community where we implemented each of the compared approaches and evaluated them on a univariate TSC benchmark (the UCR archive) and 12 multivariate time series datasets. By training 8,730 deep learning models on 97 time series datasets, we propose the most exhaustive study of DNNs for TSC to date.
Link: https://arxiv.org/abs/1809.04356
====================================================
Rapid Training of Very Large Ensembles of Diverse Neural Networks (Abdul Wasay - 12 September, 2018)
In particular, our approach trains an ensemble of $100$ variants of deep neural networks with diverse architectures up to $6 \times$ faster as compared to existing approaches
Link: https://arxiv.org/abs/1809.04270
====================================================
Searching for Efficient Multi-Scale Architectures for Dense Image Prediction (Liang-Chieh Chen - 11 September, 2018)
The design of neural network architectures is an important component for achieving state-of-the-art performance with machine learning systems across a broad array of tasks. Based on a survey of techniques in dense image prediction, we construct a recursive search space and demonstrate that even with efficient random search, we can identify architectures that outperform human-invented architectures and achieve state-of-the-art performance on three dense prediction tasks including 82.7\% on Cityscapes (street scene parsing), 71.3\% on PASCAL-Person-Part (person-part segmentation), and 87.9\% on PASCAL VOC 2012 (semantic image segmentation). Additionally, the resulting architecture is more computationally efficient, requiring half the parameters and half the computational cost as previous state of the art systems.
Link: https://arxiv.org/abs/1809.04184
====================================================
On-Demand TDMA for Energy Efficient Data Collection with LoRa and Wake-up Receiver (Rajeev Piyare - 11 September, 2018)
To overcome this drawback, we propose a heterogeneous network architecture and an energy-efficient On-demand TDMA communication scheme improving both the device lifetime and the data latency of standard LoRa networks. Experimental results show a data reliability of 100% and a round-trip latency on the order of milliseconds with end devices dissipating less than 46 mJ when active and 1.83 μW during periods of inactivity, lasting up to 3 years on a 1200 mAh Lithium battery.
Link: https://arxiv.org/abs/1809.04142
====================================================
Parallel Separable 3D Convolution for Video and Volumetric Data Understanding (Felix Gonda - 11 September, 2018)
Lastly, we empirically show that PmSCn is applicable to different backbone architectures, such as ResNet, DenseNet, and UNet, for different applications, such as video action recognition, MRI brain segmentation, and electron microscopy segmentation. In all three applications, we replace the 3D convolution layers in state-of-the art models with PmSCn and achieve around 14% improvement in test performance and 40% reduction in model size and on average.
Link: https://arxiv.org/abs/1809.04096
====================================================
On The Alignment Problem In Multi-Head Attention-Based Neural Machine Translation (Tamer Alkhouli - 11 September, 2018)
This work investigates the alignment problem in state-of-the-art multi-head attention models based on the transformer architecture. Using the proposed approach, we achieve up to $3.8$ % BLEU improvement when using the dictionary, in comparison to $2.4$ % BLEU in the baseline case. We also propose alignment pruning to speed up decoding in alignment-based neural machine translation (ANMT), which speeds up translation by a factor of $1.8$ without loss in translation performance. We carry out experiments on the shared WMT 2016 English$\to$Romanian news task and the BOLT Chinese$\to$English discussion forum task.
Link: https://arxiv.org/abs/1809.03985
====================================================
5G Massive MIMO Architectures: Self-Backhauled Small Cells versus Direct Access (Andrea Bonfante - 11 September, 2018)
In this paper, we focus on one of the key technologies for the fifth-generation wireless communication networks, massive multiple-input-multiple-output (mMIMO), by investigating two of its most relevant architectures: 1) to provide in-band wireless backhauling to a dense deployment of self-backhauled small cells (SCs) acting as communication relays to end-users, and 2) to provide direct wireless access (DA) to end-users. We find that the ad-hoc deployment of self-backhauled SCs closer to the users (UEs) with optimal resource partition and with directive antenna patterns, provides rate improvements for cell-edge UEs that amount to 30%, and a tenfold gain as compared to mMIMO DA architecture with pilot reuse 3 and reuse 1, respectively
Link: https://arxiv.org/abs/1809.03953
====================================================
UAV Aided Aerial-Ground IoT for Air Quality Sensing in Smart City: Architecture, Technologies and Implementation (Zhiwen Hu - 11 September, 2018)
The architecture of this system consists of four layers: the sensing layer to collect data, the transmission layer to enable bidirectional communications, the processing layer to analyze and process the data, and the presentation layer to provide graphic interface for users. Our implementation has been deployed in Peking University and Xidian University since February 2018, and has collected about 100 thousand effective data samples by June 2018.
Link: https://arxiv.org/abs/1809.03746
====================================================
Jointly Learning to See, Ask, and GuessWhat (Aashish Venkatesh - 10 September, 2018)
We show that the introduction of our new architecture combined with these learning regimes yields an increase of 19.5% in task success accuracy with respect to a baseline model that treats submodules independently. With this increase, we reach an accuracy comparable to state-of-the-art models that use reinforcement learning, with the advantage that our architecture is entirely differentiable and thus easier to train
Link: https://arxiv.org/abs/1809.03408
====================================================
A Comparison of CNN-based Face and Head Detectors for Real-Time Video Surveillance Applications (Le Thanh Nguyen-Meidine - 10 September, 2018)
This paper compares the accuracy and complexity of state-of-the-art CNN architectures that are suitable for face and head detection
Link: https://arxiv.org/abs/1809.03336
====================================================
Towards JointUD: Part-of-speech Tagging and Lemmatization using Recurrent Neural Networks (Gor Arakelyan - 10 September, 2018)
The results demonstrate the viability of the proposed multitask architecture, although its performance still remains far from state-of-the-art.
Link: https://arxiv.org/abs/1809.03211
====================================================
Shallow vs deep learning architectures for white matter lesion segmentation in the early stages of multiple sclerosis (Francesco La Rosa - 10 September, 2018)
In this work, we present a comparison of a shallow and a deep learning architecture for the automated segmentation of white matter lesions in MR images of multiple sclerosis patients. All methods were trained on 32 patients, and the evaluation was performed on a pure test set of 73 cases. Results show low lesion-wise false positives (30%) for the deep learning architecture, whereas the shallow architecture yields the best Dice coefficient (63%) and volume difference (19%). Combining both shallow and deep architectures further improves the lesion-wise metrics (69% and 26% lesion-wise true and false positive rate, respectively).
Link: https://arxiv.org/abs/1809.03185
====================================================
SHOMA at Parseme Shared Task on Automatic Identification of VMWEs: Neural Multiword Expression Tagging with High Generalisation (Shiva Taslimipoor - 9 September, 2018)
We employ a neural architecture comprising of convolutional and recurrent layers with the addition of an optional CRF layer at the top. It outperformed all participating systems in both open and closed tracks with the overall macro-average MWE-based F1 score of 58.09 averaged among all languages
Link: https://arxiv.org/abs/1809.03056
====================================================
A Neural Temporal Model for Human Motion Prediction (Anand Gopalakrishnan - 14 September, 2018)
Key aspects of our proposed system include: 1) a novel, two-level processing architecture that aids in generating planned trajectories, 2) a simple set of easily computable features that integrate simple derivative information into the model, and 3) a novel multi-objective loss function that helps the model to slowly progress from the simpler task of next-step prediction to the harder task of multi-step closed-loop prediction
Link: https://arxiv.org/abs/1809.03036
====================================================
Accelerating Viterbi Algorithm using Custom Instruction Approach (Waqar Ahmad - 8 September, 2018)
In this paper, we propose to utilize the custom instruction approach to efficiently implement the widely used Viterbi decoding algorithm by adding the assembly language instructions to the ISA of DLX, PicoJava II and NIOS II processors, which represent RISC, stack and FPGA-based soft-core processor architectures, respectively. By using the custom instruction approach, the execution time of the Viterbi algorithm is significantly improved by approximately 3 times for DLX and PicoJava II, and by 2 times for NIOS II.
Link: https://arxiv.org/abs/1809.02887
====================================================
A Supervised Learning Methodology for Real-Time Disguised Face Recognition in the Wild (Saumya Kumaar - 8 September, 2018)
Along the same lines, we propose a deep learning architecture for disguised facial recognition (DFR). The algorithm put forward in this paper detects 20 facial key-points in the first stage, using a 14-layered convolutional neural network (CNN). Our key-point feature prediction accuracy is 65% while the classification rate is 72.4%. Moreover, the architecture works at 19 FPS, thereby performing in almost real-time
Link: https://arxiv.org/abs/1809.02875
====================================================
Adversarial Learning for Image Forensics Deep Matching with Atrous Convolution (Yaqi Liu - 8 September, 2018)
In DMAC, atrous convolution is adopted to extract features with rich spatial information, the correlation layer based on the skip architecture is proposed to capture hierarchical features, and atrous spatial pyramid pooling is constructed to localize tampered regions at multiple scales. Extensive experiments, conducted on 21 generated testing sets and two public datasets, demonstrate the effectiveness of the proposed framework and the superior performance of DMAC.
Link: https://arxiv.org/abs/1809.02791
====================================================
Metamorphic Relation Based Adversarial Attacks on Differentiable Neural Computer (Alvin Chan - 7 September, 2018)
The unique architecture of DNC contributes to its state-of-the-art performance in tasks which requires the ability to represent variables and data structure as well as to store data over long timescales
Link: https://arxiv.org/abs/1809.02444
====================================================
Predicting Lung Nodule Malignancies by Combining Deep Convolutional Neural Network and Handcrafted Features (Shulong Li - 7 September, 2018)
We then trained 3D CNNs modified from three state-of-the-art 2D CNN architectures (AlexNet, VGG-16 Net and Multi-crop Net) to extract the CNN features learned at the output layer. For each 3D CNN, the CNN features combined with the 29 handcrafted features were used as the input for the support vector machine (SVM) coupled with the sequential forward feature selection (SFS) method to select the optimal feature subset and construct the classifiers. The patient cohort includes 431 malignant nodules and 795 benign nodules extracted from the LIDC/IDRI database
Link: https://arxiv.org/abs/1809.02333
====================================================
Cell-aware Stacked LSTMs for Modeling Sentences (Jihun Choi - 6 September, 2018)
We dub this architecture Cell-aware Stacked LSTM (CAS-LSTM) and show from experiments that our models achieve state-of-the-art results on benchmark datasets for natural language inference, paraphrase detection, and sentiment classification.
Link: https://arxiv.org/abs/1809.02279
====================================================
ProdSumNet: reducing model parameters in deep neural networks via product-of-sums matrix decompositions (Chai Wah Wu - 6 September, 2018)
As an example, by using this decomposition on a reference CNN architecture for MNIST with over 3x10^6 trainable parameters, we are able to obtain an accuracy of 98.44% using only 3554 trainable parameters.
Link: https://arxiv.org/abs/1809.02209
====================================================
A Benchmarking of DCM Based Architectures for Position and Velocity Controlled Walking of Humanoid Robots (Giulio Romualdi - 6 September, 2018)
We show which implementation of the above control architecture allows the robot to achieve a walking velocity of 0.41 meters per second.
Link: https://arxiv.org/abs/1809.02167
====================================================
Panoptic Segmentation with a Joint Semantic and Instance Segmentation Network (Daan de Geus - 6 September, 2018)
For instance segmentation, a Mask R-CNN type of architecture is used, while the semantic segmentation branch is augmented with a Pyramid Pooling Module. Results for this method are submitted to the COCO and Mapillary Joint Recognition Challenge 2018. Our approach achieves a PQ score of 17.6 on the Mapillary Vistas validation set and 27.2 on the COCO test-dev set.
Link: https://arxiv.org/abs/1809.02110
====================================================
Named Entity Recognition on Noisy Data using Images and Text (1-page abstract) (Diego Esteves - 3 September, 2018)
In this paper, we propose a novel multi-level architecture that does not rely on any specific linguistic resource or encoded rule. Experimental tests against state-of-the-art NER for Twitter on the Ritter dataset present competitive results (0.59 F-measure), indicating that this approach may lead towards better NER models.
Link: https://arxiv.org/abs/1809.01964
====================================================
Efficient Egocentric Visual Perception Combining Eye-tracking, a Software Retina and Deep Learning (Nina Hristozova - 5 September, 2018)
We present ongoing work to harness biological approaches to achieving highly efficient egocentric perception by combining the space-variant imaging architecture of the mammalian retina with Deep Learning methods. By pre-processing images collected by means of eye-tracking glasses to control the fixation locations of a software retina model, we demonstrate that we can reduce the input to a DCNN by a factor of 3, reduce the required number of training epochs and obtain over 98% classification rates when training and validating the system on a database of over 26,000 images of 9 object classes.
Link: https://arxiv.org/abs/1809.01633
====================================================
Bimodal network architectures for automatic generation of image annotation from text (Mehdi Moradi - 5 September, 2018)
There is a clear advantage obtained from the architecture with pre-trained imaging network. The centroids of the ROIs marked by this network were on average at a distance equivalent to 5.1% of the image width from the centroids of the ground truth ROIs.
Link: https://arxiv.org/abs/1809.01610
====================================================
CNNs-based Acoustic Scene Classification using Multi-Spectrogram Fusion and Label Expansions (Weiping Zheng - 5 September, 2018)
In the framework, a single CNN architecture is applied onto multiple spectrograms for feature extraction. Specifically, accuracies of 0.9744, 0.8865 and 0.7778 are obtained for the LITIS Rouen dataset, the DCASE Development set and Evaluation set respectively.
Link: https://arxiv.org/abs/1809.01543
====================================================
Image Manipulation with Perceptual Discriminators (Diana Sungatullina - 5 September, 2018)
We demonstrate the merits of the new architecture in a series of qualitative and quantitative comparisons with baseline approaches and state-of-the-art frameworks for unaligned image translation.
Link: https://arxiv.org/abs/1809.01396
====================================================
Retinal Vessel Segmentation under Extreme Low Annotation: A Generative Adversarial Network Approach (Avisek Lahiri - 5 September, 2018)
The proposed method is an extension of our previous work with the addition of a new unsupervised adversarial loss and a structured prediction based architecture. We experiment with extreme low annotation budget (0.8 - 1.6% of contemporary annotation size)
Link: https://arxiv.org/abs/1809.01348
====================================================
Unsupervised Statistical Machine Translation (Mikel Artetxe - 4 September, 2018)
Our method profits from the modular architecture of SMT: we first induce a phrase table from monolingual corpora through cross-lingual embedding mappings, combine it with an n-gram language model, and fine-tune hyperparameters through an unsupervised MERT variant. In addition, iterative backtranslation improves results further, yielding, for instance, 14.08 and 26.22 BLEU points in WMT 2014 English-German and English-French, respectively, an improvement of more than 7-10 BLEU points over previous unsupervised systems, and closing the gap with supervised SMT (Moses trained on Europarl) down to 2-5 BLEU points
Link: https://arxiv.org/abs/1809.01272
====================================================
Decentralized Search on Decentralized Web (Ziliang Lai - 18 August, 2018)
DWeb also clicks well with future Internet architectures, such as Named Data Networking (NDN).Search engines have been an inseparable element of the Web. Contemporary ("Web 2.0") search engines, however, provide centralized services
Link: https://arxiv.org/abs/1809.00939
====================================================
Automated Instruction Stream Throughput Prediction for Intel and AMD Microarchitectures (Jan Laukemann - 10 October, 2018)
We present the Open Source Architecture Code Analyzer (OSACA), a static analysis tool for predicting the execution time of sequential loops comprising x86 instructions under the assumption of an infinite first-level cache and perfect out-of-order scheduling
Link: https://arxiv.org/abs/1809.00912
====================================================
Image Reassembly Combining Deep Learning and Shortest Path Problem (M. -M. Paumard - 4 September, 2018)
The main contributions of this work are: 1) several deep neural architectures to predict the relative position of image fragments that outperform the previous state of the art; 2) casting the reassembly problem into the shortest path in a graph problem for which we provide several construction algorithms depending on available information; 3) a new dataset of images taken from the Metropolitan Museum of Art (MET) dedicated to image reassembly for which we provide a clear setup and a strong baseline.
Link: https://arxiv.org/abs/1809.00898
====================================================
Texar: A Modularized, Versatile, and Extensible Toolkit for Text Generation (Zhiting Hu - 4 September, 2018)
In Texar, model architecture, losses, and learning processes are fully decomposed. Texar is released under Apache license 2.0 at https://github.com/asyml/texar.
Link: https://arxiv.org/abs/1809.00794
====================================================
Programmable Memristive Threshold Logic Gate Array (Olga Krestinskaya - 2 September, 2018)
The proposed TLG array operation does not depend on input signal and time pulses, comparing to the existing architectures. The on-chip area and power dissipation of the simulated $3\times 4$ TLG array is $1463 μm^2$ and $425 μW$, respectively.
Link: https://arxiv.org/abs/1809.00419
====================================================
On the Role of Event Boundaries in Egocentric Activity Recognition from Photostreams (Alejandro Cartas - 6 September, 2018)
Furthermore, we collected a new annotated dataset acquired by 15 people by a wearable photo-camera and we used it to show the generalization capabilities of several deep learning based architectures to unseen users.
Link: https://arxiv.org/abs/1809.00402
====================================================
Learning to Navigate Autonomously in Outdoor Environments : MAVNet (Saumya Kumaar - 2 September, 2018)
Based on the Inception-v3 architecture, our system performs better in terms of processing complexity and accuracy than many existing models for imitation learning. With the extensive amount of drone data that we collected, we have been able to navigate successfully through roads without crashing or overshooting, with an accuracy of 98.44%
Link: https://arxiv.org/abs/1809.00396
====================================================
Evaluation of Neural Networks for Image Recognition Applications: Designing a 0-1 MILP Model of a CNN to create adversarials (Lucas Schelkes - 1 September, 2018)
We follow up on (Fischetti & Jo, December, 2017) and show how standard convolutional neural network can be optimized to a more sophisticated capsule architecture. 2. 3
Link: https://arxiv.org/abs/1809.00216
====================================================
3D Segmentation with Exponential Logarithmic Loss for Highly Unbalanced Object Sizes (Ken C. L. Wong - 24 September, 2018)
By combining skip connections and deep supervision with respect to the computational feasibility of 3D segmentation, we propose a fast converging and computationally efficient network architecture for accurate segmentation. We achieve an average Dice coefficient of 82% on brain segmentation with 20 labels, with the ratio of the smallest to largest object sizes as 0.14%. Less than 100 epochs are required to reach such accuracy, and segmenting a 128x128x128 volume only takes around 0.4 s.
Link: https://arxiv.org/abs/1809.00076
====================================================
Bioinspired Straight Walking Task-Space Planner (Carlo Tiseo - 31 August, 2018)
The data show that the proposed architecture can generate behaviour in line with human walking strategies for both the CoM and the foot swing. Moreover, being the planner able to generate a single stride in less than 140 ms and sequences of 10 strides in less than 600 ms, it allows an online task-space planning for locomotion
Link: https://arxiv.org/abs/1808.10799
====================================================
Ensemble Sequence Level Training for Multimodal MT: OSU-Baidu WMT18 Multimodal Machine Translation System Report (Renjie Zheng - 31 August, 2018)
Our systems ensemble several models using different architectures and training methods and achieve the best performance for three subtasks: En-De and En-Cs in task 1 and (En+De+Fr)-Cs task 1B.
Link: https://arxiv.org/abs/1808.10592
====================================================
Multi-Cell Multi-Task Convolutional Neural Networks for Diabetic Retinopathy Grading (Kang Zhou - 11 October, 2018)
Considering the resolution of retinal image is very high, where small pathological tissues can be detected only with large resolution image and large local receptive field are required to identify those late stage disease, but directly training a neural network with very deep architecture and high resolution image is both time computational expensive and difficult because of gradient vanishing/exploding problem, we propose a \textbf{Multi-Cell} architecture which gradually increases the depth of deep neural network and the resolution of input image, which both boosts the training time but also improves the classification accuracy. Experimental results on the Kaggle dataset show that our method achieves a Kappa of 0.841 on test set which is the 4-th rank of all state-of-the-arts methods
Link: https://arxiv.org/abs/1808.10564
====================================================
Total Recall: Understanding Traffic Signs using Deep Hierarchical Convolutional Neural Networks (Sourajit Saha - 30 August, 2018)
In this paper, we propose a novel and one-for-all architecture that aces multiple benchmarks with better overall score than the state-of-the-art architectures. With this we score 99.33% Accuracy in German sign recognition benchmark and 99.17% Accuracy in Belgian traffic sign classification benchmark
Link: https://arxiv.org/abs/1808.10524
====================================================
Contribution of Glottal Waveform in Speech Emotion: A Comparative Pairwise Investigation (Zhongzhe Xiao - 30 August, 2018)
In experiments of generation of a performance-driven hierarchical classifier architecture, and pairwise classification on individual emotional states, the low difference between accuracies obtained from speech signal and glottal signal proved that a majority of emotional cues in speech could be conveyed through glottal waveform. The best distinguishable emotional pair by glottal waveform is intense anger against moderate sadness, with the accuracy of 92.45%
Link: https://arxiv.org/abs/1808.10144
====================================================
The Impact of Preprocessing on Deep Representations for Iris Recognition on Unconstrained Environments (Luiz A. Zanlorensi - 29 August, 2018)
In this context, we propose the use of deep representations, more specifically, architectures based on VGG and ResNet-50 networks, for dealing with the images using (and not) iris segmentation and normalization. Our results show that the approach using non-normalized and only circle-delimited iris images reaches a new state of the art in the official protocol of the NICE.II competition, a subset of the UBIRIS database, one of the most challenging databases on unconstrained environments, reporting an average Equal Error Rate (EER) of 13.98% which represents an absolute reduction of about 5%.
Link: https://arxiv.org/abs/1808.10032
====================================================
MemComputing Integer Linear Programming (Fabio L. Traversa - 29 August, 2018)
We first describe a new circuit architecture of memcomputing machines specifically designed to solve for the linear inequalities representing a general ILP problem. We then show simulations of these machines using MATLAB running on a single core of a Xeon processor for several ILP benchmark problems taken from the MIPLIB 2010 library, and compare our results against a renowned commercial solver. In particular, we find within minutes feasible solutions for one of these hard problems (f2000 from MIPLIB 2010) whose feasibility, to the best of our knowledge, has remained unknown for the past eight years.
Link: https://arxiv.org/abs/1808.09999
====================================================
An Operation Sequence Model for Explainable Neural Machine Translation (Felix Stahlberg - 29 August, 2018)
Our technique can outperform a plain text system in terms of BLEU score under the recent Transformer architecture on Japanese-English and Portuguese-English, and is within 0.5 BLEU difference on Spanish-English.
Link: https://arxiv.org/abs/1808.09688
====================================================
Towards Semi-Supervised Learning for Deep Semantic Role Labeling (Sanket Vaibhav Mehta - 28 August, 2018)
On CoNLL-2012 English section, the proposed semi-supervised training with 1%, 10% SRL-labeled data and varying amounts of SRL-unlabeled data achieves +1.58, +0.78 F1, respectively, over the pre-trained models that were trained on SOTA architecture with ELMo on the same SRL-labeled data. Additionally, by using the syntactic-inconsistency loss on inference time, the proposed model achieves +3.67, +2.1 F1 over pre-trained model on 1%, 10% SRL-labeled data, respectively.
Link: https://arxiv.org/abs/1808.09543
====================================================
Internet of Things: Technology, Applications and Standardardization (Jaydip Sen - 25 August, 2018)
This book presents some of the state-of-the-art research work in the field of the IoT, especially on the issues of communication protocols, interoperability of protocols and semantics, trust security and privacy issues, reference architecture design, and standardization
Link: https://arxiv.org/abs/1808.09390
====================================================
Bridging Knowledge Gaps in Neural Entailment via Symbolic Models (Dongyeop Kang - 4 September, 2018)
Our new architecture combines standard neural entailment models with a knowledge lookup module. On the SciTail dataset, NSnet outperforms a simpler combination of the two predictions by 3% and the base entailment model by 5%.
Link: https://arxiv.org/abs/1808.09333
====================================================
Joint Aspect and Polarity Classification for Aspect-based Sentiment Analysis with End-to-End Neural Networks (Martin Schmitt - 28 August, 2018)
We conduct experiments with different neural architectures and word representations on the recent GermEval 2017 dataset. The combination of a convolutional neural network and fasttext embeddings outperformed the best submission of the shared task in 2017, establishing a new state of the art.
Link: https://arxiv.org/abs/1808.09238
====================================================
Guided Neural Language Generation for Abstractive Summarization using Abstract Meaning Representation ( Hardy - 28 August, 2018)
Recent work on abstractive summarization has made progress with neural encoder-decoder architectures. We demonstrate that this guidance improves summarization results by 7.4 and 10.5 points in ROUGE-2 using gold standard AMR parses and parses obtained from an off-the-shelf parser respectively. We also find that the summarization performance using the latter is 2 ROUGE-2 points higher than that of a well-established neural encoder-decoder approach trained on a larger dataset
Link: https://arxiv.org/abs/1808.09160
====================================================
Single Shot Scene Text Retrieval (LluÃs Gómez - 27 August, 2018)
Our experiments demonstrate that the proposed architecture outperforms previous state-of-the-art while it offers a significant increase in processing speed.
Link: https://arxiv.org/abs/1808.09044
====================================================
Pyramidal Recurrent Unit for Language Modeling (Sachin Mehta - 27 August, 2018)
This architecture gives strong results on word-level language modeling while reducing the number of parameters significantly. (2018) by up to 1.3 points while learning 15-20% fewer parameters
Link: https://arxiv.org/abs/1808.09029
====================================================
Review Helpfulness Assessment based on Convolutional Neural Network (Xianshan Qu - 27 August, 2018)
To our knowledge, this is the first use of this architecture to address this problem. We demonstrate that this can improve the overall accuracy by 2%. Finally, we evaluate the method on a benchmark dataset and show an improvement in accuracy relative to published results for traditional methods of 2.5% for a model trained using only review text and 4.24% for a model trained on a combination of rating star information and review text.
Link: https://arxiv.org/abs/1808.09016
====================================================
Why Self-Attention? A Targeted Evaluation of Neural Machine Translation Architectures (Gongbo Tang - 28 August, 2018)
Recently, non-recurrent architectures (convolutional, self-attentional) have outperformed RNNs in neural machine translation. Our experimental results show that: 1) self-attentional networks and CNNs do not outperform RNNs in modeling subject-verb agreement over long distances; 2) self-attentional networks perform distinctly better than RNNs and CNNs on word sense disambiguation.
Link: https://arxiv.org/abs/1808.08946
====================================================
Deep Learning for Stress Field Prediction Using Convolutional Neural Networks (Zhenguo Nie - 27 August, 2018)
Both the tow architectures are stable and converged reliably in training and testing on GPUs. Mean relative error (MRE) of the SE-Res-FCN model is about 0.25% with respect to the average ground truth
Link: https://arxiv.org/abs/1808.08914
====================================================
Attentive Sequence to Sequence Translation for Localizing Clips of Interest by Natural Language Descriptions (Ke Ning - 27 August, 2018)
The hierarchical architecture exploits video content with multiple granularities, ranging from subtle details to global context. Our ASST outperforms the state-of-the-art by $4.28\%$ in Rank$@1$ on the DiDeMo dataset. On the Charades-STA dataset, we significantly improve the state-of-the-art by $13.41\%$ in Rank$@1,IoU=0.5$.
Link: https://arxiv.org/abs/1808.08803
====================================================
An Empirical Study of Architecting for Continuous Delivery and Deployment (Mojtaba Shahin - 27 August, 2018)
Whilst an increasing amount of the literature covers different aspects of CD, little is known about the role of software architecture in CD and how an application should be (re-) architected to enable and support CD. We have conducted a mixed-methods empirical study that collected data through in-depth, semi-structured interviews with 21 industrial practitioners from 19 organizations, and a survey of 91 professional software practitioners
Link: https://arxiv.org/abs/1808.08796
====================================================
Adaptive Structural Learning of Deep Belief Network for Medical Examination Data and Its Knowledge Extraction by using C4.5 (Shin Kamada - 27 August, 2018)
Deep Learning has a hierarchical network architecture to represent the complicated feature of input patterns. The prediction system shows higher classification accuracy (99.8% for training and 95.5% for test) than the traditional DBN
Link: https://arxiv.org/abs/1808.08777
====================================================
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization (Shashi Narayan - 27 August, 2018)
We demonstrate experimentally that this architecture captures long-range dependencies in a document and recognizes pertinent content, outperforming an oracle extractive system and state-of-the-art abstractive approaches when evaluated automatically and by humans.
Link: https://arxiv.org/abs/1808.08745
====================================================
Automatic 3D bi-ventricular segmentation of cardiac images by a shape-constrained multi-task deep learning approach (Jinming Duan - 28 August, 2018)
The architecture of the proposed FCN uses a 2.5D representation, thus combining the computational advantage of 2D FCNs networks and the capability of addressing 3D spatial consistency without compromising segmentation accuracy. We validate the pipeline on 1831 healthy subjects and 649 subjects with pulmonary hypertension
Link: https://arxiv.org/abs/1808.08578
====================================================
Rain Streak Removal for Single Image via Kernel Guided CNN (Ye-Tao Wang - 28 August, 2018)
In this paper, we propose a novel rain streak removal approach using a kernel guided convolutional neural network (KGCNN), achieving the state-of-the-art performance with simple network architectures
Link: https://arxiv.org/abs/1808.08545
====================================================
Event Detection with Neural Networks: A Rigorous Empirical Evaluation (J. Walker Orr - 26 August, 2018)
While the neural network models have generally led the state-of-the-art, the differences in performance between different architectures have not been rigorously studied
Link: https://arxiv.org/abs/1808.08504
====================================================
Painting Outside the Box: Image Outpainting with GANs (Mark Sabini - 25 August, 2018)
We use a three-phase training schedule to stably train a DCGAN architecture on a subset of the Places365 dataset. Once trained, our model is able to outpaint $128 \times 128$ color images relatively realistically, thus allowing for recursive outpainting
Link: https://arxiv.org/abs/1808.08483
====================================================
Privacy in Internet of Things: from Principles to Technologies (Chao Li - 25 August, 2018)
In this paper, we review the state-of-the-art principles of privacy laws, the architectures for IoT and the representative privacy enhancing technologies (PETs)
Link: https://arxiv.org/abs/1808.08443
====================================================
Deep Convolutional Neural Network with Mixup for Environmental Sound Classification (Zhichao Zhang - 25 August, 2018)
Our network architecture uses stacked convolutional and pooling layers to extract high-level feature representations from spectrogram-like features. Our experimental results demonstrated that our ESC system has achieved the state-of-the-art performance (83.7%) on UrbanSound8K and competitive performance on ESC-50 and ESC-10.
Link: https://arxiv.org/abs/1808.08405
====================================================
A Novel Deep Neural Network Architecture for Mars Visual Navigation (Jiang Zhang - 25 August, 2018)
By employing this architecture, Mars rover can determine the optimal navigation policy to the target point directly from original Martian environment images. Moreover, compared with the existing state-of-the-art algorithm, the training time is reduced by 45.8%
Link: https://arxiv.org/abs/1808.08395
====================================================
Improving Breast Cancer Detection using Symmetry Information with Deep Learning (Yeman Brhane Hagos - 17 August, 2018)
At candidate level, AUC value of 0.933 with 95% confidence interval of [0.920, 0.954] was obtained when symmetry information is incorporated in comparison with baseline architecture which yielded AUC value of 0.929 with [0.919, 0.947] confidence interval. By incorporating symmetrical information, although there was no a significant candidate level performance again (p = 0.111), we have found a compelling result at exam level with CPM value of 0.733 (p = 0.001)
Link: https://arxiv.org/abs/1808.08273
====================================================
Recalibrating Fully Convolutional Networks with Spatial and Channel 'Squeeze & Excitation' Blocks (Abhijit Guha Roy - 23 August, 2018)
The recalibration is achieved by simple computational blocks that can be easily integrated in F-CNNs architectures. Importantly, SE blocks only lead to a minimal increase in model complexity of about 1.5%, while the Dice score increases by 4-9% in the case of U-Net
Link: https://arxiv.org/abs/1808.08127
====================================================
Left ventricle quantification through spatio-temporal CNNs (Alejandro Debus - 23 August, 2018)
We show that incorporating such information by means of spatio-temporal convolutions into standard LV quantification architectures improves the accuracy of the predictions when compared with single-slice models, achieving competitive results for all cardiac indices and significantly breaking the state of the art (Xue et al., 2018, MedIA) for cardiac phase estimation.
Link: https://arxiv.org/abs/1808.07967
====================================================
Financial Aspect-Based Sentiment Analysis using Deep Representations (Steve Yang - 23 August, 2018)
FiQA contains high quality labels, but it still lacks data quantity to apply traditional ABSA deep learning architecture. Our results show an 8.7% improvement in the F1 score for classification and an 11% improvement over the MSE for regression on current state-of-the-art results.
Link: https://arxiv.org/abs/1808.07931
====================================================
Progressive Deep Neural Networks Acceleration via Soft Filter Pruning (Yang He - 23 August, 2018)
Moreover, our approach has been demonstrated effective for many advanced CNN architectures. Notably, on ILSCRC-2012, our method reduces more than 42% FLOPs on ResNet-101 with even 0.2% top-5 accuracy improvement, which has advanced the state-of-the-art. On ResNet-50, our progressive pruning method have 1.08% top-1 accuracy improvement over the pruning method without progressive pruning.
Link: https://arxiv.org/abs/1808.07471
====================================================
3D Topology Optimization using Convolutional Neural Networks (Saurabh Banga - 22 August, 2018)
To this end, we propose a deep learning approach based on a 3D encoder-decoder Convolutional Neural Network architecture for accelerating 3D topology optimization and to determine the optimal computational strategy for its deployment. For the best performing network, we achieved about 40% reduction in overall computation time while also attaining structural accuracies in the order of 96%.
Link: https://arxiv.org/abs/1808.07440
====================================================
DeepCorr: Strong Flow Correlation Attacks on Tor Using Deep Learning (Milad Nasr - 22 August, 2018)
DeepCorr leverages an advanced deep learning architecture to learn a flow correlation function tailored to Tor's complex network this is in contrast to previous works' use of generic statistical correlation metrics to correlated Tor flows. For instance, by collecting only about 900 packets of each target Tor flow (roughly 900KB of Tor data), DeepCorr provides a flow correlation accuracy of 96% compared to 4% by the state-of-the-art system of RAPTOR using the same exact setting.
Link: https://arxiv.org/abs/1808.07285
====================================================
Neural Architecture Optimization (Renqian Luo - 5 September, 2018)
Experiments show that the architecture discovered by our method is very competitive for image classification task on CIFAR-10 and language modeling task on PTB, outperforming or on par with the best results of previous architecture search methods with a significantly reduction of computational resources. Specifically we obtain $2.07\%$ test set error rate for CIFAR-10 image classification task and $55.9$ test set perplexity of PTB language modeling task
Link: https://arxiv.org/abs/1808.07233
====================================================
On Deep Neural Networks for Detecting Heart Disease (Nathalie-Sofia Tomov - 21 August, 2018)
The HEARO-5 architecture, yielding 99% accuracy and 0.98 MCC, significantly outperforms currently published research in the area.
Link: https://arxiv.org/abs/1808.07168
====================================================
Language Identification in Code-Mixed Data using Multichannel Neural Networks and Context Capture (Soumil Mandal - 21 August, 2018)
Inspired from the recent advancements in neural network architectures for computer vision tasks, we have implemented multichannel neural networks combining CNN and LSTM for word level language identification of code-mixed data. Combining this with a Bi-LSTM-CRF context capture module, accuracies of 93.28% and 93.32% is achieved on our two testing sets.
Link: https://arxiv.org/abs/1808.07118
====================================================
QuAC : Question Answering in Context (Eunsol Choi - 27 August, 2018)
We also report results for a number of reference models, including a recently state-of-the-art reading comprehension architecture extended to model dialog context. Our best model underperforms humans by 20 F1, suggesting that there is significant room for future work on this data
Link: https://arxiv.org/abs/1808.07036
====================================================
Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks (Yang He - 21 August, 2018)
Moreover, our approach has been demonstrated effective for many advanced CNN architectures. Notably, on ILSCRC-2012, SFP reduces more than 42% FLOPs on ResNet-101 with even 0.2% top-5 accuracy improvement, which has advanced the state-of-the-art
Link: https://arxiv.org/abs/1808.06866
====================================================
Deep Learned Full-3D Object Completion from Single View (Dario Rethage - 21 August, 2018)
This writing proposes a new approach to 3D reconstruction and scene understanding, which implicitly learns 3D geometry from depth maps pairing a deep convolutional neural network architecture with an auto-encoder. The relatively small network, consisting of roughly 4 million weights, achieves a 92.9% reconstruction accuracy at a 30x30x30 resolution through the use of a pre-trained decompression layer
Link: https://arxiv.org/abs/1808.06843
====================================================
Real-time Analog Pixel-to-pixel Dynamic Frame Differencing with Memristive Sensing Circuits (Olga Krestinskaya - 21 August, 2018)
The proposed circuit is integrated into a pixel-parallel and pixel-column architectures. The power dissipation of the proposed circuit is $96.64mW$, and on-chip ares is $531.66 μm^2$
Link: https://arxiv.org/abs/1808.06780
====================================================
Constrained-size Tensorflow Models for YouTube-8M Video Understanding Challenge (Tianqi Liu - 12 September, 2018)
For each single model, we use the same network architecture as in the winning solution of the first YouTube-8M video understanding competition, namely Gated NetVLAD. We train the single models separately in tensorflow's default float32 precision, then replace weights with float16 precision and ensemble them in the evaluation and inference stages., achieving 48.5% compression rate without loss of precision. Our best model achieved 88.324% GAP on private leaderboard
Link: https://arxiv.org/abs/1808.06739
====================================================
Fast Spectrogram Inversion using Multi-head Convolutional Neural Networks (Sercan O. Arik - 20 August, 2018)
We propose the multi-head convolutional neural network (MCNN) architecture for waveform synthesis from spectrograms. MCNN achieves more than an order of magnitude higher compute intensity than commonly-used iterative algorithms like Griffin-Lim, yielding efficient utilization for modern multi-core processors, and very fast (more than 300x real-time) waveform synthesis
Link: https://arxiv.org/abs/1808.06719
====================================================
VERAM: View-Enhanced Recurrent Attention Model for 3D Shape Classification (Songle Chen - 20 August, 2018)
Taking grayscale image as input and AlexNet as CNN architecture, VERAM with 9 views achieves instance-level and class-level accuracy of 95:5% and 95:3% on ModelNet10, 93:7% and 92:1% on ModelNet40, both are the state-of-the-art performance under the same number of views.
Link: https://arxiv.org/abs/1808.06698
====================================================
Class2Str: End to End Latent Hierarchy Learning (Soham Saha - 20 August, 2018)
We show that for some of the best performing architectures on CIFAR and Imagenet datasets, the proposed replacement and training by LH classifier recovers the accuracy, with a fraction of the number of parameters in the classifier part. Compared to the previous work of HDCNN, which also learns a 2 level hierarchy, we are able to learn a hierarchy at an arbitrary number of levels as well as obtain an accuracy improvement on the Imagenet classification task over them
Link: https://arxiv.org/abs/1808.06675
====================================================
A Hybrid Differential Evolution Approach to Designing Deep Convolutional Neural Networks for Image Classification (Bin Wang - 21 August, 2018)
Firstly, an existing effective encoding scheme is refined to cater for variable-length CNN architectures; Secondly, the new mutation and crossover operators are developed for variable-length DE to optimise the hyperparameters of CNNs; Finally, the new second crossover is introduced to evolve the depth of the CNN architectures. The proposed algorithm is tested on six widely-used benchmark datasets and the results are compared to 12 state-of-the-art methods, which shows the proposed method is vigorously competitive to the state-of-the-art algorithms
Link: https://arxiv.org/abs/1808.06661
====================================================
Video-to-Video Synthesis (Ting-Chun Wang - 20 August, 2018)
Through carefully-designed generator and discriminator architectures, coupled with a spatio-temporal adversarial objective, we achieve high-resolution, photorealistic, temporally coherent video results on a diverse set of input formats including segmentation masks, sketches, and poses. In particular, our model is capable of synthesizing 2K resolution videos of street scenes up to 30 seconds long, which significantly advances the state-of-the-art of video synthesis
Link: https://arxiv.org/abs/1808.06601
====================================================
CU-Net: Coupled U-Nets (Zhiqiang Tang - 20 August, 2018)
We design a new connectivity pattern for the U-Net architecture. However, it only has at least 60% fewer parameters than other approaches.
Link: https://arxiv.org/abs/1808.06521
====================================================
Deep Residual Network for Sound Source Localization in the Time Domain (Dmitry Suvorov - 20 August, 2018)
This study describes the gathered dataset and developed architecture of the neural network. The accuracy classification of 30 m sec sound frames is 99.2%. Its usage decreased word error rate by 1.14% in comparison with similar speech recognition pipeline using GCC-PHAT sound source localization.
Link: https://arxiv.org/abs/1808.06429
====================================================
Experimental Evaluation of Passive Optical Network Based Data Centre Architecture (AEA Eltraify - 18 August, 2018)
In this paper we report the implementation of a PON based data centre architecture that provides high resilience and high speed interconnections by providing alternative communication routes between servers in different racks. We implement the switching and routing functionalities within servers using 4x10GE Xilinx NetFPGA, and demonstrate end-to-end communication using IP cameras live video streaming over up to 100 km optical connections through WDM nodes and the PON network.
Link: https://arxiv.org/abs/1808.06143
====================================================
Energy Efficient Service Distribution in Internet of Things (Barzan Yosuf - 18 August, 2018)
We optimize the placement of the IoT services in this architecture so that the total power consumption is minimized. Our results show that, introducing local computation at the IoT layer can bring up to 90% power savings compared with general purpose servers in a central cloud.
Link: https://arxiv.org/abs/1808.06120
====================================================
Compiler Enhanced Scheduling for OpenMP for Heterogeneous Multiprocessors (Jyothi Krishna V S - 18 August, 2018)
We implement a compiler for OpenMP and demonstrate its efficiency in Samsung Exynos with big.LITTLE architecture. On an average, we see 18% reduction in runtime and 14% reduction in energy consumption in standard NPB and FSU benchmarks with CES across multiple frequencies and core configurations in big.LITTLE.
Link: https://arxiv.org/abs/1808.06074
====================================================
CellLineNet: End-to-End Learning and Transfer Learning For Multiclass Epithelial Breast cell Line Classification via a Convolutional Neural Network (Darlington Ahiale Akogo - 18 August, 2018)
Using Transfer Learning, the 28-layer MobileNet Convolutional Neural Network architecture with pre-trained ImageNet weights is extended and fine tuned to the Multiclass Epithelial Breast cell Line Classification problem. CellLineNet simply requires an imaged Cell Line as input and it outputs the type of breast epithelial cell line (MDA-MB-468, MCF7, 10A, 12A or HC11) as predicted probabilities for the 5 classes. CellLineNet scored a 96.67% Accuracy.
Link: https://arxiv.org/abs/1808.06041
====================================================
Neuromorphic Architecture for the Hierarchical Temporal Memory (Abdullah M. Zyarah - 17 August, 2018)
The spatial pooler architecture is synthesized on Xilinx ZYNQ-7, with 91.16% classification accuracy for MNIST and 90\% accuracy for EUNF, with noise. For the temporal memory sequence prediction, first and second order predictions are observed for a 5-number long sequence generated from EUNF dataset and 95% accuracy is obtained
Link: https://arxiv.org/abs/1808.05839
====================================================
Read + Verify: Machine Reading Comprehension with Unanswerable Questions (Minghao Hu - 5 September, 2018)
Moreover, we introduce two auxiliary losses to help the reader better handle answer extraction as well as no-answer detection, and investigate three different architectures for the answer verifier. Our experiments on the SQuAD 2.0 dataset show that our system achieves a score of 74.2 F1 on the test set, outperforming all previous approaches at the time of submission (Aug
Link: https://arxiv.org/abs/1808.05759
====================================================
Dynamic Routing on Deep Neural Network for Thoracic Disease Classification and Sensitive Area Localization (Yan Shen - 17 August, 2018)
We address this problem by utilizing the recently developed routing-by agreement mechanism in our architecture. We demonstrate our results on the NIH chestX-ray14 dataset that consists of 112,120 images on 30,805 unique patients including 14 kinds of lung diseases.
Link: https://arxiv.org/abs/1808.05744
====================================================
BlockQNN: Efficient Block-wise Neural Network Architecture Generation (Zhao Zhong - 16 August, 2018)
However, most usable network architectures are hand-crafted and usually require expertise and elaborate design. The block-wise generation brings unique advantages: (1) it yields state-of-the-art results in comparison to the hand-crafted networks on image classification, particularly, the best network generated by BlockQNN achieves 2.35% top-1 error rate on CIFAR-10. (2) it offers tremendous reduction of the search space in designing networks, spending only 3 days with 32 GPUs. A faster version can yield a comparable result with only 1 GPU in 20 hours. The best network achieves very competitive accuracy of 82.0% top-1 and 96.0% top-5 on ImageNet.
Link: https://arxiv.org/abs/1808.05584
====================================================
LARNN: Linear Attention Recurrent Neural Network (Guillaume Chevalier - 16 August, 2018)
This neural architecture yields better results than the vanilla LSTM cells. It can obtain results of 91.92% for the test accuracy, compared to the previously attained 91.65% using vanilla LSTM cells. Note that this is not to compare to other research, where up to 93.35% is obtained, but costly using 18 LSTM cells rather than with 2 to 3 cells as analyzed here
Link: https://arxiv.org/abs/1808.05578
====================================================
Deeper Image Quality Transfer: Training Low-Memory Neural Networks for 3D Images (Stefano B. Blumberg - 16 August, 2018)
We exploit memory-efficient backpropagation techniques, to reduce the memory complexity of network training from being linear in the network's depth, to being roughly constant $ - $ permitting us to elongate deep architectures with negligible memory increase. We obtain substantially better results than the previous state-of-the-art model with a slight memory increase, reducing the root-mean-squared-error by $ 13\% $
Link: https://arxiv.org/abs/1808.05577
====================================================
Anatomy Of High-Performance Deep Learning Convolutions On SIMD Architectures (Evangelos Georganas - 20 August, 2018)
In this paper, we introduce direct convolution kernels for x86 architectures, in particular for Xeon and XeonPhi systems, which are implemented via a dynamic compilation approach
Link: https://arxiv.org/abs/1808.05567
====================================================
DNN Feature Map Compression using Learned Representation over GF(2) (Denis A. Gudovskiy - 15 August, 2018)
We apply the proposed network architectures derived from modified SqueezeNet and MobileNetV2 to the tasks of ImageNet classification and PASCAL VOC object detection. Compared to prior approaches, the conducted experiments show a factor of 2 decrease in memory requirements with minor degradation in accuracy while adding only bitwise computations.
Link: https://arxiv.org/abs/1808.05285
====================================================
Using Regular Languages to Explore the Representational Capacity of Recurrent Neural Architectures (Abhijit Mahalunkar - 15 August, 2018)
In order to test these state-of-the-art architectures, there is growing need for rich benchmarking datasets
Link: https://arxiv.org/abs/1808.05128
====================================================
Ensemble of Convolutional Neural Networks for Dermoscopic Images Classification (Tomáš Majtner - 15 August, 2018)
The proposed solution is based on deep learning, where we employed transfer learning strategy on VGG16 and GoogLeNet architectures. The solution was evaluated on Task 3: Lesion Diagnosis of the ISIC 2018: Skin Lesion Analysis Towards Melanoma Detection.
Link: https://arxiv.org/abs/1808.05071
====================================================
Deep EHR: Chronic Disease Prediction Using Medical Notes (Jingshu Liu - 14 August, 2018)
We compareperformance of different deep learning architectures including CNN, LSTM and hierarchical models.In contrast to traditional text-based prediction models, our approach does not require disease specificfeature engineering, and can handle negations and numerical values that exist in the text. Ourresults on a cohort of about 1 million patients show that models using text outperform modelsusing just structured data, and that models capable of using numerical values and negations in thetext, in addition to the raw text, further improve performance
Link: https://arxiv.org/abs/1808.04928
====================================================
Microservices in Practice: A Survey Study (Markos Viggiato - 14 August, 2018)
Microservices architectures have become largely popular in the last years. Thereupon, in this paper, we report the results of a survey with 122 professionals who work with microservices
Link: https://arxiv.org/abs/1808.04836
====================================================
DeepNeuro: an open-source deep learning toolbox for neuroimaging (Andrew Beers - 14 August, 2018)
We show how this framework can be used to both design and train neural network architectures, as well as modify state-of-the-art architectures in a flexible and intuitive way
Link: https://arxiv.org/abs/1808.04589
====================================================
Automatic Airway Segmentation in chest CT using Convolutional Neural Networks (A. Garcia-Uceda Juarez - 14 August, 2018)
Recently, deep convolutional neural networks (CNNs) have become the state-of-the-art for many segmentation tasks, and in particular the so-called Unet architecture for biomedical images. The method is trained on a dataset composed of 12 CTs, and tested on another 6 CTs. We evaluate the influence of different loss functions and data augmentation techniques, and reach an average dice coefficient of 0.8 between the ground-truth and our automated segmentations.
Link: https://arxiv.org/abs/1808.04576
====================================================
Multimodal Deep Neural Networks using Both Engineered and Learned Representations for Biodegradability Prediction (Garrett B. Goh - 13 September, 2018)
In this work, we develop a novel multimodal CNN-MLP neural network architecture that utilizes both domain-specific feature engineering as well as learned representations from raw data. DeepBioD, a multimodal CNN-MLP network is more accurate than either standalone network designs, and achieves an error classification rate of 0.125 that is 27% lower than the current state-of-the-art
Link: https://arxiv.org/abs/1808.04456
====================================================
Murmur Detection Using Parallel Recurrent & Convolutional Neural Networks (Shahnawaz Alam - 13 August, 2018)
We introduce a novel deep neural network architecture using parallel combination of the Recurrent Neural Network (RNN) based Bidirectional Long Short-Term Memory (BiLSTM) & Convolutional Neural Network (CNN) to learn visual and time-dependent characteristics of Murmur in PCG waveform. The proposed method was evaluated on a large dataset using 5-fold cross-validation, resulting in a sensitivity and specificity of 96 +- 0.6 % , 100 +- 0 % respectively and F1 Score of 98 +- 0.3 %.
Link: https://arxiv.org/abs/1808.04411
====================================================
A Domain Guided CNN Architecture for Predicting Age from Structural Brain Images (Pascal Sturmfels - 11 August, 2018)
We present two simple modifications to existing CNN architectures based on brain image structure. Applied to the task of brain age prediction, our network achieves a mean absolute error (MAE) of 1.4 years and trains 30% faster than a CNN baseline that achieves a MAE of 1.6 years
Link: https://arxiv.org/abs/1808.04362
====================================================
iNNvestigate neural networks! (Maximilian Alber - 13 August, 2018)
To demonstrate the versatility of iNNvestigate, we provide an analysis of image classifications for variety of state-of-the-art neural network architectures.
Link: https://arxiv.org/abs/1808.04260
====================================================
A Reference Architecture for Datacenter Scheduling: Extended Technical Report (Georgios Andreadis - 13 August, 2018)
To demonstrate the validity of the reference architecture, we map to it state-of-the-art datacenter schedulers
Link: https://arxiv.org/abs/1808.04224
====================================================
Automatic Plaque Detection in IVOCT Pullbacks Using Convolutional Neural Networks (Nils Gessert - 24 August, 2018)
We fuse both representations in a multi-path architecture for more effective feature exploitation. Overall, we find that our combined model performs best with an accuracy of 91.7%, a sensitivity of 90.9% and a specificity of 92.4%
Link: https://arxiv.org/abs/1808.04187
====================================================
DenseRAN for Offline Handwritten Chinese Character Recognition (Wenchao Wang - 13 August, 2018)
In this study, we propose a novel radical analysis network with densely connected architecture (DenseRAN) to analyze Chinese character radicals and its two-dimensional structures simultaneously. Evaluated on ICDAR-2013 competition database, the proposed approach significantly outperforms whole-character modeling approach with a relative character error rate (CER) reduction of 18.54%. Meanwhile, for the case of recognizing 3277 unseen Chinese characters in CASIA-HWDB1.2 database, DenseRAN can achieve a character accuracy of about 41% while the traditional whole-character method has no capability to handle them.
Link: https://arxiv.org/abs/1808.04134
====================================================
Confidence penalty, annealing Gaussian noise and zoneout for biLSTM-CRF networks for named entity recognition (Antonio Jimeno Yepes - 13 August, 2018)
In this work, we have done an analysis of several methods that intend to optimize the performance of networks based on this architecture, which in some cases encourage overfitting avoidance. Results show that the optimization methods improve the performance of the biLSTM-CRF NER baseline system, setting a new state of the art performance for the CoNLL-2003 Spanish set with an F1 of 87.18.
Link: https://arxiv.org/abs/1808.04029
====================================================
Pervasive Attention: 2D Convolutional Neural Networks for Sequence-to-Sequence Prediction (Maha Elbayad - 11 August, 2018)
Current state-of-the-art machine translation systems are based on encoder-decoder architectures, that first encode the input sequence, and then generate an output sequence based on the input encoding
Link: https://arxiv.org/abs/1808.03867
====================================================
Self-Supervised Model Adaptation for Multimodal Semantic Segmentation (Abhinav Valada - 11 August, 2018)
In addition, we propose a computationally efficient unimodal segmentation architecture termed AdapNet++ that incorporates a new encoder with multiscale residual units and an efficient atrous spatial pyramid pooling that has a larger effective receptive field with more than 10x fewer parameters, complemented with a strong decoder with a multi-resolution supervision scheme that recovers high-resolution details. Comprehensive empirical evaluations on several benchmarks demonstrate that both our unimodal and multimodal architectures achieve state-of-the-art performance.
Link: https://arxiv.org/abs/1808.03833
====================================================
Automatically Designing CNN Architectures Using Genetic Algorithm for Image Classification (Yanan Sun - 11 August, 2018)
For some state-of-the-art CNNs, their architectures are hand-crafted with expertise in both CNNs and the investigated problems. Furthermore, the proposed algorithm also shows the competitive classification accuracy to the semi-automatic peer competitors, while reducing 10 times of the parameters
Link: https://arxiv.org/abs/1808.03818
====================================================
Dropout during inference as a model for neurological degeneration in an image captioning network (Bai Li - 10 August, 2018)
We replicate a variation of the image captioning architecture by Vinyals et al. We find that the generated sentences most closely approximate the word frequency distribution of the training corpus when using a moderate dropout of 0.4 during inference.
Link: https://arxiv.org/abs/1808.03747
====================================================
Error Forward-Propagation: Reusing Feedforward Connections to Propagate Errors in Deep Learning (Adam A. Kohan - 9 August, 2018)
This mechanism, Error Forward-Propagation, is a plausible basis for how error feedback occurs deep in the brain independent of and yet in support of the functionality underlying intricate network architectures. We show experimentally that recurrent neural networks with two and three hidden layers can be trained using Error Forward-Propagation on the MNIST and Fashion MNIST datasets, achieving $1.90\%$ and $11\%$ generalization errors respectively.
Link: https://arxiv.org/abs/1808.03357
====================================================
On-Chip Optical Convolutional Neural Networks (Hengameh Bagherian - 16 August, 2018)
In this paper, we propose a photonics circuit architecture which could consume a fraction of energy per inference compared with state of the art electronics.
Link: https://arxiv.org/abs/1808.03303
====================================================
Controllable Image-to-Video Translation: A Case Study on Facial Expression Generation (Lijie Fan - 8 August, 2018)
To this end, we design a novel neural network architecture that can incorporate the user input into its skip connections and propose several improvements to the adversarial training method for the neural network. Especially, we would like to highlight that even for the face images in the wild (downloaded from the Web and the authors' own photos), our model can generate high-quality facial expression videos of which about 50\% are labeled as real by Amazon Mechanical Turk workers.
Link: https://arxiv.org/abs/1808.02992
====================================================
SchiNet: Automatic Estimation of Symptoms of Schizophrenia from Facial Behaviour Analysis (Mina Bishay - 7 August, 2018)
We automatically analyse the facial behaviour of 91 out-patients - this is almost 3 times the number of patients in other studies - and propose SchiNet, a novel neural network architecture that estimates expression-related symptoms in two different assessment interviews
Link: https://arxiv.org/abs/1808.02531
====================================================
YOLO3D: End-to-end real-time 3D Oriented Object Bounding Box Detection from LiDAR Point Cloud (Waleed Ali - 7 August, 2018)
In this paper, we build on the success of the one-shot regression meta-architecture in the 2D perspective image space and extend it to generate oriented 3D object bounding boxes from LiDAR point cloud. Our results are showing promising figures on KITTI benchmark, achieving real-time performance (40 fps) on Titan X GPU.
Link: https://arxiv.org/abs/1808.02350
====================================================
Deep Learning for Domain Adaption: Engagement Recognition (Omid Mohamad Nezami - 7 August, 2018)
We find that our Transfer architecture outperforms standard deep learning architectures that we apply for the first time to engagement recognition, as well as approaches using HOG features and SVMs. The model achieves a classification accuracy of 72.38%, which is 6.1% better than the best baseline model on the test set of the ER dataset. Using the F1 measure and the area under the ROC curve, our Transfer model achieves 73.90% and 73.74%, exceeding the best baseline model by 3.49% and 5.33% respectively.
Link: https://arxiv.org/abs/1808.02324
====================================================
Fast Variance Reduction Method with Stochastic Batch Size (Xuanqing Liu - 6 August, 2018)
However, due to the presence of cache/disk IO effect in computer architecture, the number of data access cannot reflect the running time because of 1) random memory access is much slower than sequential access, 2) when data is too big to fit into memory, disk seeking takes even longer time. After taking these into account, choosing batch size of $1$ is no longer optimal, so we propose a new algorithm called SAGA++ and show how to calculate the optimal average batch size theoretically
Link: https://arxiv.org/abs/1808.02169
====================================================
Efficient Fusion of Sparse and Complementary Convolutions (Chun-Fu Chen - 10 September, 2018)
We integrate this module into various network architectures and demonstrate its effectiveness on three vision tasks, object classification, localization and detection. For object detection, our approach leads to a VGG-16-based Faster RCNN detector that is 12.4$\times$ smaller and about 3$\times$ faster than the baseline.
Link: https://arxiv.org/abs/1808.02167
====================================================
Residual Memory Networks: Feed-forward approach to learn long temporal dependencies (Murali Karthick Baskar - 6 August, 2018)
In this paper we propose a residual memory neural network (RMN) architecture to model short-time dependencies using deep feed-forward layers having residual and time delayed connections. Recognition performance of RMN trained with 300 hours of Switchboard corpus is compared with various state-of-the-art LVCSR systems. The results indicate that RMN and BRMN gains 6 % and 3.8 % relative improvement over LSTM and BLSTM networks.
Link: https://arxiv.org/abs/1808.01916
====================================================
Classification of Dermoscopy Images using Deep Learning (Nithin D Reddy - 5 August, 2018)
We trained a convolutional neural network based on the ResNet50 architecture to accurately classify dermoscopy images of skin lesions into one of seven disease categories. Using our custom model, we obtained a balanced accuracy of 91% on the validation dataset.
Link: https://arxiv.org/abs/1808.01607
====================================================
A Deep Learning based Joint Segmentation and Classification Framework for Glaucoma Assesment in Retinal Color Fundus Images (Arunava Chakravarty - 29 July, 2018)
The use of fewer network parameters and the sharing of the CNN features for multiple related tasks ensures the good generalizability of the architecture, allowing it to be trained on small training sets. The cross-testing performance of the proposed method on an independent validation set acquired using a different camera and image resolution was found to be good with an average dice score of 0.92 for OD, 0.84 for OC and AUC of 0.95 on the task of glaucoma classification illustrating its potential as a mass screening tool for the early detection of glaucoma.
Link: https://arxiv.org/abs/1808.01355
====================================================
SWDE : A Sub-Word And Document Embedding Based Engine for Clickbait Detection (Vaibhav Kumar - 2 August, 2018)
We generate sub-word level embeddings of the title using Convolutional Neural Networks and use them to train a bidirectional LSTM architecture. We test our model over 2538 posts (having trained it on 17000 records) and achieve an accuracy of 83.49% outscoring previous state-of-the-art approaches.
Link: https://arxiv.org/abs/1808.00957
====================================================
BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation (Changqian Yu - 2 August, 2018)
The proposed architecture makes a right balance between the speed and segmentation performance on Cityscapes, CamVid, and COCO-Stuff datasets. Specifically, for a 2048x1024 input, we achieve 68.4% Mean IOU on the Cityscapes test dataset with speed of 105 FPS on one NVIDIA Titan XP card, which is significantly faster than the existing methods with comparable performance.
Link: https://arxiv.org/abs/1808.00897
====================================================
Weakly Supervised Localisation for Fetal Ultrasound Images (Nicolas Toussaint - 2 August, 2018)
We examine the use of convolutional neural network architectures coupled with soft proposal layers. Detection achieves an average accuracy of 90\% on individual regions, and show that the proposal maps correlate well with relevant anatomical structures
Link: https://arxiv.org/abs/1808.00793
====================================================
Approximate Probabilistic Neural Networks with Gated Threshold Logic (Olga Krestinskaya - 2 August, 2018)
The weights of the PNN are approximated using a memristive crossbar architecture. In particular, the proposed algorithm performs normalization of the training weights, and quantization into 16 levels which significantly reduces the complexity of the circuit.
Link: https://arxiv.org/abs/1808.00733
====================================================
Deep Learning for Radio Resource Allocation in Multi-Cell Networks (K. I. Ahmed - 2 August, 2018)
Starting with a brief overview of a deep neural network (DNN) as a DL model, relevant DNN architectures and the data training procedure, we provide an overview of existing state-of-the-art applying DL in the context of radio resource allocation. Simulation results show that the trained DL model is able to provide the desired optimal solution 86.3% of time.
Link: https://arxiv.org/abs/1808.00667
====================================================
The BaseJump Manycore Accelerator Network (Shaolin Xie - 15 August, 2018)
The BaseJump Manycore Accelerator-Network is an open source mesh-based On-Chip-Network which is designed leveraging the Bespoke Silicon Group's 20+ years of experience in designing manycore architectures. (2018), forming the basis of both a 1 GHz 496-core RISC-V manycore and a 10-core always-on low voltage complex
Link: https://arxiv.org/abs/1808.00650
====================================================
Efficient Progressive Neural Architecture Search (Juan-Manuel Perez-Rua - 1 August, 2018)
We propose a method that aggregates two main results of the previous state-of-the-art in neural architecture search. Sequential search has previously demonstrated its capabilities to find state-of-the-art neural architectures for image classification
Link: https://arxiv.org/abs/1808.00391
====================================================
Reinforced Evolutionary Neural Architecture Search (Yukang Chen - 6 September, 2018)
We conduct the proposed search method on CIFAR-10 with 4 GPUs (Titan Xp) across 1.5 days and discover a powerful network architecture
Link: https://arxiv.org/abs/1808.00193
====================================================
News Session-Based Recommendations using Deep Neural Networks (Gabriel de Souza P. Moreira - 16 September, 2018)
Experiments with an extensive number of session-based recommendation methods were performed and the proposed instantiation of CHAMELEON meta-architecture obtained a significant relative improvement in top-n accuracy and ranking metrics (10% on Hit Rate and 13% on MRR) over the best benchmark methods.
Link: https://arxiv.org/abs/1808.00076
====================================================
Modeling Task Effects in Human Reading with Neural Attention (Michael Hahn - 31 July, 2018)
We propose a neural architecture that combines an attention module (deciding whether to skip words) and a task module (memorizing the input). We show that our model predicts human skipping behavior, while also modeling reading times well, even though it skips 40% of the input
Link: https://arxiv.org/abs/1808.00054
====================================================
Compact Convolutional Neural Networks for Multi-Class, Personalised, Closed-Loop EEG-BCI (Pablo Ortega - 31 July, 2018)
Our preliminary results show that an efficient architecture (SmallNet), with only one convolutional layer, can classify 4 mental activities chosen by the user. It is kept up-to-date through the use of newly collected signals along playing, reaching an online accuracy of 47.6% where most approaches only report results obtained offline. Compared to our previous decoder of physiological signals relying on blinks, we increased by a factor 2 the amount of states among which the user can transit, bringing the opportunity for finer control of specific subtasks composing natural grasping in a self-paced way
Link: https://arxiv.org/abs/1807.11752
====================================================
Deep Cross Modal Learning for Caricature Verification and Identification(CaVINet) (Jatin Garg - 31 July, 2018)
This paper presents the first cross modal architecture that handles extreme distortions of caricatures using a deep learning network that learns similar representations across the modalities. The learned shared representation achieves 91% accuracy for verifying unseen images and 75% accuracy on unseen identities. Further, recognizing the identity in the image by knowledge transfer using a combination of shared and modality specific representations, resulted in an unprecedented performance of 85% rank-1 accuracy for caricatures and 95% rank-1 accuracy for visual images.
Link: https://arxiv.org/abs/1807.11688
====================================================
MnasNet: Platform-Aware Neural Architecture Search for Mobile (Mingxing Tan - 30 July, 2018)
In this paper, we propose an automated neural architecture search approach for designing resource-constrained mobile CNN models. On the ImageNet classification task, our model achieves 74.0% top-1 accuracy with 76ms latency on a Pixel phone, which is 1.5x faster than MobileNetV2 (Sandler et al. 2018) and 2.4x faster than NASNet (Zoph et al. 2018) with the same top-1 accuracy
Link: https://arxiv.org/abs/1807.11626
====================================================
Testing the Efficient Network TRaining (ENTR) Hypothesis: initially reducing training image size makes Convolutional Neural Network training for image recognition tasks more efficient (Thomas Cherico Wanger - 30 July, 2018)
Convolutional Neural Networks (CNN) for image recognition tasks are seeing rapid advances in the available architectures and how networks are trained based on large computational infrastructure and standard datasets with millions of images. We test this Efficient Network TRaining (ENTR) Hypothesis by training pre-trained Residual Network (ResNet) models (ResNet18, 34, & 50) on three small datasets (steel microstructures, bee images, and geographic aerial images) with a free cloud GPU
Link: https://arxiv.org/abs/1807.11583
====================================================
Harmonic-Percussive Source Separation with Deep Neural Networks and Phase Recovery (Konstantinos Drossos - 30 July, 2018)
MaD TwinNet is a deep learning architecture that has reached state-of-the-art results in monaural singing voice separation
Link: https://arxiv.org/abs/1807.11298
====================================================
Modular Sensor Fusion for Semantic Segmentation (Hermann Blum - 30 July, 2018)
Current multi-sensor deep learning based semantic segmentation approaches do not provide robustness to under-performing classes in one modality, or require a specific architecture with access to the full aligned multi-sensor training data. In our experiments, the approach improves performance in IoU over the best single modality segmentation results by up to 5%
Link: https://arxiv.org/abs/1807.11249
====================================================
Multi-Fiber Networks for Video Recognition (Yunpeng Chen - 18 September, 2018)
Extensive experimental results show that our multi-fiber architecture significantly boosts the efficiency of existing convolution networks for both image and video recognition tasks, achieving state-of-the-art performance on UCF-101, HMDB-51 and Kinetics datasets. Our proposed model requires over 9x and 13x less computations than the I3D and R(2+1)D models, respectively, yet providing higher accuracy.
Link: https://arxiv.org/abs/1807.11195
====================================================
Leveraging Medical Sentiment to Understand Patients Health on Social Media (Shweta Yadav - 30 July, 2018)
We propose an effective architecture that uses a Convolutional Neural Network (CNN) as a data-driven feature extractor and a Support Vector Machine (SVM) as a classifier. In addition to our dataset, we also evaluate our approach on the benchmark "CLEF eHealth 2014" corpora and show that our model outperforms the state-of-the-art techniques.
Link: https://arxiv.org/abs/1807.11172
====================================================
Towards Good Practices on Building Effective CNN Baseline Model for Person Re-identification (Fu Xiong - 29 July, 2018)
To answer this open question, we propose 3 good practices in this paper from the perspectives of adjusting CNN architecture and training procedure. The extensive experiments on 3 widely-used benchmark datasets demonstrate that, our propositions essentially facilitate the CNN baseline model to achieve the state-of-the-art performance without any other high-level domain knowledge or low-level technical trick.
Link: https://arxiv.org/abs/1807.11042
====================================================
Tiny-DSOD: Lightweight Object Detection for Resource-Restricted Usages (Yuxi Li - 29 July, 2018)