From patchwork Wed Aug 17 23:50:48 2011 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Gab Charette X-Patchwork-Id: 110478 Return-Path: X-Original-To: incoming@patchwork.ozlabs.org Delivered-To: patchwork-incoming@bilbo.ozlabs.org Received: from sourceware.org (server1.sourceware.org [209.132.180.131]) by ozlabs.org (Postfix) with SMTP id 04C0AB6F95 for ; Thu, 18 Aug 2011 09:51:11 +1000 (EST) Received: (qmail 8818 invoked by alias); 17 Aug 2011 23:51:09 -0000 Received: (qmail 8809 invoked by uid 22791); 17 Aug 2011 23:51:07 -0000 X-SWARE-Spam-Status: No, hits=-1.0 required=5.0 tests=AWL, BAYES_50, DKIM_SIGNED, DKIM_VALID, DKIM_VALID_AU, RP_MATCHES_RCVD, SPF_HELO_PASS X-Spam-Check-By: sourceware.org Received: from smtp-out.google.com (HELO smtp-out.google.com) (216.239.44.51) by sourceware.org (qpsmtpd/0.43rc1) with ESMTP; Wed, 17 Aug 2011 23:50:52 +0000 Received: from hpaq2.eem.corp.google.com (hpaq2.eem.corp.google.com [172.25.149.2]) by smtp-out.google.com with ESMTP id p7HNooIH014803; Wed, 17 Aug 2011 16:50:50 -0700 Received: from gchare.mtv.corp.google.com (gchare.mtv.corp.google.com [172.18.111.122]) by hpaq2.eem.corp.google.com with ESMTP id p7HNomKQ022364; Wed, 17 Aug 2011 16:50:49 -0700 Received: by gchare.mtv.corp.google.com (Postfix, from userid 138564) id 5874A1C0ED2; Wed, 17 Aug 2011 16:50:48 -0700 (PDT) To: reply@codereview.appspotmail.com, gcc-patches@gcc.gnu.org Subject: [pph] Fix child references being included multiple times (issue4904050) Message-Id: <20110817235048.5874A1C0ED2@gchare.mtv.corp.google.com> Date: Wed, 17 Aug 2011 16:50:48 -0700 (PDT) From: gchare@google.com (Gabriel Charette) X-System-Of-Record: true X-IsSubscribed: yes Mailing-List: contact gcc-patches-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Id: List-Unsubscribe: List-Archive: List-Post: List-Help: Sender: gcc-patches-owner@gcc.gnu.org Delivered-To: mailing list gcc-patches@gcc.gnu.org I changed my mind and kept stream->includes the way it was originally meant to be, i.e. every stream will have its list of includes not only the main pph's stream. More specifically I will be using this for every stream when regenerating the linemap (and reading the includes in parallel) in my upcoming patch! Furthermore, we could get rid of the global pph_read_image altogether now as it's only a flat vector representation of the include tree structure saved through the pph_streams'->includes. The only problem I see is in pph_cache_get where we need a fix index for a stream (we could definitely map an index to the post-order traversal of the include tree, but it won't be as fast as a simple index in a flat vector), I didn't do it for now.. Cheers, Gab 2011-08-17 Gabriel Charette gcc/cp/ChangeLog.pph * pph-streamer-in.c (pph_reading_includes): New. (pph_in_includes): Add logic to control pph_reading_includes. (pph_read_file_1): Only call pph_add_include if reading an include from the main file (not from pph_in_includes). (pph_read_file): Don't handle adding to pph_read_images here. (pph_reader_finish): Free pph_read_images. * pph-streamer-out.c (pph_tree_matches): Remove now unused STREAM parameter. Update all users. (pph_add_include): Handle adding INCLUDE to pph_read_images here. * pph-streamer.c (pph_read_images): Moved here from pph-streamer-in.c (pph_stream_close): Free stream->includes. (pph_cache_lookup_in_includes): Lookup in pph_read_images. Remove now unused STREAM parameter. Update all users. (pph_cache_get): Index in pph_read_images. * pph-streamer.h (pph_stream): Changed comment for field "includes". * pph.c (pph_finish): Fixed extra space typo. gcc/testsuite/ChangeLog.pph * g++.dg/pph/c2deepincl.cc: Remove asm xdiff. --- This patch is available for review at http://codereview.appspot.com/4904050 diff --git a/gcc/cp/pph-streamer-in.c b/gcc/cp/pph-streamer-in.c index 013f526..58f084e 100644 --- a/gcc/cp/pph-streamer-in.c +++ b/gcc/cp/pph-streamer-in.c @@ -33,13 +33,6 @@ along with GCC; see the file COPYING3. If not see #include "cppbuiltin.h" #include "toplev.h" -/* List of PPH images read during parsing. Images opened during #include - processing and opened from pph_in_includes cannot be closed - immediately after reading, because the pickle cache contained in - them may be referenced from other images. We delay closing all of - them until the end of parsing (when pph_reader_finish is called). */ -static VEC(pph_stream_ptr,heap) *pph_read_images = NULL; - typedef char *char_p; DEF_VEC_P(char_p); DEF_VEC_ALLOC_P(char_p,heap); @@ -53,6 +46,12 @@ DEF_VEC_ALLOC_P(char_p,heap); memory will remain allocated until the end of compilation. */ static VEC(char_p,heap) *string_tables = NULL; +/* Increment when we are in the process of reading includes as we do not want + to add those to the parent pph stream's list of includes to be written out. + Decrement when done. We cannot use a simple true/false flag as read includes + will call pph_in_includes as well. */ +static int pph_reading_includes = 0; + /* Wrapper for memory allocation calls that should have their results registered in the PPH streamer cache. DATA is the pointer returned by the memory allocation call in ALLOC_EXPR. IX is the cache slot @@ -1289,6 +1288,8 @@ pph_in_includes (pph_stream *stream) { unsigned i, num; + pph_reading_includes++; + num = pph_in_uint (stream); for (i = 0; i < num; i++) { @@ -1296,6 +1297,8 @@ pph_in_includes (pph_stream *stream) pph_stream *include = pph_read_file (include_name); pph_add_include (stream, include); } + + pph_reading_includes--; } @@ -1467,7 +1470,7 @@ pph_read_file_1 (pph_stream *stream) /* If we are generating an image, the PPH contents we just read from STREAM will need to be read again the next time we want to read the image we are now generating. */ - if (pph_out_file) + if (pph_out_file && !pph_reading_includes) pph_add_include (NULL, stream); } @@ -1481,10 +1484,7 @@ pph_read_file (const char *filename) stream = pph_stream_open (filename, "rb"); if (stream) - { - pph_read_file_1 (stream); - VEC_safe_push (pph_stream_ptr, heap, pph_read_images, stream); - } + pph_read_file_1 (stream); else error ("Cannot open PPH file for reading: %s: %m", filename); @@ -1964,4 +1964,6 @@ pph_reader_finish (void) /* Close any images read during parsing. */ FOR_EACH_VEC_ELT (pph_stream_ptr, pph_read_images, i, image) pph_stream_close (image); + + VEC_free (pph_stream_ptr, heap, pph_read_images); } diff --git a/gcc/cp/pph-streamer-out.c b/gcc/cp/pph-streamer-out.c index 2099d4e..44fe018 100644 --- a/gcc/cp/pph-streamer-out.c +++ b/gcc/cp/pph-streamer-out.c @@ -207,11 +207,11 @@ pph_out_start_record (pph_stream *stream, void *data) return false; } - /* DATA is not in STREAM's cache. See if it is in any of STREAM's + /* DATA is not in STREAM's cache. See if it is in any of the included images. If it is, write an external reference to it and inform the caller that it should not write a physical representation for DATA. */ - if (pph_cache_lookup_in_includes (stream, data, &include_ix, &ix)) + if (pph_cache_lookup_in_includes (data, &include_ix, &ix)) { pph_out_record_marker (stream, PPH_RECORD_XREF); pph_out_uint (stream, include_ix); @@ -351,7 +351,7 @@ pph_out_ld_min (pph_stream *stream, struct lang_decl_min *ldm) /* Return true if T matches FILTER for STREAM. */ static inline bool -pph_tree_matches (pph_stream *stream, tree t, unsigned filter) +pph_tree_matches (tree t, unsigned filter) { if ((filter & PPHF_NO_BUILTINS) && DECL_P (t) @@ -359,7 +359,7 @@ pph_tree_matches (pph_stream *stream, tree t, unsigned filter) return false; if ((filter & PPHF_NO_XREFS) - && pph_cache_lookup_in_includes (stream, t, NULL, NULL)) + && pph_cache_lookup_in_includes (t, NULL, NULL)) return false; return true; @@ -399,7 +399,7 @@ pph_out_tree_vec_filtered (pph_stream *stream, VEC(tree,gc) *v, unsigned filter) /* Collect all the nodes that match the filter. */ FOR_EACH_VEC_ELT (tree, v, i, t) - if (pph_tree_matches (stream, t, filter)) + if (pph_tree_matches (t, filter)) VEC_safe_push (tree, heap, to_write, t); /* Write them. */ @@ -533,7 +533,7 @@ pph_out_chain_filtered (pph_stream *stream, tree first, unsigned filter) /* Collect all the nodes that match the filter. */ for (t = first; t; t = TREE_CHAIN (t)) - if (pph_tree_matches (stream, t, filter)) + if (pph_tree_matches (t, filter)) VEC_safe_push (tree, heap, to_write, t); /* Write them. */ @@ -1746,7 +1746,8 @@ pph_add_decl_to_symtab (tree decl) /* Add INCLUDE to the list of files included by STREAM. If STREAM is NULL, INCLUDE is added to the list of includes for pph_out_stream - (the image that we are currently generating). */ + (the image that we are currently generating). Also add the INCLUDE + to the global list pph_read_images. */ void pph_add_include (pph_stream *stream, pph_stream *include) @@ -1754,6 +1755,8 @@ pph_add_include (pph_stream *stream, pph_stream *include) if (stream == NULL) stream = pph_out_stream; VEC_safe_push (pph_stream_ptr, heap, stream->includes, include); + + VEC_safe_push (pph_stream_ptr, heap, pph_read_images, include); } diff --git a/gcc/cp/pph-streamer.c b/gcc/cp/pph-streamer.c index 1ac5bf4..b6ccf0a 100644 --- a/gcc/cp/pph-streamer.c +++ b/gcc/cp/pph-streamer.c @@ -33,6 +33,13 @@ along with GCC; see the file COPYING3. If not see #include "cppbuiltin.h" #include "streamer-hooks.h" +/* List of PPH images read during parsing. Images opened during #include + processing and opened from pph_in_includes cannot be closed + immediately after reading, because the pickle cache contained in + them may be referenced from other images. We delay closing all of + them until the end of parsing (when pph_reader_finish is called). */ +VEC(pph_stream_ptr, heap) *pph_read_images = NULL; + /* Pre-load common tree nodes into the pickle cache in STREAM. These nodes are always built by the front end, so there is no need to pickle them. @@ -154,6 +161,7 @@ pph_stream_close (pph_stream *stream) destroy_output_block (stream->encoder.w.ob); free (stream->encoder.w.decl_state_stream); lto_delete_out_decl_state (stream->encoder.w.out_state); + VEC_free (pph_stream_ptr, heap, stream->includes); } else { @@ -423,8 +431,7 @@ pph_cache_lookup (pph_stream *stream, void *data, unsigned *ix_p) } -/* Return true if DATA is in the pickle cache of one of STREAM's - included images. +/* Return true if DATA is in the pickle cache of one of the included images. If DATA is found: - the index for INCLUDE_P into IMAGE->INCLUDES is returned in @@ -439,15 +446,15 @@ pph_cache_lookup (pph_stream *stream, void *data, unsigned *ix_p) - the function returns false. */ bool -pph_cache_lookup_in_includes (pph_stream *stream, void *data, - unsigned *include_ix_p, unsigned *ix_p) +pph_cache_lookup_in_includes (void *data, unsigned *include_ix_p, + unsigned *ix_p) { unsigned include_ix, ix; pph_stream *include; bool found_it; found_it = false; - FOR_EACH_VEC_ELT (pph_stream_ptr, stream->includes, include_ix, include) + FOR_EACH_VEC_ELT (pph_stream_ptr, pph_read_images, include_ix, include) if (pph_cache_lookup (include, data, &ix)) { found_it = true; @@ -512,7 +519,7 @@ pph_cache_get (pph_stream *stream, unsigned include_ix, unsigned ix) if (include_ix == (unsigned) -1) image = stream; else - image = VEC_index (pph_stream_ptr, stream->includes, include_ix); + image = VEC_index (pph_stream_ptr, pph_read_images, include_ix); data = VEC_index (void_p, image->cache.v, ix); gcc_assert (data); diff --git a/gcc/cp/pph-streamer.h b/gcc/cp/pph-streamer.h index 8c3298a..9e790fc 100644 --- a/gcc/cp/pph-streamer.h +++ b/gcc/cp/pph-streamer.h @@ -179,8 +179,8 @@ typedef struct pph_stream { they were instantiated originally. */ pph_symtab symtab; - /* List of PPH files included by the PPH file that we are currently - generating. Note that this list only contains PPH files, not + /* List of PPH files directly included by the PPH file that we are currently + generating/reading. Note that this list only contains PPH files, not regular text headers. Those are embedded in this stream. */ VEC(pph_stream_ptr,heap) *includes; } pph_stream; @@ -203,11 +203,12 @@ void pph_trace_chain (pph_stream *, tree); void pph_trace_bitpack (pph_stream *, struct bitpack_d *); void pph_cache_insert_at (pph_stream *, void *, unsigned); bool pph_cache_lookup (pph_stream *, void *, unsigned *); -bool pph_cache_lookup_in_includes (pph_stream *, void *, unsigned *, - unsigned *); +bool pph_cache_lookup_in_includes (void *, unsigned *, unsigned *); bool pph_cache_add (pph_stream *, void *, unsigned *); void *pph_cache_get (pph_stream *, unsigned, unsigned); +extern VEC(pph_stream_ptr, heap) *pph_read_images; + /* In pph-streamer-out.c. */ void pph_flush_buffers (pph_stream *); void pph_init_write (pph_stream *); diff --git a/gcc/cp/pph.c b/gcc/cp/pph.c index 91dc622..4779010 100644 --- a/gcc/cp/pph.c +++ b/gcc/cp/pph.c @@ -172,7 +172,7 @@ void pph_finish (void) { /* Finalize the writer. */ - pph_writer_finish (); + pph_writer_finish (); /* Finalize the reader. */ pph_reader_finish (); diff --git a/gcc/testsuite/g++.dg/pph/c2deepincl.cc b/gcc/testsuite/g++.dg/pph/c2deepincl.cc index da56b1e..bbf9402 100644 --- a/gcc/testsuite/g++.dg/pph/c2deepincl.cc +++ b/gcc/testsuite/g++.dg/pph/c2deepincl.cc @@ -1,5 +1,3 @@ -// pph asm xdiff 00611 - #include "c2deepincl3.h" int test() {