Orchard BlogML Module

Commented Unassigned: Issue with breaks / newline [15]

jsiegmund — Thu, 18 Apr 2013 19:24:31 GMT

After importing my blog posts, all of the newlines have disappeared. I checked the XML, in which they're present (as actual newlines, not <br/> tags or something).

I guess perhaps the file is using the incorrect newline characters or something. I tried fiddling in notepad++ changing the encoding and EOL conversion, didn't do anything.

Another question: in Wordpress I used <pre> tags with prettyprint to format code samples. What do I need to do to make that work in Orchard?
Comments: By the way, same issue was already handled (but not resolved) here: https://orchard.codeplex.com/discussions/397451.

Created Unassigned: Issue with breaks / newline [15]

jsiegmund — Thu, 18 Apr 2013 19:22:18 GMT

Commented Issue: Blog archives stuff everything imported in month of import, not actual month (Orchard 1.6) [14]

andrewconnell — Mon, 25 Mar 2013 20:43:31 GMT

Anyone else try to use this module to import content from an existing blog on Orchard 1.6 ? I'm successfully importing everything, but Orchard reports everything was posted in the month of the import rather than the correct month. Unpublishing/publishing the post fixes that specific post, but when you're importing hundreds of posts, this isn't a feasible option.
Comments: Check out a fork I created for the Orchard.Blogs module [ImportUtilityHelperCommands](http://orchard.codeplex.com/SourceControl/network/forks/andrewconnell/ImportUtilityHelperCommands) where I added a new commend to the command line Orchard tool that rebuilds the archive.

Commented Issue: Blog archives stuff everything imported in month of import, not actual month (Orchard 1.6) [14]

coderfin — Mon, 25 Mar 2013 18:12:13 GMT

Anyone else try to use this module to import content from an existing blog on Orchard 1.6 ? I'm successfully importing everything, but Orchard reports everything was posted in the month of the import rather than the correct month. Unpublishing/publishing the post fixes that specific post, but when you're importing hundreds of posts, this isn't a feasible option.
Comments: I had around 600 posts that I imported and ran into the same issue. I browsed to __Manage Blog__ and then selected __Show: All__ at the bottom. Then I opened up __Developer Tools__ and ran __$(':checkbox').prop('checked', true)__. This selected all of the checkboxes so that I could then run __Actions: Unpublish__. When everything was unpublished I did the same thing but selected __Actions: Publish Now__. A bit of a hack but it worked.

New Post: Blog archives stuff everything imported in month of import, not actual month (Orchard 1.6)

andrewconnell — Tue, 12 Mar 2013 13:48:53 GMT

Scenario: Running Orchard 1.6 and migrating from another engine (SubText) using the BlogML format & the BlogML module.

The module was written for Orchard 1.4 and from a few I talked to that used it, it worked fine. However I'm assuming something changed in the blog logic from Orchard 1.4 > 1.6. Basically when a blog post is published, it fires a handler that uses the current timestamp as the publish date which also is used for updating the archive month counters. Immediately after this, the BlogML module changes the Publish date so it looks correct in the UI & DB, but the counters are already set.

Changeset b486d94960b6 that added a command to the Orchard.Blogs module, but I had a bunch of issues with it. Not entirely sure how to comment / update a changeset, so posting my findings & fix here. First, here are the issues I found and how to address them. Then I'm posting the code from my replaced ArchiveService.cs file:

In the original file, lines 25 & 31 were getting the oldest & news blog posts in the DB, but not filtering based on the actual blog specified (see my introduction of a WHERE clause on lines 26 & 32).
For some reason, I was getting a ton of errors on line 61 in the changeset… NHibernate/LINQ couldn’t evaluate the x.CreatedUtc.Value property. Thus, I changed it and created (my file, lines 57-66) a generic list that had all the dates of each blog post & updated that line in the where clause to look at my generic list rather than querying the DB for counts. For me, this will result in 1 big call to the DB and the creation of a 1,500 item list (# of blog posts) vs. 120 DB count calls (I’ve been blogging for 10 years). Since it’s only done one time updating the archive… I’m not concerned with perf.
Issue in calculating the FROM & TO date range (original changeset lines 59 & 60). You’ll see my change in lines 70-72. Basically adding a month to the UTC converted date does just that… adds a month… but it might not jive with the timezone. For instance I had posts being missed on 12/31/2003. The reason is that it would use the start range of timezone formatted (I’m GMT -0500) of 11/30/2003 19:00:00 (-5hrs from 11/31/2003 00:00:00). When the changeset figured the end range (line 60), it resulted in 12/30/2003 19:00:00… but it should have been the 31st. The FIX: do the calculation before converting from UTC (see my line 72).
Another issue was that I didn’t want leading/trailing zero months. For instance, I started blogging in September 2003. The changeset would have put zero counters for January – August 2003. Same is true on the back side (I’m importing to March 2013, but I don’t want zero’d counters from April – December 2013). I addressed this in lines 74-81.
Finally, the way values were added to the DB caused some off by one dates. For instance using the year & month from the TO & FROM variables meant that it was off due to the timezone change. I fixed this by using the indexes of the for loops.

My ArchiveService.cs fixed file (this should overwrite the file in the changeset:

using System;
using System.Collections.Generic;
using System.Linq;
using Orchard.Blogs.Models;
using Orchard.ContentManagement;
using Orchard.Core.Common.Models;
using Orchard.Data;

namespace Orchard.Blogs.Services {
  public class ArchiveService : IArchiveService {
    private readonly IRepository<BlogPartArchiveRecord> _blogArchiveRepository;
    private readonly IContentManager _contentManager;
    private readonly IWorkContextAccessor _workContextAccessor;

    public ArchiveService(
        IRepository<BlogPartArchiveRecord> blogArchiveRepository,
        IContentManager contentManager,
        IWorkContextAccessor workContextAccessor) {
      _blogArchiveRepository = blogArchiveRepository;
      _contentManager = contentManager;
      _workContextAccessor = workContextAccessor;
    }

    public void RebuildArchive(BlogPart blogPart) {

      var first = _contentManager.Query<BlogPostPart>().Where<CommonPartRecord>(bp => bp.Container.Id == blogPart.Record.Id).OrderBy<CommonPartRecord>(x => x.CreatedUtc).Slice(0, 1).FirstOrDefault();

      if (first == null) {
        return;
      }

      var last = _contentManager.Query<BlogPostPart>().Where<CommonPartRecord>(bp => bp.Container.Id == blogPart.Record.Id).OrderByDescending<CommonPartRecord>(x => x.CreatedUtc).Slice(0, 1).FirstOrDefault();

      DateTime? start = DateTime.MaxValue;
      if (first.As<CommonPart>() != null) {
        start = first.As<CommonPart>().CreatedUtc;
      }

      DateTime? end = DateTime.MinValue;
      if (last.As<CommonPart>() != null) {
        end = last.As<CommonPart>().CreatedUtc;
      }

      // delete previous archive records
      foreach (var record in _blogArchiveRepository.Table.Where(x => x.BlogPart == blogPart.Record)) {
        _blogArchiveRepository.Delete(record);
      }

      if (!start.HasValue || !end.HasValue) {
        return;
      }

      // get the time zone for the current request
      var timeZone = _workContextAccessor.GetContext().CurrentTimeZone;

      // build a collection of all the post dates
      List<DateTime> blogPostDates = new List<DateTime>();
      var blogPosts = _contentManager.Query<BlogPostPart>().Where<CommonPartRecord>(bp => bp.Container.Id == blogPart.Record.Id);
      foreach (var blogPost in blogPosts.List()) {
        if (blogPost.As<CommonPart>() != null)
          if (blogPost.As<CommonPart>().CreatedUtc.HasValue) {
            DateTime timeZoneAdjustedCreatedDate = TimeZoneInfo.ConvertTimeFromUtc(blogPost.As<CommonPart>().CreatedUtc.Value, timeZone);
            blogPostDates.Add(timeZoneAdjustedCreatedDate);
            //System.Diagnostics.Debug.WriteLine(timeZoneAdjustedCreatedDate);
          }
      }

      for (int year = start.Value.Year; year <= end.Value.Year; year++) {
        for (int month = 1; month <= 12; month++) {
          DateTime fromDateUtc = new DateTime(year, month, 1);
          var from = TimeZoneInfo.ConvertTimeFromUtc(fromDateUtc, timeZone);
          var to = TimeZoneInfo.ConvertTimeFromUtc(fromDateUtc.AddMonths(1), timeZone);

          // skip the first months of the first year until a month has posts
          //  for instance, if started posting in May 2000, don't write counts for Jan 200 > April 2000... start May 2000
          if (from < TimeZoneInfo.ConvertTimeFromUtc(new DateTime(start.Value.Year, start.Value.Month, 1), timeZone))
            continue;
          // skip the last months of the last year if no posts
          //  for instance, no need to have archives for months in the future
          if (to > end.Value.AddMonths(1))
            continue;

          //var count = _contentManager.Query<BlogPostPart>().Where<CommonPartRecord>(x => x.CreatedUtc.Value >= from && x.CreatedUtc.Value < to).Count();
          var count = blogPostDates.Where(bp => bp >= from && bp < to).Count();

          var newArchiveRecord = new BlogPartArchiveRecord { BlogPart = blogPart.Record, Year = year, Month = month, PostCount = count };
          _blogArchiveRepository.Create(newArchiveRecord);
        }
      }
    }
  }
}

Created Issue: Blog archives stuff everything imported in month of import, not actual month (Orchard 1.6) [14]

andrewconnell — Thu, 07 Mar 2013 21:54:19 GMT

New Post: Blog archives stuff everything imported in month of import, not actual month (Orchard 1.6)

andrewconnell — Thu, 07 Mar 2013 21:54:04 GMT

New Post: Importing into an existing blog working? BlogIdToImportInto

kjopc — Thu, 29 Nov 2012 21:46:58 GMT

When importing, the ImportSettings value for BlogIdToImportInto seems to always be zero. It means the imported posts appear in a new blog, not into the one selected in the GUI.

Could someone check and confirm this?

Commented Issue: Transaction Timeout on large files [7]

kjopc — Sat, 03 Nov 2012 16:24:04 GMT

as title says
Comments: Still times out, even uploading to the Media folder. I suspect there needs to be a more robust batching process for large blogML files.

New Post: BlogML in Orchard 1.4

Jetski5822 — Thu, 05 Apr 2012 14:43:35 GMT

Hmm... Looks like a side affect of the refactor... The code was basically a rewrite, so I will take a look.

New Post: BlogML in Orchard 1.4

steve — Thu, 05 Apr 2012 11:26:46 GMT

I've found that if I use the same slug, it will import into the same blog...irrespective of what blog i choose form the drop down.

I also hit the timeout error .... I found setting the number of posts to import and slug worked as well...but this was easier!

upped the execution timeout as well Dave!

<httpRuntime executionTimeout="100000" />

New Post: BlogML in Orchard 1.4

Jetski5822 — Tue, 03 Apr 2012 14:54:05 GMT

Interesting that the blog didn't import into an existing blog. I will take a look at that.

BTW - I have seen the Base64 issue before.I will investigate.

Nick

On Tue, Apr 3, 2012 at 3:19 PM, DaveSussman <notifications@codeplex.com> wrote:

From: DaveSussman

I'm posting another reply so that if anyone else is converting from subText to Orchard via BlogML, they need to know that subText Base64 encodes the blog posts, so you'll need to uncovert them before importing into Orchard. I used the code at http://garfoot.com/blog/2010/08/importing-blogml-into-wordpress/ which worked fine.

Read the full discussion online.

To add a post to this discussion, reply to this email (OrchardBlogML@discussions.codeplex.com)

To start a new discussion for this project, email OrchardBlogML@discussions.codeplex.com

You are receiving this email because you subscribed to this discussion on CodePlex. You can unsubscribe on CodePlex.com.

Please note: Images and attachments will be removed from emails. Any posts to this discussion will also be available online at CodePlex.com

New Post: BlogML in Orchard 1.4

DaveSussman — Tue, 03 Apr 2012 14:19:47 GMT

I'm posting another reply so that if anyone else is converting from subText to Orchard via BlogML, they need to know that subText Base64 encodes the blog posts, so you'll need to uncovert them before importing into Orchard. I used the code at http://garfoot.com/blog/2010/08/importing-blogml-into-wordpress/ which worked fine.

New Post: BlogML in Orchard 1.4

DaveSussman — Tue, 03 Apr 2012 13:02:17 GMT

Ah, I din't think to check the gallery had been updated; I assumed this wasn'tpushed up yet.

I installed it fine, but the import worked until a timeout took down the request. My exported file is 1.3Mb, 343 entries, as exported from subText. I'll try cutting the file down.

edit: Ah, it did import - 243 items, but yes, it created a new blog. This will be a problem if I can't import the entire file as I wouldn't be able to merge any new blog. Maybe I'll just up the timeout while I import.

edit 2: increased timeout and import worked fine. Still created a new blog, but this is a new isntallation, so that's not a problem.

New Post: BlogML in Orchard 1.4

Steve — Tue, 03 Apr 2012 12:36:21 GMT

I downloaded the new version from the module gallery (from Orchard dashboard). It installed fine.

I got the new menu item, ran the import and the data imported fine.

However, I did find that even though I selected an existing blog to import the data into, it created another blog in Orchard. Not a major issue.

I tried again adding in the slug (of the existing blog), it added the slug fine, but again created a seperate blog.

I didn't try any other options.

New Post: BlogML in Orchard 1.4

DaveSussman — Tue, 03 Apr 2012 12:33:20 GMT

I compiled it, yanking in the assemblies from my 1.4 installation, but wasn't sure what to do next - I'm new to Orchard and it's setup. I did try renaming the old BlogML Modules folder and copying in the new one, but that did change anything - ie, the menu item didn't appear. What should I do to get this usable within Orchard?

New Post: BlogML module not importing tags

Jetski5822 — Sat, 31 Mar 2012 16:16:34 GMT

I have also pushed a whole bunch of fixes for 1.4 to the dev branch... I noticed a tagging issue in the default branch but I have corrected that issue. Let me know how you get on.

New Post: error in orchard.tags module after importing blogs through blogml module

Jetski5822 — Sat, 31 Mar 2012 16:16:22 GMT

I have also pushed a whole bunch of fixes for 1.4 to the dev branch... I noticed a tagging issue in the default branch but I have corrected that issue. Let me know how you get on.

New Post: BlogML request timeout error

Jetski5822 — Sat, 31 Mar 2012 16:15:39 GMT

If the file is large, i would recommending it up to the media folder and use the url import which is baked in to this module, that will get around that issues.

I have also pushed a whole bunch of fixes for 1.4 to the dev branch... could you give it a test for me please and I will release the moduel to the gallary.

Let me know how you get on.

New Post: Error exporting generates "Object reference not set to an instance of an object"

Jetski5822 — Sat, 31 Mar 2012 16:14:27 GMT

Yeah its to do with 1.4

I have push a whole bunch of fixes for 1.4 to the dev branch... could you give it a test for me please and I will release the moduel to the gallary.

Let me know how you get on.